Dexterous robot hands have been demoed everywhere lately — but almost all of them focus on simple tasks like folding clothes or grasping a cup. Many of the viral manipulation videos online are also sped up; remove the fast-forward, and the motion turns visibly clumsy and stiff.
Yet the human hand, the very model embodied AI is trying to imitate, is far more refined. Take pen spinning: a practiced spin finishes in about half a second. The thumb, index finger, and middle finger cooperate to flick the pen into the air, flip it, and catch it. Such motions are full of sudden starts and stops, and spectral analysis shows their angular-velocity signals still carry significant energy above 100 Hz. The same high-frequency adjustments appear in everyday actions like catching a ball, unscrewing a cap, tying shoelaces, and using chopsticks.
Why has it been so hard for robots to reproduce these fast, fine movements? Zhu Yixin, Assistant Professor at Peking University's School of Psychological and Cognitive Sciences and Institute for Artificial Intelligence, has studied data gloves and dexterous hands for nearly a decade. His blunt diagnosis: the field has never clearly answered a foundational question — what does "dexterity" actually mean?
Looking like a hand — five fingers that bend and straighten — is not dexterity. In his view, the speed of response to external stimuli is a core dimension of dexterity. And the industry cannot deliver it, largely because of low-frequency data collection: to teach a robot to be dexterous, you first have to see the human hand clearly.
Robot Learning Needs High-Fidelity Human Demonstration Data
Robot learning depends on high-fidelity human demonstration data, but the sampling rates of existing wearable capture devices rarely exceed 200 times per second (200 Hz); most sit in the tens to 200 Hz range. Even at the 200 Hz ceiling, the Nyquist–Shannon sampling theorem says you can only reconstruct motion details below 100 Hz — anything faster is lost.
To close this gap, Zhu, together with Tang Xiyuan, Assistant Professor at Peking University's Institute for Artificial Intelligence and School of Integrated Circuits, recently developed a data glove named T-800 — after the Terminator, and for its 800 Hz sampling rate. The work was published in SmartBot, the English-language journal Intelligent Robotics, co-published by Harbin Institute of Technology and Wiley. PhD students Luo Haoyang and Zhao Zihang are co-first authors.
Seeing the Hand's High-Frequency Details
T-800 is a flexible glove worn on the hand that outputs hand posture in real time. Seventeen miniature inertial measurement units (IMUs — six-axis chips sensing rotation and acceleration) are distributed along the back of the hand, the palm, and each finger, plus one reference IMU in the wrist hub: 18 IMUs in total, covering every joint from wrist to fingertips.
Each IMU samples asynchronously at a nominal 800 Hz, and the host realigns them onto a strictly synchronized 800 Hz time grid. All batteries, the main controller, and antennas sit in a small box on the wrist, connected to the sensors by five flexible printed circuits (FPCs), minimizing load on the fingers.
Packing 800 Hz whole-hand synchronization into such a small volume required solving two problems: each sensor must measure accurately, and all 18 must stay aligned.
For individual accuracy, hand mechanics interfere: skin stretches and fabric slides when fingers bend, and during grasping, the glove fabric's tension and the bone's reaction force press directly on the IMU chips. At 800 Hz sampling, this seriously corrupts the data. The team borrowed the shielding-can structure used to block electromagnetic interference in analog circuits — sandwiching each IMU between a metal top cap and a metal base plate. The rigid shell absorbs fabric tension and bone reaction forces and generates enough friction to hold the module firmly against the bone. Each finished module is only 9.8 mm long, 6.8 mm wide, and 2.2 mm thick — smaller than a pinky nail.
Aligning 18 sensors in time is just as hard. Each IMU has its own internal oscillator as a clock source; manufacturing differences and temperature drift make frequencies deviate slightly, accumulating into millisecond-level drift during continuous capture. The team reprogrammed the hardware peripherals of the ESP32-S3 main controller into a hardware-level broadcast mode, so a single latch-timestamp command reaches all IMUs simultaneously over hardware signal lines. The repeated synchronization events create a series of "time anchors" that let the host dynamically compensate each clock's drift.
The approach paid off beyond expectations: because temperature also shifts oscillator frequency, the broadcast mechanism compensates temperature drift while calibrating clocks. In comparison experiments, subjects performed 140 seconds of continuous fast hand-flip motion. With the old single calibration, sensor deviation grew over time and the reconstructed motion deformed; with broadcast synchronization, error stayed within a very small range.
Verifying That High-Frequency Motion Is Real
With this system, the team could finally answer a deeper scientific question: does human fast manipulation actually contain motion above 100 Hz?
They validated it with pen spinning and ball catching. Asked why they did not demonstrate folding clothes, Zhu's answer was direct: folding clothes does not demand high precision, but pen spinning is in-hand manipulation — requiring fast coordination between fingers to precisely change an object's position — which demonstrates dexterity more vividly. Zhao added that grasping tasks were avoided for the same reason: once an object is securely held, its relative position to the hand barely changes, so no high-frequency hand motion is needed.
Spectral analysis showed that in one-direction pen spins, the participating thumb, index, and middle fingers showed clear energy bursts above 100 Hz; two-direction spins, which involve sudden stops and reverse acceleration, showed even stronger high-frequency energy.
