The next time you’re scrolling your phone, take a moment to appreciate the feat: This seemingly mundane act is possible thanks to the coordination of 34 muscles, 27 joints, and more than 100 tendons and ligaments in your hand. Indeed, our hands are the nimblest parts of our bodies. Mimicking their many nuanced gestures has been a longstanding challenge in robotics and virtual reality.

Now, MIT engineers have designed an ultrasound wristband that precisely tracks a wearer’s hand movements in real time. The wristband produces ultrasound images of the wrist’s muscles, tendons, and ligaments as the hand moves, and is paired with an artificial intelligence algorithm that continuously translates the images into the corresponding positions of the five fingers and palm.

The researchers can train the wristband to learn a wearer’s hand motions, which the device can communicate in real time to a robot or a virtual environment.

 …