Yiyue Luo鈥檚 at the 糖心少女 is full of machinery that鈥檚 oddly cozy. Here, soft and pliable sensors are sewn, knit and glued directly into clothing to give everyday garments new capabilities.聽
One of the lab鈥檚 newest curiosities is a nondescript gray work glove embedded with sensors that enable it to 鈥渇eel鈥� on its own. An array of small wires hidden inside the glove report the location and degree of pressure anywhere along its surface. When in use, the signals from the glove inform a realtime 鈥渉eat map鈥� of pressure that could one day help physical therapy patients track their progress, teach robots to grasp objects, and more.
The project, as it鈥檚 officially known, is led by 糖心少女electrical and computer engineering doctoral student as part of a collaboration with the and at MIT. 糖心少女News caught up with Murphy to learn more about the glove and its potential uses.
What inspired you to create this glove?
Devin Murphy: Our hands are arguably our greatest tools as humans. We interact with the world through our hands in so many different ways. But the nature of how we grasp and manipulate things in our environment is super nuanced and complex, and it鈥檚 hard to capture. We have very mature electronics that record sight and sound 鈥� think of the cameras and microphones in your smartphone. But there aren鈥檛 many electronic devices that record our other senses 鈥� like touch. That鈥檚 what I鈥檝e been working to remedy with the OpenTouch Glove.
How does the glove work? What are its capabilities?
DM: There are two flexible circuit boards inside each glove that form a grid of wires across the gripping surface of the glove. We can measure pressure at any point in that mesh where two wires meet. The circuit boards connect to a little box of electronics at the user鈥檚 wrist, which processes the signals and sends them wirelessly to a laptop.
We can then generate a 鈥渉eat map鈥� image showing where force is being applied on the hand, where the hand is applying force to different objects and how much force the hand is applying.聽
This kind of data gives us extra nuance that a camera can’t capture. For example, if your hand is in a bag or behind an object while it鈥檚 grasping things, a camera wouldn鈥檛 be able to tell what your hand is doing, whereas this glove can follow along.
What are some potential applications for the glove?
DM: I’m particularly excited about how this technology might help patients recovering from an injury. Physical therapists have patients perform a variety of tasks to regain mobility in their hands 鈥� if we can measure how much force people apply during this process, we can provide them with concrete feedback. The patient and therapist can both track progress by monitoring grip strength of the patient over time.聽
We鈥檙e also seeing lots of new companies invest in physical intelligence for robotics 鈥� basically recording how robots interact with the physical world. If we can record human hand grip signals, we might be able to teach robotic hands how to mimic human behavior.聽
One other interesting application is in augmented reality or virtual reality. If we replaced traditional controllers with these gloves, it could give users a more natural way to interact with virtual objects and scenery 鈥� though we鈥檇 need some additional technology for users to feel pressure when gripping virtual things.
How can other researchers access this technology?
DM: It鈥檚 really important to us that the glove is accessible to other researchers and anyone else who might want to use it for their own applications. You can order all of the components of the glove directly from commercial manufacturers, and we have released all of the manufacturing files and instructions for putting the glove together yourself.聽
We’ve also shown some demos of the glove 鈥渋n the wild鈥� to showcase the different kinds of data it can collect, and we鈥檙e planning to release an open source data set collected with the glove in partnership with researchers at MIT.聽
I鈥檓 really excited about developing new wearable technologies that allow people to record less popular sensing modalities like touch. I want to figure out how we can capture the nuances of touch-based interactions, so that ultimately we can get better insights into our daily lives.
For more information, contact Murphy at devinmur@uw.edu.