This Brain Implant Lets People Control Amazon Alexa With Their Minds
“It’s pretty exciting and freeing to keep my independence,” Mark says. “Some days can be more challenging, especially depending how I’m feeling, but the layout of the Amazon tablet makes it pretty easy to interact with and complete the tasks I need to.”
Amazon declined to respond to a request for comment.
Synchron has also connected Mark’s BCI to OpenAI’s ChatGPT and the Apple Vision Pro, a mixed-reality headset. Released earlier this year, the Vision Pro requires hand gestures to make item selections. After Synchron’s integration, Mark could use his thoughts to control the cursor on the Vision Pro to play Solitaire, watch Apple TV, and send text messages. In addition to Mark, one of Synchron’s trial participants in Australia is now using these applications as well.
Alexa and the Vision Pro both connect to Mark’s BCI via Bluetooth. A Synchron field engineer visits Mark at his home in Pennsylvania twice a week while he practices using his BCI. Mark says the different platforms provide a range of capabilities that he can use in his daily life, but the experience isn’t always smooth. “We’ve been working through accessibility challenges on all platforms to make it better for the next generation of users,” he says.
Synchron’s BCI resembles a mesh stent and is dotted with electrodes that collect neural signals. Instead of being directly implanted in the brain, it’s inserted into the jugular vein at the base of the neck in a minimally invasive procedure. A surgeon pushes the device through the vein until it sits against the motor cortex—a region of the brain that controls voluntary movement. Once implanted, it’s designed to detect and wirelessly transmit movement intentions out of the brain so that paralyzed people can control personal devices hands-free.
While virtual assistants are already helpful for people with disabilities, they don’t always afford privacy since they rely on voice commands that can be overheard. “Restoring any amount of independence is really important to people, but restoring independent private use is even better,” says Emily Graczyk, an assistant professor of biomedical engineering at Case Western Reserve University, who is working on restoring sensation with BCIs.
She thinks Synchron’s approach could also help provide a sense of normalcy to people with limited mobility because it means they can use the same devices as their families and friends, rather than special assistive devices.
Ian Burkhart, a quadriplegic who participated in a trial of a different company’s BCI, sees Synchron’s efforts as a positive thing for patients as long as the devices are seamlessly integrated and users can interact with them in a practical way in their day-to-day lives. “It’s really interesting,” he says. “I see the future of BCI as just being a pipe that can let data flow from the brain to control anything that you can control with a computer.” Burkhart received an implant made by Blackrock Neurotech in 2014 but had it removed in 2021 after developing an infection.
Oxley says Synchron is working on more features and says it is talking to other big tech companies about further integrations. The most common thing that paralyzed patients say they want is to be able to multitask, he says.
“Things like scroll, click, drag, menu drop-down, back—all these different things that we use our fingers to do—we’re figuring out ways to identify unique signatures from the brain and can then generate product features to control operating systems,” Oxley says.
Mark is hoping his BCI will eventually allow him to do more complex tasks. For one, he wants to get back to painting.
Source link