Simultaneous speech and gesture decoding for multimodal communication in paralysis.

Neural signals from a single high-density electrocorticography implant can support simultaneous decoding of speech and gestures in people with paralysis.

• Why it matters: Restoring natural communication for individuals with paralysis remains challenging because previous BCIs mainly focused on decoding speech or gestures separately, limiting their effectiveness.
• What they did: Researchers recorded neural activity from three participants with paralysis and developed parallel decoders for speech and gestures, enabling control of a virtual avatar during combined or isolated attempts.
• The result: Training on both isolated and simultaneous data improved decoding performance, demonstrating that a single cortical implant can support multi-effector control and advance BCIs toward more natural communication.