Communication & Control

BCI interface to AT software

BCI technology aims at increasing people’s communication and control capabilities by providing access to a variety of devices (virtual keyboards, Internet, etc.).

Our Motor Imagery (MI) based BCI system has been integrated into Assistive Technology (AT) software, thus allowing people with impaired motor skills to convey typed messages to the external world as well as to browse documents on the Internet. The AT platform QualiWORLD has been chosen for our experimentation, providing a variety of applications as well as user input alternatives replacing the standard mouse and keyboard.

In the short videos below, we show several applications:

Web Browsing with Assistive Technology

The BCI to QualiWorld interface enables control by simultaneously processing BCI-actuated commands and AT events, in a shared control approach.

QualiWORLD sequentially scans the controls of the focused menu. The BCI user performs two different MI tasks to move the feedback bar either left or right. Upon reaching the end of the designated area, the respective command is communicated to QualiWORLD.

“Right” command selects the scanned element, while “left” command is used to navigate among different menus.

The shared control prevents erroneous actions (e.g. closing the application) and decides the effects of the “left” command according to the application.

 

EPFL Web bowsing demos

Text Editor with Assistive Technology Software.

In this demonstration, the user writes using our Assistive Techology Software.

The system automatically scans slowly the group, then the row and finally the character.

“Right” command selects the scanned group, row or character. “Left” command reverses the scanning order to speed up character typing.

 

EPLF Text Entry editor demo

Text Entry with the Hex-O-Speller

In this variation of the text editor, the prototype presents various sets of letters in 6 hexagons. An arrow rotates from one hexagon to the other one. Once it reaches the hexagone with the target letter, the subject actively selects this area with the BCI. The set of selected letters is then distributes in a new hexagone for selection. Once the letter has been selected the system goes back to the first screen containing the most probable set of letters, and the user reiterates the cycle to select the following letter.

 

 

 

TUB hexospell demo