Loading Events

« All Events

  • This event has passed.

WS 2: On the need of good practices and standards for Benchmarking Brain-Machine Interfaces

March 4 @ 10:00 am

4:00pm CET, 10:00am EST, 7:00am PST, 2:00am AEDT, 11:00pm (CST)

Registration deadline: February 25


  • Ricardo Chavarriaga, Zurich University Applied Sciences, ZHAW (Switzerland) ; Chair IEEE Industry Connections group on neurotechnologies for brain-machine interface (https://twitter.com/r_chavarriaga)
  • Paul Sajda, Columbia University (USA), Chair IEEE BRAIN Initiative
  • José Contreras-Vidal, FIEEE, NSF IUCRC BRAIN Center, University of Houston (USA) ; Co-Chair IEEE Industry Connections group on neurotechnologies for brain-machine interface (https://twitter.com/pepe_uh)
  • Luigi Bianchi, “Tor Vergata” University of Rome (IT) ; Chair IEEE P2731: Standard for a unified terminology for brain-computer interfaces
  • Zach McKinney , The BioRobotics Institute-Scuola Superiore Sant’Anna (IT); Chair IEEE Standard project P2794: Reporting of In Vivo Neural Interface Research
  • Laura Y. Cabrera,  The Pennsylvania State University (USA). Chair Neuroethics Subcommittee IEEE BRAIN Initiative. (https://twitter.com/NeuroethCabrera)

Translating Brain-Machine Interfacing (BMI) systems outside research laboratories onto real applications requires reliable measurement of their performance. However, there are no accepted, well-defined criteria to assess their effectiveness, usability or safety. Few attempts of benchmarking have mainly focused on off-line comparison of decoding accuracy, neglecting the effects of closed loop interaction, as well as other elements of the BMI loop (e.g. shared-control or hybrid BMI systems). This workshop will work on the identification of specific challenges related to assessing performance of closed-loop BMI systems, and propose specific action points that can lead toward good practices and standards on benchmarking BMI systems. This workshop is supported by CLAIRE (htttp://claire-ai.org), the IEEE EMB standards committee, the IEEE Brain Initiative, the IEEE Standards Association working group on neurotechnologies (http://standards.ieee.org/industry-connections/neurotechnologies-for-brain-machine-interfacing.html).

Intended audience
The workshop is aimed at all individuals interested in the development and translation of neurotechnologies from research prototypes onto clinical and consumer applications. These include novice and experienced researchers, potential innovators and entrepreneurs, as well as representatives of the industry and regulatory bodies among others

Learning objectives
1. Participants will improve their knowledge about the current situation and practices regarding performance evaluation and standards relevant to neurotechnologies and brain-machine interfaces
2. Participants will acknowledge the importance agreed metrics and benchmarking have in the successful translation of research onto clinical and consumer applications
3. Participants will be able to identify current scenario and initiatives that can help the definition of common metrics and standards for BMI performance evaluation

Ricardo Chavarriaga: r_chavarriaga@ieee.org


March 4
10:00 am
Event Category: