Skip to content

Latest commit

 

History

History
310 lines (150 loc) · 24.4 KB

File metadata and controls

310 lines (150 loc) · 24.4 KB

AI for Brain-Computer interface

A curated list of resources dedicated to AI (ML/DL/RL) applied to brain-computer interfaces.

For several years now, as hardware and learning methods have been perfected, the applications of AI to brain-machine interfaces have become more and more numerous. The brain is a highly complex system The brain is a complex system and learning algorithms are probably the only technique that will allow BCIs to develop to their full potential .

I strongly encourage people interested in the fields to make pull request to update their paper's information!

Contents

Must-read papers on AI for Brain computer interfaces.

Introduction

This is a list of articles about AI for brain-computer interface.

I have tried to include both major papers from the biomedical field - curing epilepsy, restoring sight to the blind, curing paraplegic, restoring the sense of touch via a robotic prosthesis - as well as more theoretical and conceptual papers - the brain as a non linear dynamical system,inferring latent variable from recordings,multi-agent framework... because I think both are relevant to the field.

I spend a lot of time reading all the articles to make sure the tags match what is described in the article. If you see an error, please let me know. I will be updating this list regularly with incoming literature, so feel free to contribute as well.

Keywords Convention

The "invasivness" of the BCI used.

The precise device used in the paper.

The type of model used for the experiment (Human/Animal/Simulation).

The type of interaction between the brain and the machine (Recording/Stimulation/Bidirectional).

If the paper develop concepts without any particular experimentation.

Overviews

This section contains the papers that overview the general trends in AI for brain-computer interface.

  1. Brain Co-Processors: Using AI to Restore and Augment Brain Function. 2020

    Rajesh P. N. Rao [pdf]

  2. Computation Through Neural Population Dynamics. 2020

    Saurabh Vyas,Matthew D. Golub,David Sussillo,and Krishna V. Shenoy [pdf]

  3. Efficient characterization of electrically evoked responses for neural interfaces. 2019

    Nishal Shah, Sasidhar Madugula, Pawel Hottowy, Alexander Sher, Alan Litke, Liam Paninski, E.J. Chichilnisky [pdf]

  4. Computational challenges and opportunities for a bi-directional artificial retina. 2020

    Nishal P Shah, E. J. Chichilnisky [pdf]

  5. The combination of brain-computer interfaces and artificial intelligence: applications and challenges 2020

    Xiayin Zhang,..,Haotian Lin [pdf]

  6. A multi-agent control framework for co-adaptation in brain-computer interfaces, 2013

    Josh S. Merel, Roy Fox, Tony Jebara, Liam Paninski [pdf]

Pilot work

This section contains the pilot works of AI for brain computer interfaces.

  1. Using Neural Networks to Improve Cochlear Implant Speech Perception 1987.

    Manoel Tenorio. [pdf]

  2. A Novel Channel Selection System in Cochlear Implants Using Artificial Neural Network 1995. Marwan Jabri, Raymond Wang [pdf]

  3. An Auditory Paradigm for Brain-Computer Interfaces 2004.

    N. Hill, Thomas Lal, Karin Bierig, Niels Birbaumer, Bernhard Schölkopf. [pdf]

  4. Methods Towards Invasive Human Brain Computer Interfaces 2004.

    Zhengbao Jiang, Frank F. Xu, Jun Araki, Graham Neubig. [pdf]

  5. Dynamic Bayesian Networks for Brain-Computer Interfaces 2004.

    Pradeep Shenoy, Rajesh PN Rao. [pdf]

  6. A recurrent neural network for closed-loop intracortical brain-machine interface decoders 2012. David Sussillo,Paul Nuyujukian,Joline M Fan, Jonathan C Kao, Sergey D Stavisky, Stephen Ryu, and Krishna Shenoy. [pdf]

  7. Reducing Calibration Time For Brain-Computer Interfaces: A Clustering Approach 2006.

    Matthias Krauledat, Michael Schröder, Benjamin Blankertz, Klaus-Robert Müller [pdf]

  8. Adaptive Treatment of Epilepsy via Batch-mode Reinforcement Learning 2008. Arthur Guez, Massimo Avoli, Joelle Pineau. [pdf]

  9. Kernel-ARMA for Hand Tracking and Brain-Machine interfacing During 3D Motor Control 2008.

    Lavi Shpigelman, Hagai Lalazar, Eilon Vaadia. [pdf]

  10. A general framework for investigating how far the decoding process in the brain can be simplified 2008.

    Masafumi Oizumi, Toshiyuki Ishii, Kazuya Ishibashi, Toshihiko Hosoya, Masato Okada. [pdf]

  11. Coadaptive Brain–Machine Interface via Reinforcement Learning 2009.

    Jack DiGiovanna, Babak Mahmoudi, Jose C. Principe,Justin C. Sanchez. [pdf]

  12. Optimization of Electrical Stimulation for a High-Fidelity Artificial Retina 2017.

    Nishal P. Shah, Babak Mahmoudi, Jose Fortes, Jose C. Principe,E.J. Chichilnisky. [pdf]

  13. Multiscale Semi-Markov Dynamics for Intracortical Brain-Computer Interfaces 2017.

    Daniel Milstein, Jason Pacheco, Leigh Hochberg, John D. Simeral, Beata Jarosiewicz, Erik Sudderth. [pdf]

  14. Information-based Adaptive Stimulus Selection to Optimize Communication Efficiency in Brain-Computer Interfaces 2018.

    Boyla Mainsah, Dmitry Kalika, Leslie Collins, Siyuan Liu, Chandra Throckmorton. [pdf]

  15. Model-Based Design of Closed Loop Deep Brain Stimulation Controller using Reinforcement Learning 2020.

    Qitong Gao,..., Miroslav Pajic. [pdf]

  16. Adversarial Domain Adaptation for Stable Brain-Machine Interfaces 2019.

    Ali Farshchian, Juan A. Gallego, Lee E. Miller,Sara A. Sollag,Joseph P. Cohen, Yoshua Bengio. [pdf]

  17. Reinforcement Learning Framework for Deep Brain Stimulation Study 2019.

    Dmitrii Krylov, Remi Tachet, Romain Laroche, Michael Rosenblum, Dmitry V. Dylov. [pdf]

  18. Hierarchical Bayesian Optimization of Spatiotemporal Neurostimulations for Targeted Motor Outputs 2020.

    Samuel Laferriere, Marco Bonizzato, Sandrine L Cote, Numa Dancause, Guillaume Lajoie. [pdf]

  19. Neurolight: A Deep Learning Neural Interface for Cortical Visual Prostheses 2020.

    Antonio Lozano,.., Eduardo Fernandez . [pdf]

  20. Stabilizing brain-computer interfaces through alignment of latent dynamics 2022.

    Brianna M. Karpowicz,Yahia H. Ali, Lahiru N. Wimalasena, Andrew R. Sedler, Mohammad Reza Keshtkaran, Kevin Bodkin, Xuan Ma, Lee E. Miller, Chethan Pandarinath. [pdf]

  21. A Hybrid Neural Autoencoder for Sensory Neuroprostheses and Its Applications in Bionic Vision 2022.

    Jacob Granley, Lucas Relic, Michael Beyeler[pdf]

  22. Adapting Brain-Like Neural Networks for Modeling Cortical Visual Prostheses 2022.

    Jacob Granley, Alexander Riedel, Michael Beyeler[pdf]

  23. Mind Reader: Reconstructing complex images from brain activities 2022.

    Sikun Lin, Thomas Sprague, Ambuj K Singh [pdf]

  24. Plug-and-Play Stability for Intracortical Brain-Computer Interfaces: A One-Year Demonstration of Seamless Brain-to-Text Communication 2023.

    Chaofei Fan, Nick Hahn, Foram Kamdar, Donald Avansino, Guy Wilson, Leigh Hochberg, Krishna V Shenoy, Jaimie Henderson, Francis Willett [pdf]

  25. Balancing memorization and generalization in RNNs for high performance brain-machine Interfaces 2023.

    Joseph Costello, Hisham Temmar, Luis Cubillos, Matthew Mender, Dylan Wallace, Matt Willsey, Parag Patil, Cynthia Chestek [pdf]

  26. PPi: Pretraining Brain Signal Model for Patient-independent Seizure Detection 2023.

    Zhizhang Yuan, Daoze Zhang, Yang Yang, Junru Chen, Yafeng Li [pdf]

  27. Human-in-the-Loop Optimization for Deep Stimulus Encoding in Visual Prostheses 2023.

    Jacob Granley, Tristan Fauvel, Matthew Chalk, Michael Beyeler [pdf]

  28. Brain decoding: toward real-time reconstruction of visual perception 2023.

    Yohann Benchetrit, Hubert Banville, Jean-Rémi King [pdf]

Related

This section contains neuroscience/BCI related subject that don't directly refere to AI for BCI but are relevant to the subject (e.g decoding latent variable, using dynamical systems framework,bioengineering,....)

  1. Restoring Natural Sensory Feedback in Real-Time Bidirectional Hand Prostheses 2014.

    Stanisa Raspopovic,..., Silvestro Micera [pdf]

  2. LFADS - Latent Factor Analysis via Dynamical Systems 2016.

    David Sussillo, Rafal Jozefowicz, L. F. Abbott, Chethan Pandarinath [pdf]

  3. Using goal-driven deep learning models to understand sensory cortex 2016.

    Daniel L K Yamins & James J DiCarlo. [pdf]

  4. Correlation-based model of artificially induced plasticity in motor cortex by a Bidirectional brain-computer interface 2017

    Guillaume Lajoie ,Nedialko I. Krouchev,John F. Kalaska,Adrienne L. Fairhall,Eberhard E. Fetz [pdf]

  5. Inferring single-trial neural population dynamics using sequential auto-encoders 2018

    Chethan Pandarinath ,...,David Sussillo [pdf]

  6. Structure in neural population recordings: an expected byproduct of simpler phenomena? 2017

    Gamaleldin F Elsayed , John P Cunningham [pdf]

  7. An integrated brain-machine interface platform with thousands of channels (Neuralink device launch paper) 2019.

    Elon Musk,Neuralink [pdf]

  8. From deep learning to mechanistic understanding in neuroscience: the structure of retinal prediction 2019

    Hidenori Tanaka, Aran Nayebi, Niru Maheswaranathan, Lane McIntosh, Stephen Baccus, Surya Ganguli [pdf]

  9. Structure in neural population recordings: an expected byproduct of simpler phenomena? 2019.

    Gamaleldin F Elsayed & John P Cunningham [pdf]

  10. A deep learning framework for neuroscience 2019.

    Blake .A Richards & Konrad P. Kording [pdf]

  11. Neural population control via deep image synthesis 2019.

    Pouya Bashivan, Kohitij Kar, James J Dicarlo [pdf]

  12. Generative Models of Brain Dynamics -- A review 2021

    Mahta Ramezanian Panahi, Germán Abrevaya, Jean-Christophe Gagnon-Audet, Vikram Voleti, Irina Rish, Guillaume Dumas [pdf]

  13. A brain-computer interface that evokes tactile sensations improves robotic arm control 2021

    Sharlene N. Flesher,..,Robert A. Gaunt [pdf]

  14. Mine Your Own vieW: Self-Supervised Learning Through Across-Sample Prediction 2021.

    Mehdi Azabou,Eva L. Dyer [pdf]

  15. Drop, Swap, and Generate: A Self-Supervised Approach for Generating Neural Activity 2021.

    Ran Liu,Mehdi Azabou, Max Dabagia, Chi-Heng Lin, Mohammad Gheshlaghi Azar, Keith B. Hengen, Michal Valko, Eva L. Dyer [pdf]

  16. Latent Factors and Dynamics in Motor Cortex and Their Application to Brain–Machine Interfaces 2021.

    Chethan Pandarinath, K. Cora Ames, Abigail A. Russo, Ali Farshchian, Lee E. Miller, Eva L. Dyer and Jonathan C. Kao [pdf]

  17. Neural Latents Benchmark '21: Evaluating latent variable models of neural population activity 2021.

    Felix Pei,..,Chethan Pandarinath [pdf]

  18. Comparing high-dimensional neural recordings by aligning their low-dimensional latent representations 2022.

    Max Dabagia, Konrad P Kording, Eva L Dyer [pdf]

  19. The application of artificial intelligence to biology and neuroscience 2022.

    Blake Richards, Doris Tsao, Anthony Zador [pdf]

  20. A Unified, Scalable Framework for Neural Population Decoding 2023.

    Mehdi Azabou, Vinam Arora, Venkataramana Ganesh, Ximeng Mao, Santosh Nachimuthu, Michael J. Mendelson, Blake Richards, Matthew G. Perich, Guillaume Lajoie, Eva L. Dyer [pdf]

Contribution

Contributing to this paper list

  • First, think about which category the work should belong to.
  • Second, use the same format as the others to discribe the work. Note that there should be an empty line between the title and the authors list, and take care of the indentation.
  • Then, add keywords tags. Add the pdf link of the paper. I

Don't worry if you put all these wrong, we will fix them for you. Just contribute and promote your awesome work here!

Thanks to https://github.com/thunlp/PromptPapers for their awesome template !.