Result: PsychRNN: An Accessible and Flexible Python Package for Training Recurrent Neural Network Models on Cognitive Tasks.

Title:
PsychRNN: An Accessible and Flexible Python Package for Training Recurrent Neural Network Models on Cognitive Tasks.
Authors:
Ehrlich DB; Interdepartmental Neuroscience Program, Yale University, New Haven, CT 06520-8074., Stone JT; Department of Computer Science, Yale University, New Haven, CT 06520-8285., Brandfonbrener D; Department of Computer Science, Yale University, New Haven, CT 06520-8285.; Department of Computer Science, New York University, New York, NY 10012., Atanasov A; Department of Physics, Yale University, New Haven, CT 06511-8499.; Department of Physics, Harvard University, Cambridge, MA 02138., Murray JD; Interdepartmental Neuroscience Program, Yale University, New Haven, CT 06520-8074 john.murray@yale.edu.; Department of Physics, Yale University, New Haven, CT 06511-8499.; Department of Psychiatry, Yale School of Medicine, New Haven, CT 06511.
Source:
ENeuro [eNeuro] 2021 Jan 15; Vol. 8 (1). Date of Electronic Publication: 2021 Jan 15 (Print Publication: 2021).
Publication Type:
Journal Article
Language:
English
Journal Info:
Publisher: Society for Neuroscience Country of Publication: United States NLM ID: 101647362 Publication Model: Electronic-Print Cited Medium: Internet ISSN: 2373-2822 (Electronic) Linking ISSN: 23732822 NLM ISO Abbreviation: eNeuro Subsets: MEDLINE
Imprint Name(s):
Original Publication: [Washington, DC] : Society for Neuroscience, [2014]-
References:
Curr Opin Neurobiol. 2014 Apr;25:156-63. (PMID: 24509098)
Nat Neurosci. 2016 Mar;19(3):356-65. (PMID: 26906502)
Neuron. 2015 May 20;86(4):1067-1077. (PMID: 25959731)
Nature. 2006 Sep 7;443(7107):85-8. (PMID: 16936716)
Neural Comput. 1997 Nov 15;9(8):1735-80. (PMID: 9377276)
Annu Rev Vis Sci. 2015 Nov 24;1:417-446. (PMID: 28532370)
Nat Neurosci. 2018 Dec;21(12):1753-1763. (PMID: 30455456)
Nat Neurosci. 2015 Jul;18(7):1025-33. (PMID: 26075643)
Nat Neurosci. 2019 Feb;22(2):275-283. (PMID: 30664767)
J Neurophysiol. 2018 Mar 1;119(3):796-807. (PMID: 29142094)
Elife. 2020 May 15;9:. (PMID: 32412409)
Nat Neurosci. 2019 Nov;22(11):1761-1770. (PMID: 31659335)
Neuron. 2009 Aug 27;63(4):544-57. (PMID: 19709635)
Neuron. 2020 Sep 23;107(6):1048-1070. (PMID: 32970997)
Neural Comput. 2018 Jun;30(6):1514-1541. (PMID: 29652587)
Neuron. 2018 Jun 6;98(5):1005-1019.e5. (PMID: 29879384)
Neuron. 2016 Apr 6;90(1):128-42. (PMID: 26971945)
J Neurosci. 2002 Nov 1;22(21):9475-89. (PMID: 12417672)
Nature. 2013 Nov 7;503(7474):78-84. (PMID: 24201281)
Cognition. 2009 Mar;110(3):380-94. (PMID: 19121518)
Curr Opin Neurobiol. 2017 Oct;46:1-6. (PMID: 28668365)
Elife. 2017 Feb 23;6:. (PMID: 28230528)
Neuron. 2020 Aug 19;107(4):603-616. (PMID: 32663439)
PLoS Comput Biol. 2016 Feb 29;12(2):e1004792. (PMID: 26928718)
Nat Neurosci. 2019 Jul;22(7):1159-1167. (PMID: 31182866)
Nature. 1999 Jun 3;399(6735):470-3. (PMID: 10365959)
Grant Information:
R01 MH112746 United States MH NIMH NIH HHS
Contributed Indexing:
Keywords: cognitive task; computational model; deep learning; recurrent neural network; training
Entry Date(s):
Date Created: 20201217 Date Completed: 20210618 Latest Revision: 20230321
Update Code:
20250114
PubMed Central ID:
PMC7814477
DOI:
10.1523/ENEURO.0427-20.2020
PMID:
33328247
Database:
MEDLINE

Further Information

Task-trained artificial recurrent neural networks (RNNs) provide a computational modeling framework of increasing interest and application in computational, systems, and cognitive neuroscience. RNNs can be trained, using deep-learning methods, to perform cognitive tasks used in animal and human experiments and can be studied to investigate potential neural representations and circuit mechanisms underlying cognitive computations and behavior. Widespread application of these approaches within neuroscience has been limited by technical barriers in use of deep-learning software packages to train network models. Here, we introduce PsychRNN, an accessible, flexible, and extensible Python package for training RNNs on cognitive tasks. Our package is designed for accessibility, for researchers to define tasks and train RNN models using only Python and NumPy, without requiring knowledge of deep-learning software. The training backend is based on TensorFlow and is readily extensible for researchers with TensorFlow knowledge to develop projects with additional customization. PsychRNN implements a number of specialized features to support applications in systems and cognitive neuroscience. Users can impose neurobiologically relevant constraints on synaptic connectivity patterns. Furthermore, specification of cognitive tasks has a modular structure, which facilitates parametric variation of task demands to examine their impact on model solutions. PsychRNN also enables task shaping during training, or curriculum learning, in which tasks are adjusted in closed-loop based on performance. Shaping is ubiquitous in training of animals in cognitive tasks, and PsychRNN allows investigation of how shaping trajectories impact learning and model solutions. Overall, the PsychRNN framework facilitates application of trained RNNs in neuroscience research.
(Copyright © 2021 Ehrlich et al.)