Treffer: PyDTNN: A user-friendly and extensible framework for distributed deep learning.

Title:
PyDTNN: A user-friendly and extensible framework for distributed deep learning.
Authors:
Barrachina, Sergio1 (AUTHOR), Castelló, Adrián1 (AUTHOR), Catalán, Mar1 (AUTHOR), Dolz, Manuel F.1 (AUTHOR) dolzm@uji.es, Mestre, Jose I.1 (AUTHOR)
Source:
Journal of Supercomputing. Sep2021, Vol. 77 Issue 9, p9971-9987. 17p.
Subject Terms:
*PYTHON programming language, *DEEP learning, *NEURAL computers, *CONVOLUTIONAL neural networks
Database:
Academic Search Index

Weitere Informationen

We introduce a framework for training deep neural networks on clusters of computers with the following appealing properties: (1) It is developed in Python, exposing an amiable interface that provides an accessible entry point for the newcomer; (2) it is extensible, offering a customizable tool for the more advanced user in deep learning; (3) it covers the main functionality appearing in convolutional neural networks; and (4) it delivers reasonable inter-node parallel performance exploiting data parallelism by leveraging MPI via MPI4Py for communication and NumPy for the efficient execution of (multithreaded) numerical kernels. [ABSTRACT FROM AUTHOR]