Dynamics of On-Line Gradient Descent Learning for Multilayer Neural Networks

David Saad; Sara A. Solla

Dynamics of On-Line Gradient Descent Learning for Multilayer Neural Networks

David Saad^*, Sara A. Solla

^*Corresponding author for this work

Neuroscience

Research output: Contribution to conference › Paper › peer-review

24 Scopus citations

Abstract

We consider the problem of on-line gradient descent learning for general two-layer neural networks. An analytic solution is presented and used to investigate the role of the learning rate in controlling the evolution and convergence of the learning process.

Original language	English (US)
Pages	302-308
Number of pages	7
State	Published - 1995
Event	8th International Conference on Neural Information Processing Systems, NIPS 1995 - Denver, United States Duration: Nov 27 1995 → Dec 2 1995

Conference

Conference	8th International Conference on Neural Information Processing Systems, NIPS 1995
Country/Territory	United States
City	Denver
Period	11/27/95 → 12/2/95

ASJC Scopus subject areas

Information Systems
Computer Networks and Communications
Signal Processing

Cite this

@conference{2146c712809f4083b999add18ca9536e,

title = "Dynamics of On-Line Gradient Descent Learning for Multilayer Neural Networks",

abstract = "We consider the problem of on-line gradient descent learning for general two-layer neural networks. An analytic solution is presented and used to investigate the role of the learning rate in controlling the evolution and convergence of the learning process.",

author = "David Saad and Solla, {Sara A.}",

note = "Funding Information: Acknowledgement The work was supported by the EU grant CHRX-CT92-0063. Publisher Copyright: {\textcopyright} NIPS 1995: Proceedings of the 8th International Conference on Neural Information Processing Systems. All rights reserved.; 8th International Conference on Neural Information Processing Systems, NIPS 1995 ; Conference date: 27-11-1995 Through 02-12-1995",

year = "1995",

language = "English (US)",

pages = "302--308",

}

TY - CONF

T1 - Dynamics of On-Line Gradient Descent Learning for Multilayer Neural Networks

AU - Saad, David

AU - Solla, Sara A.

N1 - Funding Information: Acknowledgement The work was supported by the EU grant CHRX-CT92-0063. Publisher Copyright: © NIPS 1995: Proceedings of the 8th International Conference on Neural Information Processing Systems. All rights reserved.

PY - 1995

Y1 - 1995

N2 - We consider the problem of on-line gradient descent learning for general two-layer neural networks. An analytic solution is presented and used to investigate the role of the learning rate in controlling the evolution and convergence of the learning process.

AB - We consider the problem of on-line gradient descent learning for general two-layer neural networks. An analytic solution is presented and used to investigate the role of the learning rate in controlling the evolution and convergence of the learning process.

UR - http://www.scopus.com/inward/record.url?scp=85156229494&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85156229494&partnerID=8YFLogxK

M3 - Paper

AN - SCOPUS:85156229494

SP - 302

EP - 308

T2 - 8th International Conference on Neural Information Processing Systems, NIPS 1995

Y2 - 27 November 1995 through 2 December 1995

ER -

Dynamics of On-Line Gradient Descent Learning for Multilayer Neural Networks

Abstract

Conference

ASJC Scopus subject areas

Other files and links

Fingerprint

Cite this