Evolving neurocontrollers for balancing an inverted pendulum

Authors
Citation
F. Pasemann, Evolving neurocontrollers for balancing an inverted pendulum, NETWORK-COM, 9(4), 1998, pp. 495-511
Citations number
35
Categorie Soggetti
AI Robotics and Automatic Control
Journal title
NETWORK-COMPUTATION IN NEURAL SYSTEMS
ISSN journal
0954898X → ACNP
Volume
9
Issue
4
Year of publication
1998
Pages
495 - 511
Database
ISI
SICI code
0954-898X(199811)9:4<495:ENFBAI>2.0.ZU;2-9
Abstract
This paper introduces an evolutionary algorithm that is tailored to generat e recurrent neural networks functioning as nonlinear controllers. Network s ize and architecture, as well as network parameters like weights and bias t erms, are developed simultaneously. There is no quantization of inputs, out puts dr internal parameters. Different kinds of evolved networks are presen ted that solve the pole-balancing problem, i.e. balancing an inverted pendu lum. In particular, controllers solving the problem for reduced phase space information (only angle and cart position) use a recurrent connectivity st ructure. Evolved controllers of 'minimal' size still have a very good bench mark performance.