Volume 1 · Number 2 · Pages 83–90

< Previous Paper · Next Paper >

Towards Closed Loop Information: Predictive Information

Bernd Porr, Alice Egerton & Florentin Wörgötter

Download the full text in
PDF (174 kB)

Abstract

Motivation: Classical definitions of information, such as the Shannon information, are designed for open loop systems because they define information on a channel which has an input and an output. The main motivation of this paper is to present a closed loop information measure which is compatible with constructivist thinking. Design: Our information measure for a closed loop system reflects how additional sensor inputs are utilised to establish additional sensor-motor loops during learning. Our information measure is based on the assumption that it is not optimal to stay reactive and that it is beneficial to become proactive through increased learning about the environment. Consequently our information measure gauges the utilisation of new sensor inputs to generate anticipatory actions. We call this information measure “predictive information” (PI). Findings: Our PI is zero if the organism uses only its reflex reactions. It grows when the organism is able to use other sensor inputs to preempt reflex reactions and is able to replace reflexes by anticipatory reactions. This has been demonstrated with a real robot that had to learn to avoid obstacles. Conclusion: PI is a new measure which is able to quantify anticipatory learning and, in contrast to the Shannon information, is calculated only at the inputs of an agent. This information measure has been successfully applied to a simple robot task but its application is neither limited to a certain task nor to a certain learning rule.

Key words: closed loop system, information measure, differential Hebbian learning, reactive vs proactive systems

Citation

Porr B., Egerton A. & Wörgötter F. (2006) Towards Closed Loop Information: Predictive Information. Constructivist Foundations 1(2): 83–90. Available at http://constructivist.info/1/2/083.porr

Export article citation data: Plain Text · BibTex · EndNote · Reference Manager (RIS)

Similar articles

Porr B. & Di Prodi P. (2014) Subsystem Formation Driven by Double Contingency

Porr B. (2016) “Truthful” Acting Emerges Through Forward Model Development

Porr B. & Di Prodi P. (2014) Authors’ Response: What to Do Next: Applying Flexible Learning Algorithms to Develop Constructivist Communication

Porr B. (2013) The Construction of the Environment

Comments: 0

To stay informed about comments to this publication and post comments yourself, please log in first.