Part I: Foundations
The Self-Effect Regime
Introduction
0:00 / 0:00
The Self-Effect Regime
As a controller becomes more capable, it increasingly shapes its own environment. The observations it receives are increasingly consequences of its own actions.
The self-effect ratio quantifies this shift. For a system with policy in environment :
where denotes mutual information and denotes entropy. This measures what fraction of the information in future observations is attributable to past actions. For capable agents in structured environments, increases with agent capability, and in the limit:
(bounded by the environment’s intrinsic stochasticity).