The Free Energy Principle is a mathematical principle borrowed from information theory. It theorizes that the universal goal of living systems is to minimize a quantity of “free energy” in order to maintain their existence in a dynamic world.1
The “free energy” quantity can be though of as an Isomorphism to the idea of “Entropy” as a quantity in Information Theory.
This is already sort of the case for Backward Propagation based machine learning models, which are tasked with minimizing a Loss Function as their quantity.
Footnotes
-
Friston, K. (2010). The free-energy principle: A unified brain theory? Nature Reviews Neuroscience, 11(2), 127–138. https://doi.org/10.1038/nrn2787 ↩