Quantifying System‑Environment Synergistic Information by Effective Information Decomposition

Digital Technologies Research and Applications

Article

Quantifying System‑Environment Synergistic Information by Effective Information Decomposition

Downloads

https://doi.org/10.54963/dtra.v4i3.1492
Yang, M., Pan, L., & Zhang, J. (2025). Quantifying System‑Environment Synergistic Information by Effective Information Decomposition. Digital Technologies Research and Applications, 4(3), 22–34. https://doi.org/10.54963/dtra.v4i3.1492
Volume 4 Issue 3: December 2025 (In Progress)
Copyright (c) 2025 Mingzhe Yang, Linli Pan, Jiang Zhang
Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Copyright

The authors shall retain the copyright of their work but allow the Publisher to publish, copy, distribute, and convey the work.

License

Digital Technologies Research and Applications (DTRA)  publishes accepted manuscripts under Creative Commons Attribution 4.0 International (CC BY 4.0). Authors who submit their papers for publication by DTRA agree to have the CC BY 4.0 license applied to their work, and that anyone is allowed to reuse the article or part of it free of charge for any purpose, including commercial use. As long as the author and original source are properly cited, anyone may copy, redistribute, reuse, and transform the content.

Authors

  • Mingzhe Yang

    School of Systems Science, Beijing Normal University, Beijing 100875, China
  • Linli Pan

    School of Systems Science, Beijing Normal University, Beijing 100875, China
  • Jiang Zhang

    School of Systems Science, Beijing Normal University, Beijing 100875, China
    Swarma Research, Beijing 102300, China

Received: 3 August 2025; Revised: 27 August 2025; Accepted: 3 September 2025; Published: 29 September 2025

Living systems maintain structural and functional stability while adapting to environmental changes, a capability independent of specific system‑environment states. Existing frameworks, such as self‑organization theory and free energy principles, cannot measure system‑environment interaction at the causal level. In this article, we propose a new causal indicator, Flexibility, to measure a system’s ability to respond to its environment. We construct this indicator based on information theory and interventional operations from causal inference, which implies the indicator depends only on the dynamical causal mechanism. We show this indicator satisfies the axiom system of the partial information decomposition (PID) framework and decomposes into two components, Expansiveness and Introversion, which correspond to different strategic tendencies for environmental adaptation. This decomposition reveals that Flexibility depends on the entanglement between system‑environment variables and noise magnitude. Through experiments on cellular automata (CA), random Boolean networks, and real gene regulatory networks (GRNs), we validate that the indicator identifies the most complex and computationally capable CA (Langton’s parameter at 0.5), while demonstrating that feedback loops carrying important biological functions in GRNs exhibit the highest flexibility. We also find that flexibility peaks at a moderate level of dynamical noise. Furthermore, we combine this framework with machine learning techniques to demonstrate its applicability when the underlying dynamics are unknown.

Keywords:

Synergy Flexibility Effective Information Partial Information Decomposition Gene Regulatory Networks

References

  1. Kauffman, S.A. The Origins of Order: Self-Organization and Selection in Evolution; Oxford University Press: Oxford, UK, 1993.
  2. Langton, C.G. Computation at the edge of chaos: Phase transitions and emergent computation. Physica D 1990, 42, 12–37.
  3. Lansing, J.S. Complex adaptive systems. Annu. Rev. Anthropol. 2003, 32, 183–204.
  4. Friston, K.J.; Stephan, K.E. Free-energy and the brain. Synthese 2007, 159, 417–458.
  5. Holland, J.H.; Miller, J.H. Artificial adaptive agents in economic theory. Am. Econ. Rev. 1991, 81, 365–370.
  6. Holland, J.H. Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence; MIT Press: Cambridge, MA, USA, 1992.
  7. Holland, J.H. Complex adaptive systems. Daedalus 1992, 121, 17–30.
  8. Tkačik, G.; Bialek, W. Information processing in living systems. Annu. Rev. Condens. Matter Phys. 2016, 7, 89–117.
  9. Bartlett, S.; Eckford, A.W.; Egbert, M.; et al. The physics of life: Exploring information as a distinctive feature of living systems. PRX Life 2025, 3, 037003.
  10. Rosas, F.; Mediano, P.A.; Ugarte, M.; et al. An information-theoretic approach to self-organisation: Emergence of complex interdependencies in coupled dynamical systems. Entropy 2018, 20, 793.
  11. Gershenson, C.; Fernández, N. Complexity and information: Measuring emergence, self-organization, and homeostasis at multiple scales. Complexity 2012, 18, 29–44.
  12. Krakauer, D.; Bertschinger, N.; Olbrich, E.; et al. The information theory of individuality. Theory Biosci. 2020, 139, 209–223.
  13. Barandiaran, X.E.; Di Paolo, E.; Rohde, M. Defining agency: Individuality, normativity, asymmetry, and spatio-temporality in action. Adapt. Behav. 2009, 17, 367–386.
  14. Hoel, E.P.; Albantakis, L.; Tononi, G. Quantifying causal emergence shows that macro can beat micro. Proc. Natl. Acad. Sci. USA 2013, 110, 19790–19795.
  15. Oizumi, M.; Albantakis, L.; Tononi, G. From the phenomenology to the mechanisms of consciousness: Integrated information theory 3.0. PLoS Comput. Biol. 2014, 10, e1003588.
  16. Hoel, E.P. When the map is better than the territory. Entropy 2017, 19, 188.
  17. Yuan, B.; Zhang, J.; Lyu, A.; et al. Emergence and causality in complex systems: A survey of causal emergence and related quantitative studies. Entropy 2024, 26, 108.
  18. Zhang, J.; Tao, R.; Leong, K.H.; et al. Dynamical reversibility and a new theory of causal emergence based on SVD. npj Complex. 2025, 2, 3.
  19. Yang, M.; Wang, Z.; Liu, K.; et al. Finding emergence in data by maximizing effective information. Natl. Sci. Rev. 2024, 12, nwae279.
  20. Varley, T.F. Flickering emergences: The question of locality in information-theoretic approaches to emergence. Entropy 2022, 25, 54.
  21. Pearl, J.; Mackenzie, D. The Book of Why: The New Science of Cause and Effect; Basic Books: New York, NY, USA, 2018.
  22. Williams, P.L.; Beer, R.D. Nonnegative decomposition of multivariate information. arXiv 2010, arXiv:1004.2515.
  23. Lizier, J.T.; Bertschinger, N.; Jost, J.; et al. Information decomposition of target effects from multi-source interactions: Perspectives on previous, current, and future work. Entropy 2018, 20, 307.
  24. Bertschinger, N.; Rauh, J.; Olbrich, E.; et al. Shared information—new insights and problems in decomposing information in complex systems. In Proceedings of the European Conference on Complex Systems 2012; Springer: Berlin/Heidelberg, Germany, 2013; pp. 251–269.
  25. Ghosh, D.; Marwan, N.; Small, M.; et al. Recent achievements in nonlinear dynamics, synchronization, and networks. Chaos 2024, 34, 063132.
  26. Alon, U. An Introduction to Systems Biology: Design Principles of Biological Circuits; Chapman and Hall/CRC: Boca Raton, FL, USA, 2019.
  27. Albantakis, L.; Barbosa, L.; Findlay, G.; et al. Integrated information theory (IIT) 4.0: Formulating the properties of phenomenal existence in physical terms. PLoS Comput. Biol. 2023, 19, e1011465.
  28. Williams, P.L. Information Dynamics: Its Theory and Application to Embodied Cognitive Systems; Ph.D. Thesis, Indiana University, Bloomington, IN, USA, 2011.
  29. Zhang, Y.-N.; Zhu, X.-Y.; Wang, W.-P.; et al. Reproductive switching analysis of Daphnia similoides between sexual female and parthenogenetic female by transcriptome comparison. Sci. Rep. 2016, 6, 34241.
  30. Wolfram, S. Statistical mechanics of cellular automata. Rev. Mod. Phys. 1983, 55, 601–644.
  31. Mitchell, M.; Hraber, P.; Crutchfield, J.P. Revisiting the edge of chaos: Evolving cellular automata to perform computations. arXiv 1993, adap-org/9303003. DOI: https://doi.org/10.48550/arXiv.adap-org/9303003
  32. Teuscher, C. Revisiting the edge of chaos: Again? Biosystems 2022, 218, 104693.
  33. Kadelka, C.; Butrie, T.-M.; Hilton, E.; et al. A meta-analysis of Boolean network models reveals design principles of gene regulatory networks. Sci. Adv. 2024, 10, eadj0822.
  34. Orio, P.; Mediano, P.A.; Rosas, F.E. Dynamical noise can enhance high-order statistical structure in complex systems. Chaos 2023, 33, 043128.
  35. Leong, R.; He, X.; Beijen, B.S.; et al. Unlocking gene regulatory networks for crop resilience and sustainable agriculture. Nat. Biotechnol. 2025, 43, 1254–1265.
  36. Jiang, W.; Ye, W.; Tan, X.; et al. Network-based multi-omics integrative analysis methods in drug discovery: A systematic review. BioData Min. 2025, 18, 27.
  37. Farhadi, A.; Zamanifar, A.; Faezipour, M. Application of generative AI in drug discovery. In Application of Generative AI in Healthcare Systems; Springer: Cham, Switzerland, 2025; pp. 155–174.
  38. Dong, S.; Zhou, W. Improved influential nodes identification in complex networks. J. Intell. Fuzzy Syst. 2021, 41, 6263–6271.
  39. Dong, S.; Tao, X.; Zhong, R.; et al. Advanced mathematics exercise recommendation based on automatic knowledge extraction and multilayer knowledge graph. IEEE Trans. Learn. Technol. 2024, 17, 776–793.