Dr. Christoph Salge
Marie Curie Global Fellow
Adaptive Systems Research Group
Department of Computer Science
University of Hertfordshire
Hatfield AL10 9AB
Game Innovation Lab
Tandon School of Engineering
New York University
New York, 11201
United States of America
I am a Marie Curie Global Fellow working on a project (INTERCOGAM) that uses intrinsic motivation formalisms to evaluate procedurally generated game content. While I technically work for the University of Hertfordshire,
I am currently on a two year secondment to the Game Innovation Lab at NYU, where I work with Julian Togelius.
My Google Scholar Profile
Previous ActivityI have previously worked on two EU project, SocSMCs and CORBYS. I have a PhD in Computer Science and Philosophy, titled "Information-Theoretic Models of Social Interaction, where I was supervised by Daniel Polani, Daniel Hutto and Luciano Floridi.
I was a guest editor for a Special Issue in Entropy on "Information Theoretic Incentives for Cognitive Systems", which is an open-call, special issue following our workshop on Information Theoretic Incentives for Artificial Life. I also organize a follow up workshop at ECAL 2015 called Information Theory in Artificial Life and a stand-alone workshop on Information Theory in Decision Making.
(2017) Christoph Salge and Daniel Polani: Empowerment As Replacement for the Three Laws of Robotics, Frontiers in Robotics and AI, 4, 2017. (Link)
(2017) Christian Goetter and Christoph Salge: Die Mechanismen der Geschichte im Spiel,, Schwerpunkt Krieg im Computerspiel, hg. v. Martin Clauss/Martin Munke/Markus Poehlmann,, in: Portal Militaergeschichte, 3. April 2017.(Link)
(2011) Christoph Salge and Daniel Polani: Digested Information as an Information Theoretic Motivation for Social Interaction, Journal of Artificial Societies and Social Simulation (JASSS), 14(1), 2011. (Link | Postprint | Abstract | Bibtex)
Within a universal agent-world interaction framework, based on Information Theory and Causal Bayesian Networks, we demonstrate how every agent that needs to acquire relevant information in regard to its strategy selection will automatically inject part of this information back into the environment. We introduce the concept of 'Digested Information' which both quantifies, and explains this phenomenon. Based on the properties of digested information, especially the high density of relevant information in other agents actions, we outline how this could motivate the development of low level social interaction mechanisms, such as the ability to detect other agents.
(2009) Christoph Salge and Daniel Polani: Information Driven Organization of Visual Receptive Fields, Advances in Complex Systems (ACS), vol. 12, issue 03, pages 311-326, 2009. (Link | Postprint | Abstract | Bibtex)
By using information theory to reduce the state space of sensor arrays, such as receptive fields, for AI decision making we offer an adaptive algorithm without classical biases of hand coded approaches. This paper presents a way to build an acyclic directed graph to organize the sensor inputs of a visual receptive field. The Information Distance Metric is used to repeatedly select two sensors, which contain the most information about each other. Those are then encoded to a single variable, of equal alphabet size, with a deterministic mapping function that aims to create maximal entropy while maintaining a low information distance to the original sensors. The resulting tree determines which sensors are fused to reduce the input data while maintaining a maximum of information. The structure adapts to different environments of input images by encoding groups of preferred line structures or creating a higher resolution for areas with simulated movement. These effects are created without prior assumptions about the sensor statistics or the spatial configuration of the receptive field, and are cheap to compute since only pair-wise informational comparison of sensors is used.
(2017) Guckelsberger, C., Salge, C., Colton, S.: Addressing the ''Why?'' in Computational Creativity: A Non-Anthropocentric, Minimal Model of Intentional Creative Agency, Proceedings of the 8th International Conference on Computational Creativity (ICCC '17), Atlanta, USA, 2017. (Link)
(2017) Robu, A.D., Salge, C., Nehaniv, C.L. and Polani, D.,: Time as it could Be measured in Artificial Living Systems, Proceedings of the Thirteenth European Conference on Artificial Life (ECAL), Lyon, France, in Press, 2017. (ArXiv)
(2017) Guckelsberger C, Salge C, Colton S.: Intrinsically Motivated General Companion NPCs via Coupled Empowerment Maximisation, Proceedings of the 2016 IEEE Conference on Computational Intelligence and Games (CIG), SanTorini, Greece, 2016. (Preprint)
(2016) Guckelsberger, C, Salge, C, Saunders, R, Colton, S.: Supportive and Antagonistic Behaviour in Distributed Computational Creativity via Coupled Empowerment Maximisation, In Proceedings of the Seventh International Conference on Computational Creativity (ICCC '16), Paris, France, 2016. (Preprint)
(2016) Guckelsberger, C, Salge, C.: Does Empowerment Maximisation Allow for Enactive Artificial Agents?, In Proceedings of the Fifteenth International Conference on the Synthesis and Simulation of Living Systems (Alife 2016). Cancun, Mexico, 2016. (Link | Preprint)
(2015) Glackin C. et. al.: Learning gait by therapist demonstration for natural-like walking with CORBYS powered orthosis, Proceedings of the 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Hamburg, Germany.
(2014) Salge, C., Glackin, C., Ristić-Durrant, D., Greaves, M. and Polani, D.: Information-theoretic measures as a generic approach to human-robot interaction: application in CORBYS project, Proceedings of the 2014 ACM/IEEE international conference on Human-robot interaction, Bielefeld, Germany.
(2014) Glackin, C., Salge, C., Greaves, M., Polani, D., Slavnic, S., Ristic-Durrant, D., Leu, A. and Matjacic, Z.: Gait Trajectory Prediction using Gaussian Process Ensembles, Proceedings of 2014 IEEE-RAS International Conference on Humanoid Robots, Madrid, Spain, 2014.
(2014) Salge, C. and Polani, D.: Don't Believe Everything You Hear; Preserving Relevant Information by Discarding Social Information, Proceedings of the Fourteenth International Conference on the Synthesis and Simulation of Living Systems (Alife 14), 2014 (ArXiv link).
(2014) Biehl, M., Salge, C. and Polani, D.: Towards Designing Artificial Universes for Artificial Agents under Interaction Closure, Proceedings of the Fourteenth International Conference on the Synthesis and Simulation of Living Systems (Alife 14), 2014 (ArXiv link).
(2013) Salge, C., Glackin, C. and Polani, D.: Empowerment and State-dependent Noise - An Intrinsic Motivation for Avoiding Unpredictable Agents, Advances in Artificial Life, ECAL, volume. 12, pages 118--125, 2013. ( Download | Bibtex )
(2013) Leu, A., Ristic-Durrant, D., Slavnic, S., Glackin, C., Salge, C., Polani, D., Badii, A., Khan, A. and Raval, R.: CORBYS Cognitive Control Architecture for Robotic Follower, 2013 IEEE/SICE International Symposium on System Integration, 2013.
(2011) Salge, C. and Polani, D.: Local Information Maximisation creates Emergent Flocking Behaviour, Advances in Artificial Life, ECAL 2011: Proceedings of the Eleventh European Conference on Artificial Life, pages 688-696, 2011. (Abstract | Download| Bibtex )
The three boids rules of alignment, separation and cohesion, introduced by Reynolds to recreate flocking behaviour have become a well known standard to create swarm behaviour. In this paper we want to demonstrate how similar flocking behaviour can be created by a local, agent based model, following a principle of information maximisation. The basis for our model is an extension of Vergassola's infotaxis model, where agents determine their actions based on the highest expected reduction of entropy. We adapted this approach to a grid world-based search task, and extended the agents abilities so they could not only perform a Bayesian update with information gained from the environment, but also with information gained from other agents. The resulting global flocking behaviour is then analysed in regard to how well it resembles the basic boids rules.
(2010) Salge, C.: Digested Information, a Non-Semantic Motivation for Agent-Agent Interaction, In Proc. of 8th European Conference on Computing and Philsophy(ECAP10), Munich, 2010. (PDF | Abstract | Bibtex)
Digested Information is a theory that aims to explain, at the non-semantic level of Information Theory, why it makes sense for one agent to observe another. Based on the formalism of Relevant Information, defined as the minimum amount of information an agent needs in order to determine its optimal strategy, I argue that, following its own motivation, an agent (1) obtains relevant information from the environment (2) displays it in the environment through its own actions, and (3) is likely to display information in a higher density in regard to its bandwidth than other parts of the environment. Furthermore, I argue that this information is also relevant to other, similar, agents and that this could be used to motivate agent-agent interaction (such as observing other agents) in a framework where agent behaviour is determined by information maximisation.
(2010) Salge, C. and Polani, D.: Extended Abstract: From Infotaxis to Boids-like Swarm Behaviour, in Proc. of Artificial Life, Odense, Denmark, 2010. (PDF)
(2010) Salge, C. and Mahlmann, T.: Relevant Information as a Formalised Approach to Evaluate Game Mechanics, in Proc. of IEEE Computational Intelligence in Games Conference 2010, Copenhagen, pages 281 - 288, 2010. (PDF | Abstract | Bibtex)
We present a new approach to use adaptive AI and Information Theory to aid the evaluation of game mechanics. Being able to evaluate the core game mechanics early during production is useful to improve the quality of a game, and ultimately, player satisfaction. A current problem with automated game evaluation via AI is to define measurable parameters that correlate to the quality of the game mechanics. We apply the Information Theory based concept of “Relevant Information” to this problem and argue that there is a relation between enjoyment related game-play properties and Relevant Information for an AI playing the game. We also demonstrate, with a simple game implementation, a.) how an adaptive AI can be used to approximate the Relevant Information, b.) how those measurable numerical values relate to certain game design flaws c.) how this knowledge can be used to improve the game.
(2008) Salge, C., Lipski, C., Mahlmann, T. and Mathiak, B.: Using Genetically Optimized AIs to improve Gameplaying Fun for Strategical Games, in Proc. of SIGGRAPH Sandbox 2008, Los Angeles, pages 7 -14, 2008. (PDF | Abstract | Bibtex)
Fun in computer games depends on many factors. While some factors like uniqueness and humor can only be measured by human subjects, in a strategical game, the rule system is an important and measurable factor. Classics like chess and GO have a millennia-old story of success, based on clever rule design. They only have a few rules, are relatively easy to understand, but still they have myriads of possibilities. Testing the deepness of a rule-set is very hard, especially for a rule system as complex as in a classic strategic computer game. It is necessary, though, to ensure prolonged gaming fun.
This paper presents a way to build a treelike network structure to organise the sensor inputs of a visual receptive field. The Information Distance Metric is used to repeatedly select two sensors, which contain the most information about each other. Those are then encoded to a single variable of equal capacity with a mapping function that tries to create maximal entropy while maintaining a low information distance to the original sensors. The resulting tree determines which sensors are fused to reduce the input data while maintaining maximum information. The structure adapts to different environments of input images, by encoding groups of preferred line structures or creating a higher resolution of areas with simulated movement. These effects are created without prior assumption of the environment or the spatial configuration of the receptive field and are cheap to compute, since only pairwise informational comparison of sensors is used.
(2016) Christoph Salge and Daniel Polani: Dealing with Noise and Other Agents - The Empowerment of Controller Selection, Extended Abstract for the Eigth Workshop on Guided Self-Organization, Cancun, Mexico, 2016. (Link)
(2015) Christian Götter and Christoph Salge: The Mechanisms of History at Play, Extended Abstract, Workshop "Krieg und organisierte Gewalt im Computerspiel'', Chemnitz, 2015. (PDF)
This dissertation demonstrates, in a non-semantic information-theoretic framework, how the principles of "maximisation of relevant information'' and "information parsimony'' can guide the adaptation of an agent towards agent-agent interaction. Central to this thesis is the concept of digested information; I argue that an agent is intrinsically motivated to a.) process the relevant information in its environment and b.) display this information in its own actions. From the perspective of similar agents, who require similar information, this differentiates other agents from the rest of the environment, by virtue of the information they provide. This provides an informational incentive to observe other agents and integrate their information into one's own decision making process.
This process is formalized in the framework of information theory, which allows for a quantitative treatment of the resulting effects, specifically how the digested information of an agent is influenced by several factors, such as the agent's performance and the integrated information of other agents.
Two specific phenomena based on information maximisation arise in this thesis. One is flocking behaviour similar to boids that results when agents are searching for a location in a girdworld and integrated the information in other agent's actions via Bayes' Theorem. The other is an effect where integrating information from too many agents becomes detrimental to an agent's performance, for which several explanations are provided.
(2013) Christoph Salge, Nihat Ay, Daniel Polani and Mikhail Prokopenko: Zipf's Law: Balancing Signal Usage Cost and Communication Efficiency, Santa Fe Working Paper, 2013 (Pdf Link)
(2013) Christoph Salge and Daniel Polani: Changing the Environment based on Intrinsic Motivation, Extended Abstract for ECCS 2013 Workshop: Guided Self-Organization 6, Barcelona, 2013. (ArXiv Link)
Abstract: A first step towards social interaction is to observe other agents and their actions. The concept of "Relevant Information" is used to argue, from an information theoretic perspective, why it would be beneficial to observe other agents, and why observing their actions should be relevant to me, even if their actions are not. A simple grid world model illustrates those points, for a simple information gathering task, and shows how to utilise this information to increase an agent's performance.