The crucial role of Theory of Mind (ToM) capabilities in developing a next generation, human-centric artificial intelligence
3rd September 2018
Emerging applications of artificial intelligence (AI) are raising awareness of the limitations of established machine learning (ML) approaches in situations in which humans are involved. Smart cars, for instance, need to make reliable predictions about human behaviour in real time, e.g. in order to pre-emptively adjust speed and course to cope with a group of children’s possible decision to suddenly cross the road in front of them. To date, the automated recognition of present behaviour builds on the recent successes of deep learning (a technique based on artificial neural networks with an increased number of layers) to efficiently identify motion patterns in the available streaming videos. Motion patterns, however, can be deceiving, as humans can suddenly change their mind based on their own internal mental dynamics and things they spot in the scene (e.g., children seeing an ice cream van on the other side of the road). Intriguingly, humans are capable of making reliable predictions of future behaviour even when no motion is present, just by quickly assessing the ‘type’ of person they are looking at (e.g. an elderly person standing in a hallway is likely to take the elevator rather than the stairs). Theory of Mind (ToM) capabilities, i.e., the ability to ‘read’ other agent’s mental states, are crucial to develop a next generation, human-centric artificial intelligence. In a mutually beneficial process, computational models developed within AI may provide new insight on the way these mechanisms work in the human brain. Within cognitive neuroscience, the theory-theory paradigm argues in favour of the existence of a set of rules humans possess regarding human mind functioning. The simulation-theory view defends, instead, a simulation process consisting of taking someone else’s perspective to understand their reasoning. The simulation standpoint, we argue, has the potential to bring together machine learning and neuroscience in a radically new approach to the problem. A fruitful cross-fertilisation of neuroscience and machine learning can enable significant advances in both fields, by allowing both the formulation of computational theory of mind models in humans leveraging current frontier efforts in AI, and the development of machine theory of mind models informed by the most recent neuroscientific evidence, capable of going beyond simple pattern recognition for prediction in complex, human-centred scenarios. ‘Belief-desire-intention’ models are so far the dominant approach in computational ToM. However, as they lack the ability to learn from past experiences, such methods have been subject to much criticism. In opposition, composable deep networks have the potential to provide solid foundations for a simulation-theory approach. The reasoning of various classes of complex agents can be flexibly simulated by dynamically rearranging the topology of the connections among a base set of neural modules. The way the simulation adapts to agent class and scene is learned from experience via reinforcement learning. Successful machine Theory of Mind models would lay the foundations for the creation, among others, of autonomous vehicles able to negotiate complex road situations involving humans. Next-generation robotic assistant surgeons can be envisaged with the ability to understand what the main surgeon is doing and foresee their future intentions. Empathic robotic healthcare tools would become possible, as well as a new generation of ‘bots’ (e.g. for customer service or financial advice) able to interact more effectively and empathetically with humans. Research in this area would also impact on the current debate on moral AI, helping machines make ethical, human-like decisions in critical situations.

About the author

Oxford Brookes University
Fabio Cuzzolin is the founder and head of the Visual Artificial Intelligence Laboratory within the School of Engineering, Computing and Mathematics at Oxford Brookes University

Latest news

Taking our clients international by James Cowper Kreston

Taking our clients international by James Cowper Kreston

Whether you are exploring international markets for the first time, or have established operations, James Cowper Kreston can help guide READ MORE

Innovation in physical products

Innovation in physical products

The journey of developing a physical hardware product and bringing it to market can be challenging. READ MORE

James Cowper Kreston in India

James Cowper Kreston in India

James Cowper Kreston’s film and media division have been busy working with production teams to help bring the latest blockbusters to ... READ MORE






Thank you for joining us at Venturefest Oxford, we'd love to know what you thought about the event, it's programme and it's speakers. Please take a few minutes to complete our online survey. 

Keep in touch

Sign up to the Venturefest Oxford newsletter to make sure you are the first to hear the latest news. The next newsletter will be coming out soon! Make sure you're on the list!





Email Preferences


Wednesday 11th September 2019
Oxford Brookes University,
Headington Campus