The crucial role of Theory of Mind (ToM) capabilities in developing a next generation, human-centric artificial intelligence
3rd September 2018
Emerging applications of artificial intelligence (AI) are raising awareness of the limitations of established machine learning (ML) approaches in situations in which humans are involved. Smart cars, for instance, need to make reliable predictions about human behaviour in real time, e.g. in order to pre-emptively adjust speed and course to cope with a group of children’s possible decision to suddenly cross the road in front of them. To date, the automated recognition of present behaviour builds on the recent successes of deep learning (a technique based on artificial neural networks with an increased number of layers) to efficiently identify motion patterns in the available streaming videos. Motion patterns, however, can be deceiving, as humans can suddenly change their mind based on their own internal mental dynamics and things they spot in the scene (e.g., children seeing an ice cream van on the other side of the road). Intriguingly, humans are capable of making reliable predictions of future behaviour even when no motion is present, just by quickly assessing the ‘type’ of person they are looking at (e.g. an elderly person standing in a hallway is likely to take the elevator rather than the stairs). Theory of Mind (ToM) capabilities, i.e., the ability to ‘read’ other agent’s mental states, are crucial to develop a next generation, human-centric artificial intelligence. In a mutually beneficial process, computational models developed within AI may provide new insight on the way these mechanisms work in the human brain. Within cognitive neuroscience, the theory-theory paradigm argues in favour of the existence of a set of rules humans possess regarding human mind functioning. The simulation-theory view defends, instead, a simulation process consisting of taking someone else’s perspective to understand their reasoning. The simulation standpoint, we argue, has the potential to bring together machine learning and neuroscience in a radically new approach to the problem. A fruitful cross-fertilisation of neuroscience and machine learning can enable significant advances in both fields, by allowing both the formulation of computational theory of mind models in humans leveraging current frontier efforts in AI, and the development of machine theory of mind models informed by the most recent neuroscientific evidence, capable of going beyond simple pattern recognition for prediction in complex, human-centred scenarios. ‘Belief-desire-intention’ models are so far the dominant approach in computational ToM. However, as they lack the ability to learn from past experiences, such methods have been subject to much criticism. In opposition, composable deep networks have the potential to provide solid foundations for a simulation-theory approach. The reasoning of various classes of complex agents can be flexibly simulated by dynamically rearranging the topology of the connections among a base set of neural modules. The way the simulation adapts to agent class and scene is learned from experience via reinforcement learning. Successful machine Theory of Mind models would lay the foundations for the creation, among others, of autonomous vehicles able to negotiate complex road situations involving humans. Next-generation robotic assistant surgeons can be envisaged with the ability to understand what the main surgeon is doing and foresee their future intentions. Empathic robotic healthcare tools would become possible, as well as a new generation of ‘bots’ (e.g. for customer service or financial advice) able to interact more effectively and empathetically with humans. Research in this area would also impact on the current debate on moral AI, helping machines make ethical, human-like decisions in critical situations.

About the author

Oxford Brookes University
Fabio Cuzzolin is the founder and head of the Visual Artificial Intelligence Laboratory within the School of Engineering, Computing and Mathematics at Oxford Brookes University

Latest news

Finalists announced for the Trusts’s 2019 Enterprise Awards

Finalists announced for the Trusts’s 2019 Enterprise Awards

The judges for the Trust’s 2019 Enterprise Awards gathered on a hot July day at the new Wood Centre for Innovation at Stansfeld Park to READ MORE

Using Artificial Intelligence in Recruitment

Using Artificial Intelligence in Recruitment

The hiring process is a critical gateway to economic opportunity, determining who can access meaningful employment and who can achieve ... READ MORE

The new Milk-Round: if students all want jobs in start-ups these days, how do you attract and retain them?

The new Milk-Round: if students all want jobs in start-ups these days, how do you attract and retain them?

Oxford University runs many careers fairs annually where established organisations present their graduate programmes, to attract the ... READ MORE



Book Now!

Now in its 21st year, Venturefest Oxford continues to bring together entrepreneurs, innovators and SMEs with investors, support services and a host of like-minded people who want to be part of the county’s business success.

All tickets include: complimentary bus travel to and from the event, access to all Venturefest Oxford sessions, exhibition, showcase, complimentary tea & coffee, lunch and closing drinks reception. Early bird tickets on sale from 23rd April!

Student entry is free of charge – valid ID will be required.


Keep in touch

Sign up to the Venturefest Oxford newsletter to make sure you are the first to hear the latest news. The next newsletter will be coming out soon! Make sure you're on the list!





Email Preferences


Wednesday 11th September 2019
Oxford Brookes University,
Headington Campus