The crucial role of Theory of Mind (ToM) capabilities in developing a next generation, human-centric artificial intelligence
3rd September 2018
Emerging applications of artificial intelligence (AI) are raising awareness of the limitations of established machine learning (ML) approaches in situations in which humans are involved. Smart cars, for instance, need to make reliable predictions about human behaviour in real time, e.g. in order to pre-emptively adjust speed and course to cope with a group of children’s possible decision to suddenly cross the road in front of them. To date, the automated recognition of present behaviour builds on the recent successes of deep learning (a technique based on artificial neural networks with an increased number of layers) to efficiently identify motion patterns in the available streaming videos. Motion patterns, however, can be deceiving, as humans can suddenly change their mind based on their own internal mental dynamics and things they spot in the scene (e.g., children seeing an ice cream van on the other side of the road). Intriguingly, humans are capable of making reliable predictions of future behaviour even when no motion is present, just by quickly assessing the ‘type’ of person they are looking at (e.g. an elderly person standing in a hallway is likely to take the elevator rather than the stairs). Theory of Mind (ToM) capabilities, i.e., the ability to ‘read’ other agent’s mental states, are crucial to develop a next generation, human-centric artificial intelligence. In a mutually beneficial process, computational models developed within AI may provide new insight on the way these mechanisms work in the human brain. Within cognitive neuroscience, the theory-theory paradigm argues in favour of the existence of a set of rules humans possess regarding human mind functioning. The simulation-theory view defends, instead, a simulation process consisting of taking someone else’s perspective to understand their reasoning. The simulation standpoint, we argue, has the potential to bring together machine learning and neuroscience in a radically new approach to the problem. A fruitful cross-fertilisation of neuroscience and machine learning can enable significant advances in both fields, by allowing both the formulation of computational theory of mind models in humans leveraging current frontier efforts in AI, and the development of machine theory of mind models informed by the most recent neuroscientific evidence, capable of going beyond simple pattern recognition for prediction in complex, human-centred scenarios. ‘Belief-desire-intention’ models are so far the dominant approach in computational ToM. However, as they lack the ability to learn from past experiences, such methods have been subject to much criticism. In opposition, composable deep networks have the potential to provide solid foundations for a simulation-theory approach. The reasoning of various classes of complex agents can be flexibly simulated by dynamically rearranging the topology of the connections among a base set of neural modules. The way the simulation adapts to agent class and scene is learned from experience via reinforcement learning. Successful machine Theory of Mind models would lay the foundations for the creation, among others, of autonomous vehicles able to negotiate complex road situations involving humans. Next-generation robotic assistant surgeons can be envisaged with the ability to understand what the main surgeon is doing and foresee their future intentions. Empathic robotic healthcare tools would become possible, as well as a new generation of ‘bots’ (e.g. for customer service or financial advice) able to interact more effectively and empathetically with humans. Research in this area would also impact on the current debate on moral AI, helping machines make ethical, human-like decisions in critical situations.

About the author

Oxford Brookes University
Fabio Cuzzolin is the founder and head of the Visual Artificial Intelligence Laboratory within the School of Engineering, Computing and Mathematics at Oxford Brookes University

Latest news

Venturefest Oxford is back: 2021 programme launched

Venturefest Oxford is back: 2021 programme launched

We're excited to launch the event programme for this year's event which will take place on Thursday 25th November, both in person at Harwell Campus and online. READ MORE

How has business development has changed?

How has business development has changed?

With Covid-related lockdowns, travel restrictions, cancellation and postponement of conferences and events, business development activities have had to change over the last 15 months. READ MORE

Venturefest Oxford 2020 – What’s next?

Venturefest Oxford 2020 – What’s next?

It’s with great regret that we have decided to cancel Venturefest Oxford 2020 due to COVID-19 concerns. READ MORE



Visit Britain

Keep in touch

Sign up to the Venturefest Oxford newsletter to make sure you are the first to hear the latest news. The next #vfestox newsletter will be coming out soon! Make sure you're on the list!






Email Preferences

Venturefest Oxford will be returning on Thursday 25th November 2021

Make connections that lead to new investments, new businesses and new ideas in the high-tech sector in Oxfordshire.