Skip to content

Group

Interactive Systems Research Group (ISRG)

Unit(s) of assessment: Computer Science and Informatics

Research theme(s): Digital, Technology and Creative | Health Innovation

School: School of Science and Technology

The Interactive Systems Research Group (ISRG) at Nottingham Trent University focuses on the development of new technologies for cognitive and physical rehabilitation, and the promotion of users’ mental wellbeing. The main research focus of the group has always been on developing technologies for social inclusion.

This is a multi-disciplinary endeavour bringing together researchers, educationalists, psychologists and clinicians in virtual environments, serious games, games-based learning, assistive technologies, location-based services, mobile applications, robotics, health psychology and computational intelligence. Recently a strong focus has been on the application of Artificial Intelligence and Machine Learning for the benefit of health and society.

The ISRG has expertise in the analysis and use of methods from the fields of artificial intelligence and data analysis to solve real-world problems. The Research Group has access to state-of-the-art research facilities, including high-performance computing, a variety of sensors, actuators and communication devices, different assistive robotic platforms, a Virtual Reality lab equipped with a multitude of Virtual and Augmented Reality technologies, and a smart home facility.

Our focus

The ISRG’s research has several strands, as described below:

User-centred design and user experience: Designing interactive systems involving users from project start to project finish (co-design methodology), and delivering systems, which focus on User Experience goals.

Artificial Intelligence and Machine Learning: This strand includes:

  • Education: Using sensor data to track engagement and to determine personalised learning for neurotypical students, students with intellectual disability and students with autism. Our advanced learning systems track the affective state of learners through advanced real-time analysis of sensor data including camera feeds and physiological sensors. The goal is to increase the effectiveness of the learning process and engagement of learners by notifying educators when signs of disengagement or emotional dysregulation are detected, allowing early interventions.
  • Health: Developing AI techniques to analyse secondary health data with the intention to create synthetic datasets and models that can help clinicians in early identification of important health problems including lung cancer, prostate cancer, ischemic stroke and Alzheimer’s disease.

Serious Games: Working with students in designing and co-designing serious games to promote cognitive, perceptual and independent living skills in people with intellectual disabilities, working alongside multiple stakeholders; and for educating students in sustainable development goals. We also work to establish the efficacy of serious games in educational contexts and identify barriers to their adoption. We utilise modern playful design techniques to co-develop high quality deployable prototypes.

Virtual environments: We have developed virtual environments to change attitudes and behaviours in health and social related contexts. A recent example is VR use in Exposure Therapy to equip students to be better able to deliver presentations in the real world.

Assistive technologies: Improving the accessibility of solutions and services, and assessment of the latest access techniques and interaction modalities to determine their worth for a more accessible, exploitable and deeply embeddable approach in mainstream ICT.

Robotics: Investigating the role of engagement in using robots with students with profound and multiple learning disabilities, the use of assistive technologies in controlling robots and the development of intelligent multimodal systems to promote communicational skills.

We are seeking to generate research income through EPSRC, InnovateUK, NIHR, EU Horizon, European Cooperation in Science and Technology (COST) and other industrial partners.

Events

Research Dissemination Events:

ISRG plays a key organising role in the International Conference on Disability, Virtual Reality and Associated Technologies (ICDVRAT). ICDVRAT brings together academics and practitioners working with interactive technologies to explore and innovate within the areas of education, health and disability. It is an affiliated conference to the International Society of Virtual Rehabilitation.

For information on previous conferences, see the ICDVRAT Archive 1996-2024. ICDVRAT 2026 is scheduled for 15th –18th September 2026 in Copenhagen, Denmark.

Our Team

  • Dr. Mufti Mahmud (associate professor of cognitive computing). Professor in the Information and Computer Science Department at King Fahd University of Petroleum and Minerals (KFUPM), Saudi Arabia.

Matthew Harris

  • Supervisors: Prof David Brown, Dr. Pratik Vyas, Mr. James Lewis
  • Title: The Use of Virtual Reality in Assessing Cognitive Decline in Those with Intellectual Disabilities
  • Expected graduation year: 2026
  • Summary: This research involves co-designing a Virtual Reality platform that aims to assess cognitive decline in those with intellectual disabilities using Virtual Reality. Those with ID tend to experience cognitive decline earlier which is why we're targeting this group. Both neuropsychological and neurophysiological approaches to assessing cognitive decline have their limitations in this group, so this research aims to combine the two (VR spatial navigation task performance scores and EEG data) using a feature fusion machine learning approach.

Daniel J. Buxton

  • Supervisors: Prof David Brown, Dr Mufti Mahmud, Dr Jordan Bird, Dr Thomas Hughes-Roberts
  • Proposed title: A novel Computational method of autistic trait detection
  • Expected graduation year: 2030
  • Summary: Given that I was diagnosed with autism in adulthood, the project aims to improve this for others. I will undertake a multi-modal approach to autistic trait identification for young adults, aged 18-30. I will use various modalities, including neurophysiological measures and behavioural analysis, while addressing data scarcity and imbalance challenges. ORCID: 0000-0002-8729-3736

Sean Haddick

  • Supervisor: Prof David Brown, …
  • Proposed title: Developing Social-Emotional Reciprocity between Persons with ASD and their Caregivers
  • Expected graduation year: 2028
  • Summary:  Sean Haddick is an Academic Associate, studying Human-Computer Interaction at Nottingham Trent University in the UK. Currently, they are working on a VR intervention for caregivers of children with ASD, Facial Expression Emotion Recognition training for ASD children, and teaching Games Based Learning techniques and Accessible Design methodologies in client-based project work.

Safa Hamdare

  • Supervisors: Dr Omprakash Kaiwartya, Prof David Brown, Dr Pratik Vyas
  • Proposed Title: Cyber security for Electric Vehicle Smart Charging Energy network
  • Expected graduation year: 2025
  • Summary: The aim of this project is to create a framework for a secure EV charging service that can be used by both public charging station infrastructure and private charging stations in homes. Research Objectives include: design and development of an EV Charging Management and Security (EVCMS) framework; deployment of EVCMS framework as a centralized cloud service for small scale charging network and as a distributed fog/edge service for large scale charging network including home charging points; and testing, validation, and generation of experimental benchmarking performance data for EVCMS to ensure safety against potential EV charging security threats.

Rahma Hammedi

  • Supervisors: Dr Omprakash Kaiwartya, Dr Mufti Mahmud, Prof David Brown
  • Proposed title: Privacy preserving Scheme for Connected and Autonomous Vehicles
  • Expected graduation year: 2027
  • Summary: Connected and Autonomous Vehicles (CAVs) use Vehicle-to-Everything communication to enhance connectivity and self-driving capabilities, leading to a significant amount of data being transmitted. However, this opens potential privacy vulnerabilities for hackers to access the in-vehicle network. Thus, maintaining drivers' trust through robust privacy preservation measures is indispensable. Our aim is to thoroughly analyse current privacy-preserving solutions in CAVs and develop an efficient solution that addresses previous limitations, offering enhanced features in terms of latency, coverage, and computation.

Teena Rai

  • Supervisors: Dr Jun He, Dr Mufti Mahmud, Prof David Brown
  • Proposed title: Explainable Machine Learning to select high risk patients for lung cancer screening
  • Expected graduation year: 2026
  • Summary: My PhD focuses on using explainable machine learning to build risk prediction models for lung cancer using UK primary care data. I work on building ensemble models and provide post hoc explanations to explain the decisions made by the models. My main aim is to improve the performance and explainability of the ensemble models compared to the traditional logistic regression models.

Mukunda Somisetti

  • Supervisors: Prof David Brown, Dr Nadja Heym, Prof Alexander Sumich
  • Proposed title: Development of protocol for co-creation of a user-friendly Virtual Reality App to support people with Borderline Personality Disorder
  • Expected graduation year: 2029
  • Summary: I will be developing a protocol for a VR App to support individuals with Borderline Personality Disorder (BPD). A Project advisory group will be formed with NHS BPD service providers and potential end users of the App to discuss the possibilities for developing the App content. There will be a pilot testing stage towards the project end to understand the impact on BPD symptoms and feasibility of the App implementation.

Zakia Batool Turabee

  • Supervisors: Prof David Brown, Dr Mufti Mahmud, Dr Andreas Oikonomou
  • Proposed title: Neuroadaptive HCI for students with Autism
  • Expected graduation year: 2026
  • Summary: My study focuses on the early identification of behavioural changes in children with autism when they start to feel overwhelmed. By detecting these changes, I aim to enable the timely implementation of evidence-based well-being interventions to mitigate their impact.

Fuyu Zhang

  • Supervisors: Dr Jun He (Director of Studies), Prof David Brown (Co-Supervisor), Dr Mahmud Mufti (Co-Supervisor)
  • Proposed title: Explainable Graph Neural Networks for Lung Cancer Risk Prediction based on Electronic Health Records
  • Expected graduation year: 2028
  • Summary: This project aims to design an explainable Graph Neural Network (GNN) model for predicting lung cancer risk based on the Clinical Practice Research Datalink (CPRD). By integrating advanced GNN techniques and ensuring model interpretability, we seek to enhance the accuracy and clinical usability of lung cancer predictions, ultimately improving clinical decision-making and patient outcomes.

Projects

PHASE IV AI

Within the PHASE IV AI project, NTU is leading the work on Validation and Use Cases, and tasks related to the coordination of the requirements gathering and piloting of the developed technologies at different sites across countries including Belgium, Finland, Portugal, Spain, and the UK.

The Hybrid Cyber Range (HCR) Project

Antimicrobial Resistance, Omics and Microbiota (AROM) research group incorporate classical microbiology, molecular biology, systems biology and bioinformatics.

Inclusive Use of Artificial Intelligence in Education

This project will contribute to digital transformation across Vietnam on the educational use of Artificial Intelligence tools for Teaching and Learning.

Virtual Reality Exposure Therapy

Public-speaking anxiety is a form of social anxiety where the person fears performance situations, such as speaking in front of an audience. The person is apprehensive before delivering a speech, which may affect their speech, causing loss of train of thought, pauses and stuttering.

DiversAsia

Students with disabilities have limited access to Higher Education in India and Bangladesh. This project aims to tackle this issue by making accessible higher education OERs (Open Education Resources) and MOOCs (Massive Open Online Courses), and personalisation using AI (Artificial Intelligence).

AI-TOP

An AI Tool to Predict Engagement and 'Meltdown' Events in Students with Autism. AI-TOP aimed to tackle early school leaving and to support the inclusive education of students with Autistic Spectrum Condition by the provision of personalised learning pathways and support.

Pathway+

The Pathway + project aims to contribute to inclusive education by using mobile game applications to assess the pedagogical needs of children with moderate learning disabilities. It improves pedagogical support for them, so that they can be included in mainstream classrooms.

MATHISIS

This project aimed to assist the educational process for learners, tutors and caregivers by creating a novel and continuously adaptable 'robot/machine/computer'-human interaction ecosystem to enhance vocational training, workplace learning and mainstream education.

No One Left Behind

This project was an innovation action that used video games techniques to enhance the students’ abilities across all academic subjects, as well as their computational proficiency, creativity and social skills

Impact

AIMS:

  • to Launch the East Midlands as the leading hub for RehabTech excellence,
  • Build mechanisms to connect the EM’s 459 MedTech SMEs with the region’s world-class researchers, networks, and facilities,
  • Ensure the EM dominates the design, development, and delivery of pioneering RehabTech that will transform health outcomes and inequalities.

OBJECTIVES:

  • To Create mechanisms for engagement between businesses, academics, NHS, and patients/the public through our state-of-the-art facilities,
  • To Capture and harness the breadth of UK R&I talent through the Collaboration Fund.

Example activities include secondments, demonstration days, sandpit events, problem fora, and marketing. See NTU Press report.

Funded by the British Council of Bangladesh, this project was tasked with the enhancement and growth of an Inclusive Education Toolkit for use in the Bangladesh context. The original toolkit was developed in the DiversAsia project for use by Higher Education (HE) staff, to enable students with disabilities to enjoy the same access to HE as their peers, including access to free and open-source digital training materials. The Inclusive Education Toolkit comprised guidelines, checklists and leading-edge practices, an accessibility checker tool and an AI powered Tool to understand student engagement. It was based on NTU’s world leading inclusion research, teaching practices and standards relevant to, and embedded in, the Bangladesh (BD) context.

In July and December 2025, and in April 2026, workshops were held in Bangladesh and India to further enhance the awareness of Inclusivity and Accessibility in Higher Education professionals in Asia. Previously created materials have been enhanced, and new materials have been created with additional guidance on Generative AI and Race and Gender Equality. A new site has been created to host these materials which is undergoing constant development with materials from NTU and from collaborating institutions.  Find out more at Accessible Academy.

By running these multiple face-to-face and online ' Generative AI Workshops for Inclusive Higher Education’, we have significantly extended existing collaborations between the NTU and a range of HE and Technical Vocational Education and Training (TVET) Institutions in BD. Through these institutional partnerships, we will continue to work together to increase the role of “AI for Good” to tackle barriers to accessing the HE and TVET sectors for students experiencing learning difficulties (e.g., dyslexia, ADHD), sensory and physical impairments, those from socio-economically disadvantaged backgrounds and women students in Bangladesh.  Successful implementation and recognised impact through 2025/26 has secured further funding for 2026/27 from NTU Impact Accelerator funding, as well as an invitation to apply for further British Council funding.

UKHAIC will promote cross-sectoral collaboration, increase co-creation of research and clarity of ideas and technologies through the transfer of people. This will create both stronger relationships between universities and other sectors, and innovative solutions to support real world outcomes, improving human health in the real world. UKHAIC offers numerous opportunities, including cross-sector networking, access to funding, and free training for members. It serves as a gateway to our partners’ and collaborators’ knowledge transfer networks. Find out more at UK Healthy Ageing Innovation Consortium.

Inclusive use of Artificial Intelligence in Education in Vietnam: AI Powered Inclusive Education Digital Transformation in Rural and Urban Schools. Funded by the British Council [2024 – 2026].

Events:

  • Teacher Training on AI in Education - delivered to over 200 High School Teachers from Northern, Central, and South Vietnam. July 23rd and July 20th, 2025.
  • Guest Lecture - "Generative AI in Education" delivered to High School Teachers from North, Central, and South Vietnam. Available in English and Vietnamese - delivered by Dr. Jordan Bird (Nottingham Trent University, UK) and translated by Dr. Đỗ Thùy Linh (Vietnam National University, Hanoi).

Press coverage:

Access to appropriate ICT-based solutions provides perhaps the only chance for students with a range of physical, sensory, communication and cognitive disabilities of participating in society and realising their full potential. A 2015 Deloitte and Ipsos MORI study prepared for the European Commission highlighted the need to integrate inclusive, personalised ICT solutions into learning environments for children.

Research by NTU’s Interactive Systems Research Group has improved the inclusion of students with learning disabilities and autism in special and inclusive classrooms via approaches to designing accessible and adaptive learning technologies, which improve and enhance their engagement in learning. Find out more on the project website.

This project jointly conducted by Nottingham Trent University (NTU), UK and Vellore Institute of Technology (VIT), Vellore, India involved the 'co-designing of smart curriculum and personalised method of delivery on Industry 4.0' so that the problem of student's industry 4.0 readiness can be explored and addressed as the aim of this research. Value added course (VAC) is a micro credit module run by VIT independently of the various degrees offered by the institution which has been recognised as an appropriate driver for addressing this issue. Find out more on the project website.

Re:inclusion - Research Reimagined

Using technology to support neurodivergent students in classrooms - Researchers David Brown and Mufti Mahmud from NTU’s Computer Science and Informatics Research Centre have improved the inclusion of students with neurodivergent conditions in special, inclusive classrooms. Incorporating multimodal affect recognition, serious games, location-based services, digital game-making, and robotics and accessibility, their research has focused on using artificial intelligence (AI) to understand how engaged learners are, and how to employ novel ICT interventions for pupils in the greatest need.

NICER Group

Nottingham International Consortium for Educational Research. The ISRG collaborate closely with NICER, who are a group of people with intellectual disabilities, and people who work closely with them, who are passionate about making sure that they are actively involved as equal partners in research which involves improving the lives of - and opportunities for - people with intellectual disabilities. The group includes current pupils from the Oak Field School, and former students, as well as staff from both Oak Field School and other similar schools such as the Nottingham Hope Academy, who meet on a regular basis with researchers and educationalists to help to inform and guide research work.

Research Output

The full research publication output of the group is regularly collated on the ISRG Google Scholar page, which also links to the individual Scholar pages of our team.

Funding

YearFunding

2025

British Council £24,975. Generative AI for Good. PI: David Brown, Co-I: Rahman
2025National Institute of Health Research £15,436.73. Leveraging Generative AI To Support Independent Living For People With Learning Disabilities. PI: David Brown, Co-I: Jordan Bird
2024British Council £42,795. AI powered inclusive education digital transformation in Vietnam. Co-Is: David Brown, Jordan Bird

2023

Horizon Europe £493,435.43     PHASE IV AI - Privacy compliant health data as a service for AI development. PI David Brown.

2020

EU Erasmus Capacity Building in Higher Education €1M. DiversAsia – Embracing diversity in ASIA through the adoption of Inclusive Open Practices. PI David Brown.

2020

EU Erasmus Strategic partnerships in the field of education and training Education €449.691. AI-TOP: An AI Tool to Predict Engagement and 'Meltdown' Events in Students with Autism.PI David Brown.

2018

EU Erasmus+ €87,000. Serious Games to develop Entrepreneurial Skills. PI David Brown.

2017

EU Erasmus+. €443,075. Pathway+: A mobile pedagogical assistant to develop meaningful pathways to personalised learning. PI David Brown.

2016

EU Horizon 2020. €618,000 MATHISIS: Managing Affective-learning THrough Intelligent atoms and Smart InteractionS. PI David Brown.


2015

EU Erasmus KA2. €86,124 Real Life. Tackling recidivism in offenders using virtual environments. PI David Brown.


2014

EU Horizon 2020 £457,200 No One Left Behind. PI: David Brown


2014

EPSRC £294,021 Internet of Soft Things. Co-I David Brown.

2013

Technology Strategy Board £49,460 mTrust: A low cost inclusive m-commerce solution for high street and online trusted traders. PI: John Weightman. Co-Is: Tony Allen, Monica Whitty & David Brown.

2011-2012

EU FP7 £141,802 AEGIS – Open Accessibility Everywhere. PI David Brown, Co-I: Lindsay Evett.

2010-2012

EU Leonardo €285,000 Promoting Acceptance Using Simulated Environments PI David Brown.

2009-2012

EU LLP KA3 ICT €585,000 RECALL – Reconnecting Communities and Lifelong Learning using Android PI David Brown, Co-I: Lindsay Evett.

2008-2010

EU Leonardo    €300,000 Game On Extra Time PI David Brown, Co-I: Lindsay Evett.

2007-2009

EU Leonardo    €219,795 Game On Accessible Learning PI David Brown, Co-I: Lindsay Evett.

2006-2008

EU Grundtvig   €164,000 Game On: Serious Games for Offenders PI David Brown

2001-2002

EPSRC £125,141 An investigation into the design of input devices for use by people with disabilities interacting with virtual leaning environments. PI Penny Standen, Co-I: David Brown

1999-2000

ESRC   £40,000 Helping adults with learning disabilities to use virtual environments PI Penny Standen, Co-I: David Brown

Working with us

If you would like to work with the Interactive Systems Research Group or want to find out more about our work, contact david.brown@ntu.ac.uk

Research Excellence Framework (REF) 2021

The Interactive Systems Research Group submitted an impact case study to REF 2021. 80% of NTU's research submitted to the Computer Science and Informatics Unit of Assessment was assessed to be either world-leading or internationally excellent in terms of quality.

Discover the real-world impact of this research.