This project introduces a virtual simulation system, ESAIAS, to transform social and emotional learning (SEL) for adolescents with autism spectrum disorder (ASD) in Hong Kong's integrated education setting. ESAIAS leverages generative artificial intelligence (GenAI) to address the key limitations of traditional methods, such as human-led role-playing. Unlike conventional approaches that require intensive therapist involvement, physical presence, and fixed scenarios, ESAIAS offers scalable, accessible, and adaptive training within a virtual simulation of a school community. Students interact with GenAI agents to complete tasks involving collaboration, conflict resolution, and emotional regulation.
The technical framework consists of (i) a front end that provides stylised visuals and natural interactions, (ii) a back end that hosts GenAI agents with pre-configured personas, dynamic memory, and role-playing algorithms, and (iii) a set of bespoke tools for system monitoring, agent configuration, and scenario design.
The impact of ESAIAS lies in its ability to overcome the limitations of traditional SEL methods for adolescents with ASD. While human-facilitated approaches are resource-intensive and location-dependent, ESAIAS offers unmatched scalability and accessibility through GenAI technology. It allows an unlimited number of students simultaneous use and enhances accessibility via digital delivery to schools and homes. Additionally, the adaptability of ESAIAS surpasses traditional methods; GenAI agents can integrate an endless number of social nuances, personalise their interactions based on individual ability and skills, and quickly respond to newly arising needs.
Early feedback from special education teachers, counsellors, psychologists, and psychiatrists suggests that students are likely to engage more deeply in SEL with GenAI agents, since the absence of others' judgment encourages experimentation and reduces anxiety. By providing an immersive, safe, replicable, and personalised learning experience, this innovative approach aims to democratise access to high-quality SEL for adolescents with ASD, particularly in under-resourced settings. It also lays the groundwork for GenAI-enhanced interventions across neurodiverse learners, ultimately fostering inclusive communities where adolescents with special educational needs (SEN) can thrive.