EUNICE LAW EN HUI SMK ST ANTHONY SARIKEI
Did you know that in Malaysia, 1 in 7 children is born with special needs, amounting to approximately 71,706 children each year? Many of these children, along with those facing learning loss, are often left behind in mainstream education. To address this pressing issue, we developed Smart Touch, an inclusive AI-powered mobile application designed to support both special needs students and students experiencing learning loss—especially in mastering basic English skills.
Smart Touch tackles three major challenges faced by these students: coordination, personalized learning, and assistive communication. Using AI and Posenet Extension technology, our app helps students improve their physical coordination by guiding body movements in real time—for example, recognizing left and right. For cognitive development, the app offers interactive, repetitive lessons in ABCs, numbers, colors, shapes, and animal sounds—designed to strengthen memory and understanding through visual and auditory reinforcement.
The app also features a ‘Talk’ function that enables non-verbal students to express themselves through simple symbols and text. Emotional check-ins and a Bot Therapist feature further support students’ mental well-being. Integrated tools such as calming games, doodles, a voice calculator, and a sign language feature cater to diverse sensory needs.
To enhance English literacy, Smart Touch incorporates AI to provide targeted learning activities, making it an essential tool for students with learning loss. The app also includes a digital textbook aligned with the Pendidikan Khas curriculum, quizzes, and a student profile to track progress.
With over 98% positive feedback from our surveys and successful trials in schools, Smart Touch aims to create a smarter, happier, and more inclusive future for every child in Malaysia.
Keywords: AI in Education, Special Needs, Learning Loss, Posenet, Assistive Communication, Inclusive Learning,
r Abstract Here!