1 of 1

HHBBHHHHBV

A Multimodal Intelligent approach for

Dyslexia Detection and Reading Support

Mehdi Belguith¹, Wafa Khabou¹, Latifa Iben Nasr¹

¹ANLP-RG, MIRACL Lab. FSEGS, University of Sfax, Tunisia

Email: belguith.mehdi2017@gmail.com, latifa.ibennasr@fsegs.usf.tn, waafakhabou@gmail.com

The 4th International Conference

on Language Processing

and Knowledge Management

Introduction

Dyslexia: A specific learning disorder affecting school-aged children (7.1% [1]) among children and adolescents.
In recent years, AI has re-emerged as a powerful tool for enhancing the detection of learning disorders. In particular, multimodal learning, which combines text, speech, and eye tracking, has shown promising potential [2].

Methodology

Data collection

For dyslexia detection:

Available multimodal datasets

For dyslexia reading support:

Construction of a specific dataset based on Tunisian textbooks

Proposed models

Dyslexia Detection:

CNN for visual data (eye tracking)
LSTM and RNN for audio data
Machine learning models for genetic data

Hybrid method for multimodal data

Dyslexia-ready support:

LLMs, NLP techniques, and ML models for error detection and individualized support

Results: Dyslexia-ready support

Conclusion and Perspectives

This research proposes a multimodal approach (text, speech, eye-tracking, images, and videos) for:

Dyslexia detection
Dyslexia learning support

The proposed method for dyslexia support is based on NLP and machine learning techniques.

As perspectives, we intend to apply and evaluate eye-tracking models to detect dyslexia in children.

Application interface

[1] Olusanya BO, Smythe T, Ogbo FA, Nair MKC, Scher M, Davis AC. Global prevalence of developmental disabilities in children and adolescents: A systematic umbrella review. Front Public Health. 2023 Feb 16;11:1122009. doi: 10.3389/fpubh.2023.1122009. PMID: 36891340; PMCID: PMC9987263.

[2] Martín-Ruiz, I., Rueda-Flores, E., Infante-Cañete, L., Alarcón-Orozco, E., & Robles-Sánchez, M. J. (2026). Identification and Detection of Specific Learning Disabilities: A Systematic Review. Education Sciences