AI in Healthcare�(with a focus on using Knowledge-infused Neurosymbolic AI)
AIISC portfolio in Core AI & Translational AI
2
Neuro-symbolic
/Hybrid AI: Knowledge Infusion/Elicitation;
Compact + Custom
Knowledge Graph
Development
Deep Learning
Reinforcement Learning
NL Processing/�Understanding/�Generation
Computer Vision
Multimodal AI
(IoT/sensor, data streams, images, emoji)
Collaborative & Personal Assistants; coPilots, Multiagent Systems
Interpretability/�Explainability/Safety/
Trust/Ethics in AI
Medicine/Healthcare/Nursing
(Nutrition, Neurodevelopmental Disease, Asthma, Diabetes, Hypertension, Autism, Aphasia, Cognitive Disorders, Oncology,...)
Neuroscience
Brain Science
Epidemiology
Education
Social Good/Harm
(Disinformation, Harassment,Toxic Content, Deception, Extremism, Radicalization)
Public Health
(Mental Health, Addiction, COVID-19, Epidemics)
Smart Manufacturing
(Digital Twins, Factory of Future)
Disaster Management �(Response, Resilience)
Pharma: drug discovery, vigilance
Autonomous Systems (Vehicles)
Automated Planning
Gaming
Cognitive
Science
Science & Engg: �Radiation,
Astrophysics, Civil Infra & Transportation
Law
GenAI/LLMs:
HallucinationAI dectablilty, Toxicity, etc.
My Students
Recent Alumnus
AIISC
3
Outline
Using AI for Healthcare - Chemical Interaction Discovery
Using AI for Healthcare - Asthma Management
Using AI for Healthcare - Cognitive Decline from Speech
Comparing Pearson Correlation and Statistical Analysis
Identifying best combination modality, Atlas, Method
MRI Image Preprocessing
Atlas Selection
Modality Selection
Single Modality Experiments
Multimodal Experiments
r1 : rN - > PNT, AQ :Regression
r1: rN -> PNT, AQ : Autoencoder + Regression
Using AI for Healthcare - Brain Lesion Mapping
What is Semantics?
What is Semantics?
Example Semantic Interpretations constructed either from manual effort (A, B, C), automatically (D, E), or semi-automatically (F).
(A) is empathi ontology designed to identify concepts in disaster scenarios (Gaur et al. 2019).
(B) Chem2Bio2RDF (Chen et al. 2010).
(C) ATOMIC (Sap et al. 2019).
(D) Education Knowledge Graph by Embibe (Faldu et al. 2020).
(E) Event Cascade Graph in WildFire (Jiang et al. 2019).
(F) Opioid Drug Knowledge Graph (Kamdar et al. 2019)
What is Semantics?
Semantic Interpreter
Map raw data to useful features
Reasoner
Use rules of inference to infer targets from features
Downstream
Perform downstream task
—-----
—-----
—------
Semantic Interpreter
Map raw data to useful features
Reasoner
Use rules of inference to infer targets from features
Target: Return search results
Inference rule: If keyword match exists return page
Symbolic AI
—-----
—-----
—------
Keywords Obtained Using TF-IDF Vectorization, for example.
—-----
Search Results
Semantic Interpreter
Map raw data to useful features
Reasoner
Use rules of inference to infer targets from features
—-----
—-----
—------
Raw Big data + Minimal Target Demonstrations
Semantic Interpreter
Map raw data to useful features
Reasoner
Use rules of inference to infer targets from features
Target Prediction
with probability score
Visual Information processing
- object classification, object segmentation
Natural language processing
- part-of-speech tagging, constituency parsing
Long List of Successes!!
Neural AI
Downstream
Perform downstream task
Search Results
Semantic Interpreter
Map raw data to useful features
Reasoner
Use rules of inference to infer targets from features
—-----
—-----
—------
Semantic Interpreter
Map raw data to useful features
Heterogeneous
Entities (nodes) and Relationships (directed edges)
Reasoner
Use rules of inference to infer targets from features
Target: Return search results
Inference rule: If path exists between nodes through certain intermediate nodes
Search Graph
Knowledge-infused Neurosymbolic AI
Downstream
Perform downstream task
Search Results
Semantic Interpreter
Map raw data to useful features
Reasoner
Use rules of inference to infer targets from features
—-----
—-----
—------
Semantic Interpreter
Map raw data to useful features
Heterogeneous
Entities (nodes) and Relationships (directed edges)
Reasoner
Use rules of inference to infer targets from features
Target: Return search results
Inference rule: If path exists between nodes through certain intermediate nodes
Process Knowledge-infused Neurosymbolic AI
Downstream
Perform downstream task
Search Results
Search Graph
Process Trigger
If search non-toxic
ALLEVIATE - A Chatbot for Mental Health Management in Individuals
Examples from our Works
Nourish Co-pilot: Custom, Compact and NeuroSymbolic Diet AI Model
MTSS AI Concierge- Custom, Compact and NeuroSymbolic AI Model
Please play on Youtube
Custom, Compact and Neurosymbolic AI Models
Group webpage
Projects
webpage
References