AIMS Lab Background

AIMS Lab

Human-Centred AI for Multimodal Sensing

We build human-centered AI that can perceive, understand, adapt to, and act with people in the real world.

AIMS Lab

Human-Centred AI for Multimodal Sensing

Lead: Ting Dang, Senior Lecturer, The University of Melbourne

ting.dang@unimelb.edu.au
Google Scholar | ResearchGate | LinkedIn | Twitter (new: @dang_sally) | University Profile

Note: My previous Twitter/X account (@tingdang513) has been hacked and is no longer accessed.
Please follow my new account: @dang_sally. Ignore any messages or posts from the old account.

Human-Centered AI · Speech and Audio Processing · Ubiquitous Sensing
Multimodal AI · Digital Health
CV
Ting Dang

About the Lab

The AIMS Lab (Human-Centred AI for Multimodal Sensing) at the University of Melbourne, led by Dr. Ting Dang, develops human-centered AI that can perceive, understand, adapt to, and act with people in the real world. Real-world human signals, such as speech, sound, and physiology, are noisy, ambiguous, diverse, and context-dependent. Our research asks how AI can understand people from these signals, remain reliable as people and environments change, and ultimately reason with, interact with, and support them. Across this foundation we advance a capability progression: perceive → understand → adapt → act, toward applications in communication, accessibility, and health. We collaborate with clinicians, industry, and interdisciplinary partners to translate these methods into deployable systems.

Ting Dang is a Senior Lecturer at the University of Melbourne. She previously held positions as a Senior Research Scientist at Nokia Bell Labs (UK), a Senior Research Associate at the University of Cambridge, and a Research Associate at the University of New South Wales (UNSW), where she received her Ph.D. She is an elected member of the IEEE Speech and Language Technical Committee (SLTC), an IEEE Senior Member, and an Associate Editor for IEEE Transactions on Affective Computing, Computer Speech and Language, and IEEE Pervasive Computing.

Research Architecture

The lab focuses on three connected pillars:
  • Perception & Understanding — modelling people from complex real-world signals, including speech and audio, affect, physiological sensing, and multimodal human-state representation.
  • Adaptive & Trustworthy AI — keeping models reliable as people, data, and environments differ or change, through adaptation, uncertainty modelling, and low-resource learning.
  • Interactive & Agentic AI — enabling systems that reason, communicate, and act with people, through spoken dialogue, voice agents, human–agent interaction, and tool use.

The program is grounded in human-centered AI, speech and audio processing, ubiquitous sensing, multimodal AI, and digital health. Together, these pillars target impact in health and wellbeing, communication and accessibility, and safety-critical environments.

Join the Team

Now Recruiting
Seeking motivated PhD students to join our team!
  • Academic excellence: a Weighted Average Mark (WAM) of at least 85 (or ≥82 for current University of Melbourne students) is required.
  • Publication experience is preferred. Applicants should have published papers (as first author or significant contributor) in reputable conferences or journals.
  • Candidates should have a strong background in computer science, electrical engineering, or related technical areas. (Note: applicants from purely health or clinical backgrounds are not the best fit for our current team needs.)
  • Master’s degree is preferred; for those applying with a bachelor’s, first-class Honours from a top university is strongly preferred.
  • We seek applicants enthusiastic about human-centered AI, speech and audio processing, ubiquitous sensing, multimodal AI, and digital health.
  • Please send your CV, academic transcripts, and a short research proposal aligned with our research themes.
  • CSC students and visiting scholars with relevant backgrounds are also welcome.

News

2026/08: Nominated and elected as a committee member of the IEEE Speech and Language Technical Committee (SLTC).

2026/06: Sixteen papers accepted at INTERSPEECH 2026.

2026/04: One paper titled "X-FEMR: A Token-level Explainable Approach for Electronic Health Records Foundation Models using Transformer" accepted by IJCAI 2026.

2026/04: Elevated to Senior Member, IEEE.

2026/03: Awarded fund for "AI LEARN: Artificial Intelligence Centre for the Empowerment of Human Learning".

2026/03: One paper titled "Multi-Scale Diffusion for Bio-topological Representation Learning on Multimodal Brain Graphs" accepted by ACM Transactions on Intelligent Systems and Technology.

2026/01: Five papers accepted at ICASSP 2026.

2025/11: Awarded Google Fund for "Benchmarking Auditory Cognitive Reasoning in Audio-Language Models".

2025/11: Joined Editorial Board of IEEE Transactions on Affective Computing.

2025/09: Two papers and two workshop papers accepted at NeurIPS 2025.

2025/09: One paper accepted by SenSys 2026, titled 'From Cheap to Chic: Enhancing Music Playback Quality of Budget Earphones via Hardware-Aware Learning'.

2025/09: One paper accepted by¡ IEEE Transactions on Affective Computing, titled 'How many raters do we need? Analyses of uncertainty in estimating ambiguity-aware emotion labels'.

2025/09: One paper accepted by ACM Transactions on Computing for Healthcare, titled 'Data-Efficient Psychiatric Disorder Detection via Self-supervised Learning on Frequency-enhanced Brain Networks'.

2025/08: Shortlisted as the Finalist for the Rising Star (Academics) STEM Women in Color Award 2025.

2025/07: Senior PC of AAAI 2026.

2025/07: Two papers accepted at UbiComp/ISWC 2025 workshops.

2025/05: Two papers accepted at INTERSPEECH 2025.

2025/04: Joined the Editorial Board of Computer Speech and Language.

2025/03: Two US patents are granted.

2024/12: Two papers are accepted by IEEE ICASSP 2025.

2024/11: One paper titled 'Multimodal Large Language Models in Human-centered Health: Practical Insights' is accepted by IEEE Pervasive Computing.

2024/10: Served as the Area Chair for ICASSP 2024.

2024/09:One paper titled 'TinyTTA: Efficient Test-time Adaptation via Early-exit Ensembles on Edge Devices' is accepted by NeurIPS 2024.

2024/05: Joined the Editorial Board of IEEE Pervasive Computing.