Dulanga Weerakoon
I am a Postdoctoral Associate at the Singapore-MIT Alliance for Research and Technology (SMART), MIT’s research center in Singapore, established in collaboration with the National Research Foundation of Singapore. I work under the supervision of Prof. Sanjay Sarma and Prof. Archan Misra as part of the Mens, Manus, and Machine (M3S) program.
My primary research interests focus on multi-modal sensing for Human-AI Collaboration on pervasive devices, emphasizing low energy consumption, minimal latency, and efficient computational requirements. Currently, I am developing human instruction comprehension algorithms that process input from various modalities, including vision, language, and human gestures. I have proposed several fusion techniques and optimization strategies to enhance instruction comprehension accuracy while reducing latency and energy overheads, making them suitable for resource-constrained pervasive devices.
I earned my PhD in Computer Science from the School of Computing and Information Systems at Singapore Management University (SMU), under the supervision of Prof. Archan Misra and co-supervision of Dr. Vigneshwaran Subbaraju.
News
- Oct 2024 Our Paper titled, "NeuroViG - Integrating Event Cameras for Resource-Efficient Video Grounding" was accepted to WACV 2025.
- Sept 2024 Our Paper titled, "CAS: Fusing DNN Optimization & Adaptive Sensing for Energy-Efficient Multi-Modal Inference" was accepted Robotics and Automation Letters (RA-L). I will be presenting this work at ICRA 2025.
- May 2024 I successfully defended my PhD thesis titled, "Enabling and Optimizing Multi-Modal Sense-Making for Human-AI Interaction Tasks".
- April 2024 Our Paper titled, "Towards Efficient Spatio-Temporal Video Grounding in Pervasive Mobile Devices" was accepted as a poster paper at ACM MobiSys 2024.
- Oct 2023 Our Paper titled, "VGGlass - Demonstrating Visual Grounding and Localization Synergy with a LiDAR-enabled Smart-Glass" was accepted as a demo paper at ACM SenSys 2023.
- Jul 2023 I was offered Presidential Doctoral Fellowship in Computing at SMU, which is provided to exceptionally qualified students at SMU based on their research outcomes.
- Jan 2023 I was offered a PhD Research Attachment at Institute of High Performance Computing (IHPC), A*STAR, Singapore
- Dec 2022 Our Paper titled, "Demonstrating Multi-modal Human Instruction Comprehension with AR Smart Glass" was accepted as a demo paper at COMSNETS 2023.
- Jul 2022 Our Paper titled, "Demonstrating Multi-modal Human Instruction Comprehension with AR Smart Glass" was accepted as a demo paper at COMSNETS 2023.
- Jun 2022 Our Paper titled, "SoftSkip: Empowering Multi-Modal Dynamic Pruning for Single-Stage Referring Comprehension" was accepted to ACM Multimedia 2022.
- Jun 2022 Our Paper titled, "COSM2IC: Optimizing Real-time Multi-Modal Instruction Comprehension" was accepted to IROS 2022.
Education
- SINGAPORE MANAGEMENT UNIVERSITY, SINGAPORE
DOCTOR OF PHILOSOPHY (PHD), COMPUTER SCIENCE
Specialisation: Human AI Collaboration
Thesis (Tentative): Enabling and Optimizing Multi-Modal Sense-Making for Human-AI Interaction Tasks
Supervisor: Prof. Archan Misra
Co-Supervisor : Dr. Vigneshwaran Subbaraju August 2019 - Present - UNIVERSITY OF MORATUWA, SRI LANKA
BACHELOR OF SCIENCE HONOURS (BSc(Hons)) IN ENGINEERING
Specialisation: Electronics and Telecommunication Engineering
Thesis : People Counting and Tracking with Xilinx ZC702 Kits
Supervisor:Dr. Ranga Rodrigo
Co-Supervisor : Dr. Ajith Pasquel January 2017 - January 2018