Dulanga Weerakoon

I am a Postdoctoral Associate at the Singapore-MIT Alliance for Research and Technology (SMART), MIT’s research center in Singapore, established in collaboration with the National Research Foundation of Singapore. I work under the supervision of Prof. Sanjay Sarma and Prof. Archan Misra as part of the Mens, Manus, and Machine (M3S) program.

My primary research interests focus on multi-modal sensing for Human-AI Collaboration on pervasive devices, emphasizing low energy consumption, minimal latency, and efficient computational requirements. Currently, I am developing human instruction comprehension algorithms that process input from various modalities, including vision, language, and human gestures. I have proposed several fusion techniques and optimization strategies to enhance instruction comprehension accuracy while reducing latency and energy overheads, making them suitable for resource-constrained pervasive devices.

I earned my PhD in Computer Science from the School of Computing and Information Systems at Singapore Management University (SMU), under the supervision of Prof. Archan Misra and co-supervision of Dr. Vigneshwaran Subbaraju.

News

  • Oct 2024 Our Paper titled, "NeuroViG - Integrating Event Cameras for Resource-Efficient Video Grounding" was accepted to WACV 2025.
  • Sept 2024 Our Paper titled, "CAS: Fusing DNN Optimization & Adaptive Sensing for Energy-Efficient Multi-Modal Inference" was accepted Robotics and Automation Letters (RA-L). I will be presenting this work at ICRA 2025.
  • May 2024 I successfully defended my PhD thesis titled, "Enabling and Optimizing Multi-Modal Sense-Making for Human-AI Interaction Tasks".
  • April 2024 Our Paper titled, "Towards Efficient Spatio-Temporal Video Grounding in Pervasive Mobile Devices" was accepted as a poster paper at ACM MobiSys 2024.
  • Oct 2023 Our Paper titled, "VGGlass - Demonstrating Visual Grounding and Localization Synergy with a LiDAR-enabled Smart-Glass" was accepted as a demo paper at ACM SenSys 2023.
  • Jul 2023 I was offered Presidential Doctoral Fellowship in Computing at SMU, which is provided to exceptionally qualified students at SMU based on their research outcomes.
  • Jan 2023 I was offered a PhD Research Attachment at Institute of High Performance Computing (IHPC), A*STAR, Singapore
  • Dec 2022 Our Paper titled, "Demonstrating Multi-modal Human Instruction Comprehension with AR Smart Glass" was accepted as a demo paper at COMSNETS 2023.
  • Jul 2022 Our Paper titled, "Demonstrating Multi-modal Human Instruction Comprehension with AR Smart Glass" was accepted as a demo paper at COMSNETS 2023.
  • Jun 2022 Our Paper titled, "SoftSkip: Empowering Multi-Modal Dynamic Pruning for Single-Stage Referring Comprehension" was accepted to ACM Multimedia 2022.
  • Jun 2022 Our Paper titled, "COSM2IC: Optimizing Real-time Multi-Modal Instruction Comprehension" was accepted to IROS 2022.

Education

Singapore Management University University of Moratuwa
  • SINGAPORE MANAGEMENT UNIVERSITY, SINGAPORE
    DOCTOR OF PHILOSOPHY (PHD), COMPUTER SCIENCE
    Specialisation: Human AI Collaboration
    Thesis (Tentative): Enabling and Optimizing Multi-Modal Sense-Making for Human-AI Interaction Tasks
    Supervisor: Prof. Archan Misra
    Co-Supervisor : Dr. Vigneshwaran Subbaraju
    August 2019 - Present
  • UNIVERSITY OF MORATUWA, SRI LANKA
    BACHELOR OF SCIENCE HONOURS (BSc(Hons)) IN ENGINEERING
    Specialisation: Electronics and Telecommunication Engineering
    Thesis : People Counting and Tracking with Xilinx ZC702 Kits
    Supervisor:Dr. Ranga Rodrigo
    Co-Supervisor : Dr. Ajith Pasquel
    January 2017 - January 2018