CIRC: Dev: SMILE: Scan to Multi-sensorial Interactive Learning Environment

NSF Award Search · 01002425DB NSF RESEARCH & RELATED ACTIVIT · $750,000 · view on nsf.gov ↗

Abstract

VR (Virtual Reality)-based immersive and interactive environments can be a great resource for learning and training, especially for concepts that involve safety aspects by interacting with inflammable or breakable objects. The tedious nature of developing these VR experiences continues to be a limiting factor for VR becoming mainstream. The main goal of this project is the design and development of an innovative infrastructure, SMILE (Scan to Multi-sensorial Interactive Learning Environment), focusing on: (1) nearly automated construction of VR environments that mimic real-world indoor scenes; (2) interactions with virtual objects involving multiple senses such as touch, visual, aural, and smell. The SMILE infrastructure will undergo rigorous software testing to ensure safe interactions before being deployed to support Internet-scale collaboration among users. In the exploratory phase of this project, the team will address the following: (1) Democratize the creation of VR environments for subject-matter experts that are realistic in reflecting the ambiance of a real-world scene while providing the needed interactions with objects in the scene. (2) Apply sensorial information directly to 3D objects, enabling multiple sensations during interactions with the virtual objects. (3) Internet-scale collaborations in SMILE through multi-modal inter-sender and inter-receiver skew synchronization, based on the temporal requirements of multi-sensorial interactions. This will be tested

Key facts

NSF award ID
2603236
Awardee
SUNY at Albany (NY)
SAM.gov UEI
NHH3T1Z96H29
PI
Balakrishnan Prabhakaran
Primary program
01002425DB NSF RESEARCH & RELATED ACTIVIT
All programs
—
Estimated total
$750,000
Funds obligated
$514,915
Transaction type
Standard Grant
Period
10/01/2025 → 10/31/2027