Collaborative Research: SHF: Small: Designing and Optimizing Tiny Vector Symbolic Architectures for Ultra-Efficient Inference on Tiny Devices

NSF Award Search · 01002526DB NSF RESEARCH & RELATED ACTIVIT · $280,000 · view on nsf.gov ↗

Abstract

Despite the advances in deep neural networks (DNNs) and edge computing, there exist substantial challenges to enabling end-to-end DNN inference on a full spectrum of edge devices, such as tiny wearables and low-cost Internet-of-things (IoT) devices. This problem has spurred the recent studies of brain-inspired vector symbolic representation (VSA) classifiers as an alternative framework for ubiquitous on-device inference. At a high level, VSA classifiers mimic the brain cognition process by representing each object as a vector (typically in a very high-dimensional space). While VSA classifiers offer advantages over DNNs in terms of inference efficiency due to parallel processing, the hyper-dimensionality in their design can still easily result in a prohibitively large VSA model size beyond the limit of many tiny devices with stringent resource constraints. If successful, this project will make it possible for more everyday devices to run advanced artificial intelligence (AI) on their own, without needing to send data to remote servers. This could improve privacy, save energy, and open the door to smarter wearables, medical devices, and home gadgets. Finally, the project will bring the latest discoveries into college courses to help train the next generation of engineers and computer scientists. To address the hyper-dimensionality challenge, this project moves away from hypervector-oriented VSA and proposes TinyVSA, which uses much smaller, compact vector representations. S

Key facts

NSF award ID
2449990
Awardee
University of California-Riverside (CA)
SAM.gov UEI
MR5QC5FCAVH5
PI
Shaolei Ren
Primary program
01002526DB NSF RESEARCH & RELATED ACTIVIT
All programs
SMALL PROJECT, DES AUTO FOR MICRO & NANO SYST
Estimated total
$280,000
Funds obligated
$280,000
Transaction type
Standard Grant
Period
10/01/2025 → 09/30/2028