Platform for Situated Intelligence
arXiv:2103.15975
Abstract
We introduce Platform for Situated Intelligence, an open-source framework created to support the rapid development and study of multimodal, integrative-AI systems. The framework provides infrastructure for sensing, fusing, and making inferences from temporal streams of data across different modalities, a set of tools that enable visualization and debugging, and an ecosystem of components that encapsulate a variety of perception and processing technologies. These assets jointly provide the means for rapidly constructing and refining multimodal, integrative-AI systems, while retaining the efficiency and performance characteristics required for deployment in open-world settings.
arXiv comment29 pages, 14 figures, Microsoft Research Technical Report
References in corpus (5)
- Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
- Language Models are Few-Shot Learners
- The Microsoft 2017 Conversational Speech Recognition System
- The History Began from AlexNet: A Comprehensive Survey on Deep Learning Approaches
- MediaPipe: A Framework for Building Perception Pipelines
Cited by in corpus (6)
- ReactGenie: A Development Framework for Complex Multimodal Interactions Using Large Language Models
- TOM: A Development Platform For Wearable Intelligent Assistants
- An Interaction Design Toolkit for Physical Task Guidance with Artificial Intelligence and Mixed Reality
- Skeletal Data Matching and Merging from Multiple RGB-D Sensors for Room-Scale Human Behaviour Tracking
- Accelerating the Development of Multimodal, Integrative-AI Systems with Platform for Situated Intelligence
- Enabling a Social Robot to Process Social Cues to Detect when to Help a User