8 papers
A Scene Language Model for Open-Vocabulary Scene Mapping
Adam Lilja, Fabio Hübel, Siming He +6
Open-vocabulary 3D scene mapping aims to build a persistent representation of the objects in an environment. Existing systems typically rely on engineered mapping pipelines to asso…
FARM: Find Anything using Relational Spatial Memory
Siming He, Leo Huang, Adam Lilja +6
Robots operating in homes, warehouses, and other object-rich environments need memory systems that can find specific object instances on demand. Object-level memory alone is often…
Beyond Chamfer Distance: Granular Order-aware Evaluation Metric For Online Mapping
Chouaib Bencheikh Lehocine, Adam Lilja, Junsheng Fu +1
Online map estimation is a crucial component of autonomous driving systems that reduces the reliance on costly high-definition maps. State-of-the-art (SOTA) methods commonly predic…
QueryOcc: Query-based Self-Supervision for 3D Semantic Occupancy
Adam Lilja, Ji Lan, Junsheng Fu +1
Learning 3D scene geometry and semantics from images is a core challenge in computer vision and a key capability for autonomous driving. Since large-scale 3D annotation is prohibit…
GASP: Unifying Geometric and Semantic Self-Supervised Pre-training for Autonomous Driving
William Ljungbergh, Adam Lilja, Adam Tonderski. Arvid Laveno Ling +6
Self-supervised pre-training based on next-token prediction has enabled large language models to capture the underlying structure of text, and has led to unprecedented performance…
Exploring Semi-Supervised Learning for Online Mapping
Adam Lilja, Erik Wallin, Junsheng Fu +1
The ability to generate online maps using only onboard sensory information is crucial for enabling autonomous driving beyond well-mapped areas. Training models for this task -- pre…
Are NeRFs ready for autonomous driving? Towards closing the real-to-simulation gap
Carl Lindström, Georg Hess, Adam Lilja +4
Neural Radiance Fields (NeRFs) have emerged as promising tools for advancing autonomous driving (AD) research, offering scalable closed-loop simulation and data augmentation capabi…
Localization Is All You Evaluate: Data Leakage in Online Mapping Datasets and How to Fix It
Adam Lilja, Junsheng Fu, Erik Stenborg +1
The task of online mapping is to predict a local map using current sensor observations, e.g. from lidar and camera, without relying on a pre-built map. State-of-the-art methods are…