Exploring the Roles of Large Language Models in Reshaping Transportation Systems: A Survey, Framework, and Roadmap
arXiv:2503.21411 · doi:10.1016/j.ait.2025.100003
Abstract
Modern transportation systems face pressing challenges due to increasing demand, dynamic environments, and heterogeneous information integration. The rapid evolution of Large Language Models (LLMs) offers transformative potential to address these challenges. Extensive knowledge and high-level capabilities derived from pretraining evolve the default role of LLMs as text generators to become versatile, knowledge-driven task solvers for intelligent transportation systems. This survey first presents LLM4TR, a novel conceptual framework that systematically categorizes the roles of LLMs in transportation into four synergetic dimensions: information processors, knowledge encoders, component generators, and decision facilitators. Through a unified taxonomy, we systematically elucidate how LLMs bridge fragmented data pipelines, enhance predictive analytics, simulate human-like reasoning, and enable closed-loop interactions across sensing, learning, modeling, and managing tasks in transportation systems. For each role, our review spans diverse applications, from traffic prediction and autonomous driving to safety analytics and urban mobility optimization, highlighting how emergent capabilities of LLMs such as in-context learning and step-by-step reasoning can enhance the operation and management of transportation systems. We further curate practical guidance, including available resources and computational guidelines, to support real-world deployment. By identifying challenges in existing LLM-based solutions, this survey charts a roadmap for advancing LLM-driven transportation research, positioning LLMs as central actors in the next generation of cyber-physical-social mobility ecosystems. Online resources can be found in the project page: https://github.com/tongnie/awesome-llm4tr.
Published at Artificial Intelligence for Transportation, Inaugural Issue
References in corpus (45)
- Training language models to follow instructions with human feedback
- Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
- Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
- LoRA: Low-Rank Adaptation of Large Language Models
- PaLM: Scaling Language Modeling with Pathways
- A Survey on Large Language Model based Autonomous Agents
- A Survey of Large Language Models
- Scaling Instruction-Finetuned Language Models
- Large Language Models are Zero-Shot Reasoners
- A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Ugly
- Deep Learning on Traffic Prediction: Methods, Analysis and Future Directions
- Tree of Thoughts: Deliberate Problem Solving with Large Language Models
- QLoRA: Efficient Finetuning of Quantized LLMs
- Decision Transformer: Reinforcement Learning via Sequence Modeling
- FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness
- Toolformer: Language Models Can Teach Themselves to Use Tools
- CogView: Mastering Text-to-Image Generation via Transformers
- The GOOSE Dataset for Perception in Unstructured Environments
- Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning
- Direct Preference Optimization: Your Language Model is Secretly a Reward Model
- Traffic Prediction using Artificial Intelligence: Review of Recent Advances and Emerging Opportunities
- Auditing large language models: a three-layered approach
- Survey on Large Language Model-Enhanced Reinforcement Learning: Concept, Taxonomy, and Methods
- Applications of deep learning in traffic congestion detection, prediction and alleviation: A survey
- Towards Explainable Traffic Flow Prediction with Large Language Models
- Root Mean Square Layer Normalization
- Large Language Models Are Zero-Shot Time Series Forecasters
- GPT-4 Enhanced Multimodal Grounding for Autonomous Driving: Leveraging Cross-Modal Attention with Large Language Models
- LLM-Pruner: On the Structural Pruning of Large Language Models
- Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Bias
- LC-LLM: Explainable Lane-Change Intention and Trajectory Predictions with Large Language Models
- Estimating multi-year 24/7 origin-destination demand using high-granular multi-source traffic data
- When language and vision meet road safety: leveraging multimodal large language models for video-based traffic accident analysis
- LLM-attacker: Enhancing Closed-loop Adversarial Scenario Generation for Autonomous Driving with Large Language Models
- Open-TI: Open Traffic Intelligence with Augmented Language Model
- Memory-Efficient Fine-Tuning of Compressed Large Language Models via sub-4-bit Integer Quantization
- Estimating and Mitigating the Congestion Effect of Curbside Pick-ups and Drop-offs: A Causal Inference Approach
- Atom: Low-bit Quantization for Efficient and Accurate LLM Serving
- ScenarioNet: Open-Source Platform for Large-Scale Traffic Scenario Simulation and Modeling
- Joint Estimation and Prediction of City-wide Delivery Demand: A Large Language Model Empowered Graph-based Learning Approach
- A Gentle Introduction and Tutorial on Deep Generative Models in Transportation Research
- DrPlanner: Diagnosis and Repair of Motion Planners for Automated Vehicles Using Large Language Models
- Spatiotemporal Implicit Neural Representation as a Generalized Traffic Data Learner
- MiniCache: KV Cache Compression in Depth Dimension for Large Language Models
- BehaviorGPT: Smart Agent Simulation for Autonomous Driving with Next-Patch Prediction