Harnessing Earnings Reports for Stock Predictions: A QLoRA-Enhanced LLM Approach

Abstract

Accurate stock market predictions following earnings reports are crucial for investors. Traditional methods, particularly classical machine learning models, struggle with these predictions because they cannot effectively process and interpret extensive textual data contained in earnings reports and often overlook nuances that influence market movements. This paper introduces an advanced approach by employing Large Language Models (LLMs) instruction fine-tuned with a novel combination of instruction-based techniques and quantized low-rank adaptation (QLoRA) compression. Our methodology integrates 'base factors', such as financial metric growth and earnings transcripts, with 'external factors', including recent market indices performances and analyst grades, to create a rich, supervised dataset. This comprehensive dataset enables our models to achieve superior predictive performance in terms of accuracy, weighted F1, and Matthews correlation coefficient (MCC), especially evident in the comparison with benchmarks such as GPT-4. We specifically highlight the efficacy of the llama-3-8b-Instruct-4bit model, which showcases significant improvements over baseline models. The paper also discusses the potential of expanding the output capabilities to include a 'Hold' option and extending the prediction horizon, aiming to accommodate various investment styles and time frames. This study not only demonstrates the power of integrating cutting-edge AI with fine-tuned financial data but also paves the way for future research in enhancing AI-driven financial analysis tools.

Accepted by 2024 6th International Conference on Data-driven Optimization of Complex Systems

References in corpus (17)

• LoRA: Low-Rank Adaptation of Large Language Models
• QLoRA: Efficient Finetuning of Quantized LLMs
• Large Language Models for Forecasting and Anomaly Detection: A Systematic Literature Review
• Time Series Modeling for Heart Rate Prediction: From ARIMA to Transformers
• Learning to Generate Explainable Stock Predictions using Self-Reflective Large Language Models
• Large Language Models for Data Annotation and Synthesis: A Survey
• Twitter Sentiment Analysis of Covid Vacciness
• Optimizing Distributed Networking with Big Data Scheduling and Cloud Computing
• ZeroPrompt: Streaming Acoustic Encoders are Zero-Shot Masked LMs
• Advanced Payment Security System:XGBoost, LightGBM and SMOTE Integrated
• APEER: Automatic Prompt Engineering Enhances Large Language Model Reranking
• Learning from Teaching Regularization: Generalizable Correlations Should be Easy to Imitate
• Residual-based Language Models are Free Boosters for Biomedical Imaging
• Surveying Attitudinal Alignment Between Large Language Models Vs. Humans Towards 17 Sustainable Development Goals
• ComposerX: Multi-Agent Symbolic Music Composition with LLMs
• GraphCNNpred: A stock market indices prediction using a Graph based deep learning system
• Autonomous Navigation of Unmanned Vehicle Through Deep Reinforcement Learning