6 papers
Confidence-Modulated Speculative Decoding for Large Language Models
Jaydip Sen, Subhasis Dasgupta, Hetvi Waghela
Speculative decoding has emerged as an effective approach for accelerating autoregressive inference by parallelizing token generation through a draft-then-verify paradigm. However,…
Predicting Road Crossing Behaviour using Pose Detection and Sequence Modelling
Subhasis Dasgupta, Preetam Saha, Agniva Roy +1
The world is constantly moving towards AI based systems and autonomous vehicles are now reality in different parts of the world. These vehicles require sensors and cameras to detec…
Hierarchical Verification of Speculative Beams for Accelerating LLM Inference
Jaydip Sen, Harshitha Puvvala, Subhasis Dasgupta
Large language models (LLMs) have achieved remarkable success across diverse natural language processing tasks but face persistent challenges in inference efficiency due to their a…
Determination Of Structural Cracks Using Deep Learning Frameworks
Subhasis Dasgupta, Jaydip Sen, Tuhina Halder
Structural crack detection is a critical task for public safety as it helps in preventing potential structural failures that could endanger lives. Manual detection by inexperienced…
Advancing Decoding Strategies: Enhancements in Locally Typical Sampling for LLMs
Jaydip Sen, Saptarshi Sengupta, Subhasis Dasgupta
This chapter explores advancements in decoding strategies for large language models (LLMs), focusing on enhancing the Locally Typical Sampling (LTS) algorithm. Traditional decoding…
Understanding the Impact of News Articles on the Movement of Market Index: A Case on Nifty 50
Subhasis Dasgupta, Pratik Satpati, Ishika Choudhary +1
In the recent past, there were several works on the prediction of stock price using different methods. Sentiment analysis of news and tweets and relating them to the movement of st…