5 papers · 1 filter
Confidence-Modulated Speculative Decoding for Large Language Models
Jaydip Sen, Subhasis Dasgupta, Hetvi Waghela
Speculative decoding has emerged as an effective approach for accelerating autoregressive inference by parallelizing token generation through a draft-then-verify paradigm. However,…
Hierarchical Verification of Speculative Beams for Accelerating LLM Inference
Jaydip Sen, Harshitha Puvvala, Subhasis Dasgupta
Large language models (LLMs) have achieved remarkable success across diverse natural language processing tasks but face persistent challenges in inference efficiency due to their a…
Advancing Decoding Strategies: Enhancements in Locally Typical Sampling for LLMs
Jaydip Sen, Saptarshi Sengupta, Subhasis Dasgupta
This chapter explores advancements in decoding strategies for large language models (LLMs), focusing on enhancing the Locally Typical Sampling (LTS) algorithm. Traditional decoding…
Understanding the Impact of News Articles on the Movement of Market Index: A Case on Nifty 50
Subhasis Dasgupta, Pratik Satpati, Ishika Choudhary +1
In the recent past, there were several works on the prediction of stock price using different methods. Sentiment analysis of news and tweets and relating them to the movement of st…
Analyzing Consumer Reviews for Understanding Drivers of Hotels Ratings: An Indian Perspective
Subhasis Dasgupta, Soumya Roy, Jaydip Sen
In the internet era, almost every business entity is trying to have its digital footprint in digital media and other social media platforms. For these entities, word of mouse is al…