Entropy-guided sequence weighting for efficient exploration in RL-based LLM fine-tuning

Abdullah Vanlioglu

We introduce Entropy-Guided Sequence Weighting (EGSW), a novel approach that enhances the exploration-exploitation tradeoff by dynamically assigning weights to generated outputs ba…