activity
20242026
most citedIs Functional Correctness Enough to Evaluate Code Language Models? Exploring Diversity of Generated Codes

1 citations · 1 across the 9 of their papers we have counts for

collaborators
Showing 2024Show all

5 papers · 1 filter

cs.CL2024

Verbosity-Aware Rationale Reduction: Effective Reduction of Redundant Rationale via Principled Criteria

Joonwon Jang, Jaehee Kim, Wonbin Kweon +2

Large Language Models (LLMs) rely on generating extensive intermediate reasoning units (e.g., tokens, sentences) to enhance final answer quality across a wide range of complex task…

cs.SE2024

Eliciting Instruction-tuned Code Language Models' Capabilities to Utilize Auxiliary Function for Code Generation

Seonghyeon Lee, Suyeon Kim, Joonwon Jang +3

We study the code generation behavior of instruction-tuned models built on top of code pre-trained language models when they could access an auxiliary function to implement a funct…

cs.SE2024★ 1 cited

Is Functional Correctness Enough to Evaluate Code Language Models? Exploring Diversity of Generated Codes

Heejae Chon, Seonghyeon Lee, Jinyoung Yeo +1

Language models (LMs) have exhibited impressive abilities in generating codes from natural language requirements. In this work, we highlight the diversity of code generated by LMs…

cs.SE2024

Exploring Language Model's Code Generation Ability with Auxiliary Functions

Seonghyeon Lee, Sanghwan Jang, Seongbo Jang +2

Auxiliary function is a helpful component to improve language model's code generation ability. However, a systematic exploration of how they affect has yet to be done. In this work…

cs.CL2024

KoDialogBench: Evaluating Conversational Understanding of Language Models with Korean Dialogue Benchmark

Seongbo Jang, Seonghyeon Lee, Hwanjo Yu

As language models are often deployed as chatbot assistants, it becomes a virtue for models to engage in conversations in a user's first language. While these models are trained on…