ComSum: Commit Messages Summarization and Meaning Preservation
arXiv:2108.10763
Abstract
We present ComSum, a data set of 7 million commit messages for text summarization. When documenting commits, software code changes, both a message and its summary are posted. We gather and filter those to curate developers' work summarization data set. Along with its growing size, practicality and challenging language domain, the data set benefits from the living field of empirical software engineering. As commits follow a typology, we propose to not only evaluate outputs by Rouge, but by their meaning preservation.
References in corpus (9)
- Teaching Machines to Read and Comprehend
- A Closer Look at Memorization in Deep Networks
- Machine Learning in Cyber-Security - Problems, Challenges and Data Sets
- BIGPATENT: A Large-Scale Dataset for Abstractive and Coherent Summarization
- GO FIGURE: A Meta Evaluation of Factuality in Summarization
- Fine-grained evaluation of German-English Machine Translation based on a Test Suite
- Reference-less Measure of Faithfulness for Grammatical Error Correction
- Follow Your Nose -- Which Code Smells are Worth Chasing?
- Dissecting Generation Modes for Abstractive Summarization Models via Ablation and Attribution