Showing 2024Show all
3 papers · 1 filter
cs.HC2024
A System for Quantifying Data Science Workflows with Fine-Grained Procedural Logging and a Pilot Study
Jinjin Zhao, Avidgor Gal, Sanjay Krishnan
It is important for researchers to understand precisely how data scientists turn raw data into insights, including typical programming patterns, workflow, and methodology. This pap…
cs.DB2024
Compression and In-Situ Query Processing for Fine-Grained Array Lineage
Jinjin Zhao, Sanjay Krishnan
Tracking data lineage is important for data integrity, reproducibility, and debugging data science workflows. However, fine-grained lineage (i.e., at a cell level) is challenging t…
cs.HC2024
Data Makes Better Data Scientists
Jinjin Zhao, Avidgor Gal, Sanjay Krishnan
With the goal of identifying common practices in data science projects, this paper proposes a framework for logging and understanding incremental code executions in Jupyter noteboo…