Showing physics.soc-phShow all
2 papers · 1 filter
physics.soc-ph2026
Measuring What the Crawler Sees: Discovery Curves, Core Persistence, and Shell Dynamics in Longitudinal Web Crawls
Michael Paris, Hande Celikkanat, Luca Foppiano
A longitudinal web crawl is a sequence of partial samples of an evolving URL population. Pairwise containment between two crawls is the standard probe; under a simple \emph{urn} mo…
physics.soc-ph2026
Estimating Absolute Web Crawl Coverage From Longitudinal Set Intersections
Michael Paris, Grigori Paris, Fabian Baumann
Web archives preserve portions of the web, but quantifying their completeness remains challenging. Prior approaches have estimated the coverage of a crawl by either comparing the o…