Bayesian Blocks, A New Method to Analyze Structure in Photon Counting Data
arXiv:astro-ph/9711233 · doi:10.1086/306064
Abstract
I describe a new time-domain algorithm for detecting localized structures (bursts), revealing pulse shapes, and generally characterizing intensity variations. The input is raw counting data, in any of three forms: time-tagged photon events (TTE), binned counts, or time-to-spill (TTS) data. The output is the most likely segmentation of the observation into time intervals during which the photon arrival rate is perceptibly constant -- i.e. has a fixed intensity without statistically significant variations. Since the analysis is based on Bayesian statistics, I call the resulting structures Bayesian Blocks. Unlike most, this method does not stipulate time bins -- instead the data themselves determine a piecewise constant representation. Therefore the analysis procedure itself does not impose a lower limit to the time scale on which variability can be detected. Locations, amplitudes, and rise and decay times of pulses within a time series can be estimated, independent of any pulse-shape model -- but only if they do not overlap too much, as deconvolution is not incorporated. The Bayesian Blocks method is demonstrated by analyzing pulse structure in BATSE -ray data. The MatLab scripts and sample data can be found on the WWW at: http://george.arc.nasa.gov/~scargle/papers.html
42 pages, 2 figures; revision correcting mathematical errors; clarifications; removed Cyg X-1 section
Cited by in corpus (215)
- The Large Area Telescope on the Fermi Gamma-ray Space Telescope Mission
- Understanding the Lomb-Scargle Periodogram
- An online repository of Swift/XRT light curves of GRBs
- The eROSITA X-ray telescope on SRG
- Studies in Astronomical Time Series Analysis. VI. Bayesian Block Representations
- An Algorithm for Optimal Partitioning of Data on an Interval
- Chandra Orion Ultradeep Project: Observations and Source Lists
- First Sagittarius A* Event Horizon Telescope Results. II. EHT and Multi-wavelength Observations, Data Processing, and Calibration
- 3FHL: The Third Catalog of Hard Fermi-LAT Sources
- 2FHL: The Second Catalog of Hard Fermi-LAT Sources
- X-ray emitting young stars in the Orion Nebula
- Fermi-LAT Observations of the Gamma-ray Burst GRB 130427A
- The Second Swift BAT Gamma-Ray Burst Catalog
- 25 Years of Self-Organized Criticality: Solar and Astrophysics
- The First Fermi-LAT Catalog of Sources Above 10 GeV
- Stellar Activity on the Young Suns of Orion: COUP Observations of K5-7 Pre-Main Sequence Stars
- A peculiar hard X-ray counterpart of a Galactic fast radio burst
- GRB110721A: An extreme peak energy and signatures of the photosphere
- Gamma-ray Activity in the Crab Nebula: The Exceptional Flare of April 2011
- A Catalog of X-ray Point Sources from Two Megaseconds of Chandra Observations of the Galactic Center
- First search for gravitational waves from known pulsars with Advanced LIGO
- The Origin of the Solar Flare Waiting-Time Distribution
- First Simultaneous NIR/X-ray Detection of a Flare from SgrA*
- Avalanche dynamics of radio pulsar glitches
- Evidence for a Photospheric Component in the Prompt Emission of the Short GRB120323A and its Effects on the GRB Hardness-Luminosity Relation
- Threshold for Extended Emission in Short Gamma-Ray Bursts
- X-ray emission from early-type stars in the Orion Nebula Cluster
- A Comprehensive Analysis of Fermi Gamma-ray Burst Data: III. Energy-Dependent T90 Distributions of GBM GRBs and Instrumental Selection Effect on Duration Classification
- Chandra Multi-wavelength Project (ChaMP). I. First X-ray Source Catalog
- The Spectra and Variability of X-ray Sources in a Deep Chandra Observation of the Galactic Center
- Stochastic star formation in early galaxies: JWST implications
- A Bayesian Approach to Solar Flare Prediction
- X-ray Hardness Evolution in GRB Afterglows and Flares: Late Time GRB Activity Without N_H Variations
- Trends in Ultracool Dwarf Magnetism. I. X-Ray Suppression and Radio Enhancement
- Multiwavelength observations of GRB 110731A: GeV emission from onset to afterglow
- Diffuse emission measurement with INTEGRAL/SPI as indirect probe of cosmic-ray electrons and positrons
- Magnetar-like activity from the central compact object in the SNR RCW103
- An adaptive-binning method for generating constant-uncertainty/constant-significance light curves with Fermi-LAT data
- Probing Dynamical Gravity with the Polarization of Continuous Gravitational Waves
- On the Hardness-Intensity Correlation in Gamma-Ray Burst Pulses
- Correlations Between Lag, Luminosity, and Duration in Gamma-ray Burst Pulses
- Towards a Better Understanding of the GRB Phenomenon: a New Model for GRB Prompt Emission and its effects on the New Non-Thermal L-E relation
- Iron Fluorescent Line Emission from Young Stellar Objects in the Orion Nebula
- Detection of Low-energy Breaks in Gamma-Ray Burst Prompt Emission Spectra
- Autoregressive Times Series Methods for Time Domain Astronomy
- A Statistical Solar Flare Forecast Method
- A statistical analysis of X-ray variability in pre-main sequence objects of the Taurus Molecular Cloud
- A magnetar-like event from LS I +61 303 and its nature as a gamma-ray binary
- Reconciliation of Waiting Time Statistics of Solar Flares Observed in Hard X-Rays
- Testing the Epeak - Eiso relation for GRBs detected by Swift and Suzaku-WAM
- X-ray and IR Point Source Identification and Characteristics In the Embedded, Massive Star-Forming Region RCW 38
- Internal Energy Dissipation of Gamma-Ray Bursts Observed with Swift: Precursors, Prompt Gamma-rays, Extended emission and Late X-ray Flares
- Unification of Pulses in Long and Short Gamma-Ray Bursts: Evidence from Pulse Properties and their Correlations
- Temporal properties of short GRBs
- The 2012 flare of PG 1553+113 seen with H.E.S.S. and Fermi-LAT
- GRB Energetics in the Swift Era
- Evidence of Exponential Decay Emission in the Swift Gamma-ray Bursts
- X-ray Flares in Orion Low Mass Stars
- Active Galactic Nuclei under the scrutiny of CTA
- Prospects for GRB Science with the Fermi Large Area Telescope
- A Simultaneous Optical and X-ray Variability Study of the Orion Nebula Cluster. I. Incidence of Time-Correlated X-ray/Optical Variations
- X-ray Super-Flares From Pre-Main Sequence Stars: Flare Energetics And Frequency
- A detailed X-ray investigation of zeta Puppis - The variability on short and long timescales
- Fermi/GBM Observations of SGR J0501+4516 Bursts
- On the Variety of the Spectral and Temporal Behaviors of Long Gamma-Ray Burst Pulses
- The coronal mass ejection waiting-time distribution
- Heterogeneity in Short Gamma-ray Bursts
- Simultaneous Multiwavelength Observations of Magnetic Activity in Ultracool Dwarfs. IV. The Active, Young Binary NLTT 33370 AB (=2MASS J13142039+1320011)
- The Chandra Deep Field-North Survey: XVII. Evolution of magnetic activity in old late-type stars
- An XMM-Newton timing analysis of the eclipsing polar DP Leo
- Time-Dependent Searches for Point Sources of Neutrinos with the 40-String and 22-String Configurations of IceCube
- Long-term multi-wavelength variability and correlation study of Markarian 421 from 2007 to 2009
- X-ray and IR Point Source Identification and Characteristics in the Embedded, Massive Star-Forming Region RCW 108
- Simultaneous X-ray and Infrared Observations of Sagittarius A*'s Variability
- On Neural Architectures for Astronomical Time-series Classification with Application to Variable Stars
- 10.4m GTC observations of the nearby VHE-detected GRB 190829A/SN 2019oyw
- Deep Chandra Monitoring Observations of NGC 3379: Catalog of Source Properties
- Robust semicoherent searches for continuous gravitational waves with noise and signal models including hours to days long transients
- A Suzaku, NuSTAR, and XMM-Newton view on variable absorption and relativistic reflection in NGC 4151
- Hard X-ray polarization catalog for a 5-year sample of Gamma-Ray Bursts using AstroSat CZT-Imager
- Cosmological Time Dilation in Durations of Swift Long Gamma-Ray Bursts
- Discovery of a new TeV gamma-ray source: VER J0521+211
- Rapid Gamma-ray flux variability during the 2013 March Crab Nebula flare
- The Pulse Scale Conjecture and the Case of BATSE Trigger 2193
- X-ray Hardness Variations as an Internal/External Shock Diagnostic
- Deep Chandra Monitoring Observations of NGC 4278: Catalog of Source Properties
- Gamma-Ray Burst Pulse Shapes: Evidence for Embedded Shock Signatures?
- Random time series in Astronomy
- Spectral and temporal analysis of the joint Swift/BAT-Fermi/GBM GRB sample
- Catalog of Short Gamma-Ray Transients Detected in the SPI/INTEGRAL Experiment
- Two Predictions of supernova: GRB 130427A / SN 2013cq and GRB 180728A / SN 2018fip
- Revisiting the characteristics of the spectral lags in short gamma-ray bursts
- A Supernova Candidate at z=0.092 in XMM-Newton Archival Data
- Background-Source Separation in astronomical images with Bayesian probability theory (I): the method
- Probing the accretion disk and central engine structure of NGC4258 with Suzaku and XMM-Newton observations
- A new strongly X-ray flaring M9 dwarf in the solar neighborhood
- Low frequency view of GRB 190114C reveals time varying shock micro-physics
- A multi-wavelength view of magnetic flaring from PMS stars
- A Systematic Chandra study of Sgr A: I. X-ray flare detection
- Are gamma-ray bursts the same at high redshift and low redshift?
- Multiwavelength study of the flaring activity of Sgr A* in 2014 February-April
- GRB 081008: from burst to afterglow and the transition phase in between
- Source detection using a 3D sparse representation: application to the Fermi gamma-ray space telescope
- X-ray and radio observations of the magnetar Swift J1834.9-0846 and its dust-scattering halo
- Observation of enhanced X-ray emission from the CTTS AA Tau during a transit of an accretion funnel
- Automatic classification of time-variable X-ray sources
- A Simultaneous Optical and X-ray Variability Study of the Orion Nebula Cluster. II. A Common Origin in Magnetic Activity
- Multiwavelength Signatures of Magnetic Activity from Young Stellar Objects in the LkH\alpha101 Cluster
- Repeating fast radio bursts reveal memory from minutes to an hour
- Imaging the 511 keV positron annihilation sky with COSI
- Discovery of a Significant Magnetic CV Population in the Limiting Window
- Optical/-ray blazar flare correlations: understanding the high-energy emission process using ASAS-SN and Fermi light curves
- Fermi GBM GRBs with characteristics similar to GRB 170817A
- Timing properties of gamma-ray bursts detected by SPI-ACS detector on board of INTEGRAL
- Nonparametric Bayesian Estimation of Periodic Functions
- Structure in the 3D Galaxy Distribution: I. Methods and Example Results
- Evidence for departure from a power-law flare size distribution for a small solar active region
- High-Energy Variability of PSR J1311-3430
- The TANAMI Multiwavelength Program: Dynamic SEDs of Southern Blazars
- Constraints on Association of Single-pulse Gamma-ray Bursts and Supernovae
- On the Brightness and Waiting-time Distributions of a Type III Radio Storm observed by STEREO/WAVES
- An explanation for long flares from extragalactic globular cluster X-ray sources
- Methods for detection and characterization of signals in noisy data with the Hilbert-Huang Transform
- Sixteen years of X-ray monitoring of Sagittarius A*: Evidence for a decay of the faint flaring rate from 2013 August, 13 months before a rise in the bright flaring rate
- Short- and long-term variability of young stars in the Orion Nebula Cluster and Molecular Cloud
- A Bayesian method for detecting stellar flares
- The EXOD search for faint transients in XMM-Newton observations: Method and discovery of four extragalactic Type I X-ray Bursters
- Waiting Times of Quasi-homologous Coronal Mass Ejections from Super Active Regions
- Detailed Investigations of the Dimmest Bursts from Two Magnetars, SGR J0501+4516 and SGR J1550-5418
- Study of the X-ray activity of Sgr A* during the 2011 XMM-Newton campaign
- Testing the Gamma-Ray Burst Pulse Start Conjecture
- Simultaneous Monitoring of X-ray and Radio Variability in Sagittarius A*
- Instrumental Tip-of-the-iceberg Effects on the Prompt Emission of Swift/BAT Gamma-ray Bursts
- Relative spectral lag: an new redshift indicator to measure the cosmos with gamma-ray bursts
- Suzaku X-Ray Study of an Anomalous Source XSS J12270-4859
- Variability of Nineteen Millisecond Pulsars in 47 Tucanae with CHANDRA/HRC-S
- Multi-scale time- and frequency-domain likelihood analysis with photon weights
- The Spectral and Temporal Properties of Transient Sources in Early-Type Galaxies
- A short gamma-ray burst from a proto-magnetar remnant
- Improved Detection of Supernovae with the IceCube Observatory
- Multi-wavelength Observations of Sgr A*. I. 2019 July 18
- The missing GeV γ-ray binary: Searching for HESS J0632+057 with Fermi-LAT
- X-ray embedded stars as driving sources of outflow-driven turbulence in OMC1-S
- On the classification of flaring states of blazar
- Nonparametric inference of doubly stochastic Poisson process data via the kernel method
- NGC 4261 and NGC 4697: rejuvenated elliptical galaxies
- Spectro-polarimetric analysis of prompt emission of GRB 160325A: jet with evolving environment of internal shocks
- Multi-wavelength Variability of Sagittarius A* in July 2019
- Swift Observations of Gamma-Ray Burst Pulse Shapes: GRB Pulse Spectral Evolution Clarified
- A Survey of High Contrast Stellar Flares Observed by Chandra
- Testing the Simultaneity of Forbush Decreases with Algorithm-Selected Forbush Event Catalogue
- Time-dependent search for neutrino emission from x-ray binaries with the ANTARES telescope
- A hot gaseous galaxy halo candidate with Mg X absorption
- Supergiant Fast X-ray Transients uncovered by the EXTraS project: flares reveal the development of magnetospheric instability in accreting neutron stars
- X-ray and Near-infrared Studies of a Star-forming Cloud; L1448
- XMM-Newton and optical observations of the eclipsing polar CSS081231:071126+440405
- A Statistical Study of Soft X-ray Flares on Solar-type Stars
- Continuation of the X-ray monitoring of Sgr A*: the increase in bright flaring rate confirmed
- On Detecting Transient Phenomena
- The Hurst Exponent of Fermi GRBs
- Lens or Binary? Chandra Observations of the Wide Separation Broad Absorption Line Quasar Pair UM425
- The X-ray binary population in M33: II. X-ray spectra and variability
- Spectral Lags Obtained by CCF of Smoothed Lightcurves
- Analysis of cosmic ray data
- Discovery of Persistent Quasi-Periodic Oscillations in Accreting White Dwarfs: A New Link to X-ray Binaries
- Multi-Wavelength Observations of GRB 111228A and Implications for the Fireball and its environment
- Background subtraction and transient timing with Bayesian Blocks
- A Simple Method to Test for Energy-Dependent Dispersion in High Energy Light-Curves of Astrophysical Sources
- Search for muon-neutrino emission from GeV and TeV gamma-ray flaring blazars using five years of data of the ANTARES telescope
- Initial test of a Bayesian approach to solar flare prediction
- Unbinned maximum-likelihood estimators for low-count data: Applications to faint X-ray spectra in the Taurus Molecular Cloud
- Identification of activity peaks in time-tagged data with a scan-statistics driven clustering method and its application to gamma-ray data samples
- The long-period massive binary HD~54662 revisited
- The Hubble Catalog of Variables (HCV)
- Near-Infrared and X-Ray Observations of XSS J12270-4859
- Investigating time variability of X-ray absorption in Swift GRBs
- Statistical Models for Solar Flare Interval Distribution in Individual Active Regions
- Constraining the cosmic-ray pressure in the inner Virgo Cluster using H.E.S.S. observations of M 87
- Thermal components in the early X-ray afterglows of GRBs: likely cocoon emission and constraints on the progenitors
- On the Origin of the High Star-Formation Efficiency in Massive Galaxies at Cosmic Dawn
- Non-Stationary Fast-Driven Self-Organized Criticality in Solar Flares
- A QPO in Mkn 421 from Archival RXTE Data
- Bayesian Blocks: Divide and Conquer, MCMC, and Cell Coalescence Approaches
- Burst and Outburst Characteristics of Magnetar 4U 0142+61
- Bayesian Blocks in Two or More Dimensions: Image Segmentation and Cluster Analysis
- Attributes of GRB Pulses: Bayesian Blocks Analysis of TTE Data; a Microburst in GRB 920229
- Discovery and Characterization of a Rare Magnetic Hybrid Cephei Slowly Pulsating B-type Star in an Eclipsing Binary in the Young Open Cluster NGC 6193
- A comprehensive view of blackbody components in the X-ray spectra of GRBs
- Calibration of the IceCube Neutrino Observatory
- RHESSI Tests of Quasi-Thermal Gamma-Ray Burst Spectral Models
- The Spectra of IceCube Neutrino (SIN) candidate sources -- IV. Spectral energy distributions and multi-wavelength variability
- On the use of variability time-scales as an early classifier of radio transients and variables
- Time-dependent Stochastic Modeling of Solar Active Region Energy
- Quantitative comparisons of VHE gamma-ray blazar flares with relativistic reconnection models
- A Comprehensive Analysis of Insight-HXMT Gamma-Ray Burst Data. I. Power Density Spectrum
- Time domain methods for X-ray and gamma-ray astronomy
- INTEGRAL/SPI data segmentation to retrieve source intensity variations
- Automatic detection of long-duration transients in Fermi-GBM data
- The STATiX pipeline for the detection of X-ray transients in three dimensions
- Einstein@Home Searches for Gamma-ray Pulsars in the Inner Galaxy
- Detection of gamma-ray transients with wild binary segmentation
- Outer disc edge: properties of low frequency aperiodic variability in ultracompact interacting binaries
- The short bursts in SGR 1806-20, 1E 1048-5937 and SGR 0501+4516
- AGN obscuration in optical and X-rays: Host properties and the interplay of nuclear and galactic gas and dust in a combined SDSS-XMM sample
- Gamma-ray Pulsar Emission is Mostly Stable on Timescales from Minutes to Years
- Peak energy--Isotropic Luminosity Correlation and Jet Opening Angle Evolution in Swift-BAT Short GRBs with Soft Tail Emission
- Using Bayesian Blocks to Partition Self-Organizing Maps
- Statistics in astronomy
- Sub-MeV spectroscopy with AstroSat-CZT Imager for Gamma Ray Bursts
- A Bayesian Lower Bound for Parameter Estimation of Poisson Data Including Multiple Changes (extended)
- On the future of astrostatistics: statistical foundations and statistical practice
- Nonparametric Bayesian Classification
- V515 And: An Intermediate Polar in the Period Gap Exhibiting Outbursts
- iid2022: A Workshop on Statistical Methods for Event Data in Astronomy
- Time Evolution of Optical Darkness in GRB Afterglow: The Case of GRB 240825A