Hyperspectral Pixel Unmixing with Latent Dirichlet Variational Autoencoder
arXiv:2203.01327 · doi:10.1016/j.physletb.2022.137258
Abstract
We present a method for hyperspectral pixel {\it unmixing}. The proposed method assumes that (1) {\it abundances} can be encoded as Dirichlet distributions and (2) spectra of {\it endmembers} can be represented as multivariate Normal distributions. The method solves the problem of abundance estimation and endmember extraction within a variational autoencoder setting where a Dirichlet bottleneck layer models the abundances, and the decoder performs endmember extraction. The proposed method can also leverage transfer learning paradigm, where the model is only trained on synthetic data containing pixels that are linear combinations of one or more endmembers of interest. In this case, we retrieve endmembers (spectra) from the United States Geological Survey Spectral Library. The model thus trained can be subsequently used to perform pixel unmixing on "real data" that contains a subset of the endmembers used to generated the synthetic data. The model achieves state-of-the-art results on several benchmarks: Cuprite, Urban Hydice and Samson. We also present new synthetic dataset, OnTech-HSI-Syn-21, that can be used to study hyperspectral pixel unmixing methods. We showcase the transfer learning capabilities of the proposed model on Cuprite and OnTech-HSI-Syn-21 datasets. In summary, the proposed method can be applied for pixel unmixing a variety of domains, including agriculture, forestry, mineralogy, analysis of materials, healthcare, etc. Additionally, the proposed method eschews the need for labelled data for training by leveraging the transfer learning paradigm, where the model is trained on synthetic data generated using the endmembers present in the "real" data.
References in corpus (32)
- Observation of Gravitational Waves from a Binary Black Hole Merger
- GW170817: Observation of Gravitational Waves from a Binary Neutron Star Inspiral
- GW151226: Observation of Gravitational Waves from a 22-Solar-Mass Binary Black Hole Coalescence
- GW170104: Observation of a 50-Solar-Mass Binary Black Hole Coalescence at Redshift 0.2
- GW170814: A Three-Detector Observation of Gravitational Waves from a Binary Black Hole Coalescence
- Effective one-body approach to general relativistic two-body dynamics
- An Effective Field Theory of Gravity for Extended Objects
- Scattering Amplitudes and the Conservative Hamiltonian for Binary Systems at Third Post-Minkowskian Order
- From Scattering Amplitudes to Classical Potentials in the Post-Minkowskian Expansion
- High-energy gravitational scattering and the general relativistic two-body problem
- General Relativity from Scattering Amplitudes
- Conservative Dynamics of Binary Systems to Third Post-Minkowskian Order from the Effective Field Theory Approach
- Radiation and the classical double copy for color charges
- Scattering of two spinning black holes in post-Minkowskian gravity, to all orders in spin, and effective-one-body mappings
- Spinning Black Hole Binary Dynamics, Scattering Amplitudes and Effective Field Theory
- Black-hole scattering with general spin directions from minimal-coupling amplitudes
- Low-Energy Behavior of Gluons and Gravitons from Gauge Invariance
- Radiative contribution to classical gravitational scattering at the third order in
- From Boundary Data to Bound States II: Scattering Angle to Dynamical Invariants (with Twist)
- Universality of ultra-relativistic gravitational scattering
- Spinning-black-hole scattering and the test-black-hole limit at second post-Minkowskian order
- Radiation Reaction from Soft Theorems
- Gravitational Bremsstrahlung and Hidden Supersymmetry of Spinning Bodies
- Gravitational radiation reaction along general orbits in the effective one-body formalism
- Classical Gravity from Loop Amplitudes
- Radiative contributions to gravitational scattering
- From amplitudes to gravitational radiation with cubic interactions and tidal effects
- Gravitational spin-orbit coupling in binary systems at the second post-Minkowskian approximation
- Gravitational spin-orbit coupling in binary systems, post-Minkowskian approximation and effective one-body theory
- Classical Yang-Mills observables from amplitudes
- Infrared Divergences and the Eikonal Exponentiation
- Exponentiation of the leading eikonal with spin
Cited by in corpus (11)
- Classical gravitational spinning-spinless scattering at
- Conservative Binary Dynamics with a Spinning Black Hole at from Scattering Amplitudes
- Linear Response, Hamiltonian and Radiative Spinning Two-Body Dynamics
- Angular momentum of zero-frequency gravitons
- Scattering Angles in Kerr Metrics
- Classical Limit of Higher-Spin String Amplitudes
- Gravitational Faraday effect from on-shell amplitudes
- Angular Momentum Loss Due to Tidal Effects in the Post-Minkowskian Expansion
- Radiation-reaction and angular momentum loss at the second Post-Minkowskian order
- Scattering Amplitudes and N-Body Post-Minkowskian Hamiltonians in General Relativity and Beyond
- Scrambling and Entangling Spinning Particles