Hyperspectral Pixel Unmixing with Latent Dirichlet Variational Autoencoder

Abstract

We present a method for hyperspectral pixel {\it unmixing}. The proposed method assumes that (1) {\it abundances} can be encoded as Dirichlet distributions and (2) spectra of {\it endmembers} can be represented as multivariate Normal distributions. The method solves the problem of abundance estimation and endmember extraction within a variational autoencoder setting where a Dirichlet bottleneck layer models the abundances, and the decoder performs endmember extraction. The proposed method can also leverage transfer learning paradigm, where the model is only trained on synthetic data containing pixels that are linear combinations of one or more endmembers of interest. In this case, we retrieve endmembers (spectra) from the United States Geological Survey Spectral Library. The model thus trained can be subsequently used to perform pixel unmixing on "real data" that contains a subset of the endmembers used to generated the synthetic data. The model achieves state-of-the-art results on several benchmarks: Cuprite, Urban Hydice and Samson. We also present new synthetic dataset, OnTech-HSI-Syn-21, that can be used to study hyperspectral pixel unmixing methods. We showcase the transfer learning capabilities of the proposed model on Cuprite and OnTech-HSI-Syn-21 datasets. In summary, the proposed method can be applied for pixel unmixing a variety of domains, including agriculture, forestry, mineralogy, analysis of materials, healthcare, etc. Additionally, the proposed method eschews the need for labelled data for training by leveraging the transfer learning paradigm, where the model is trained on synthetic data generated using the endmembers present in the "real" data.

References in corpus (6)

• GW170817: Observation of Gravitational Waves from a Binary Neutron Star Inspiral
• GW170814: A Three-Detector Observation of Gravitational Waves from a Binary Black Hole Coalescence
• Scattering Amplitudes and the Conservative Hamiltonian for Binary Systems at Third Post-Minkowskian Order
• Low-Energy Behavior of Gluons and Gravitons from Gauge Invariance
• From amplitudes to gravitational radiation with cubic interactions and tidal effects
• Gravitational spin-orbit coupling in binary systems, post-Minkowskian approximation and effective one-body theory

Cited by in corpus (11)

• Classical gravitational spinning-spinless scattering at $\mathcal{O}(G^2{S}^{\infty })$
• Conservative Binary Dynamics with a Spinning Black Hole at $\mathcal{O}(G^3)$ from Scattering Amplitudes
• Linear Response, Hamiltonian and Radiative Spinning Two-Body Dynamics
• Angular momentum of zero-frequency gravitons
• Scattering Angles in Kerr Metrics
• Classical Limit of Higher-Spin String Amplitudes
• Gravitational Faraday effect from on-shell amplitudes
• Angular Momentum Loss Due to Tidal Effects in the Post-Minkowskian Expansion
• Radiation-reaction and angular momentum loss at the second Post-Minkowskian order
• Scattering Amplitudes and N-Body Post-Minkowskian Hamiltonians in General Relativity and Beyond
• Scrambling and Entangling Spinning Particles