5 papers
Hyperbolic Multimodal Representation Learning for Biological Taxonomies
ZeMing Gong, Chuanqi Tang, Xiaoliang Huo +6
Taxonomic classification in biodiversity research involves organizing biological specimens into structured hierarchies based on evidence, which can come from multiple modalities su…
ViGiL3D: A Linguistically Diverse Dataset for 3D Visual Grounding
Austin T. Wang, ZeMing Gong, Angel X. Chang
3D visual grounding (3DVG) involves localizing entities in a 3D scene referred to by natural language text. Such models are useful for embodied AI and scene retrieval applications,…
BIOSCAN-5M: A Multimodal Dataset for Insect Biodiversity
Zahra Gharaee, Scott C. Lowe, ZeMing Gong +10
As part of an ongoing worldwide effort to comprehend and monitor insect biodiversity, this paper presents the BIOSCAN-5M Insect dataset to the machine learning community and establ…
CLIBD: Bridging Vision and Genomics for Biodiversity Monitoring at Scale
ZeMing Gong, Austin T. Wang, Xiaoliang Huo +4
Measuring biodiversity is crucial for understanding ecosystem health. While prior works have developed machine learning models for taxonomic classification of photographic images a…
BarcodeBERT: Transformers for Biodiversity Analysis
Pablo Millan Arias, Niousha Sadjadi, Monireh Safari +9
In the global challenge of understanding and characterizing biodiversity, short species-specific genomic sequences known as DNA barcodes play a critical role, enabling fine-grained…