Mathematics of Digital Hyperspace
arXiv:2103.15203 · doi:10.1109/IPDPSW52791.2021.00048
Abstract
Social media, e-commerce, streaming video, e-mail, cloud documents, web pages, traffic flows, and network packets fill vast digital lakes, rivers, and oceans that we each navigate daily. This digital hyperspace is an amorphous flow of data supported by continuous streams that stretch standard concepts of type and dimension. The unstructured data of digital hyperspace can be elegantly represented, traversed, and transformed via the mathematics of hypergraphs, hypersparse matrices, and associative array algebra. This paper explores a novel mathematical concept, the semilink, that combines pairs of semirings to provide the essential operations for graph analytics, database operations, and machine learning. The GraphBLAS standard currently supports hypergraphs, hypersparse matrices, the mathematics required for semilinks, and seamlessly performs graph, network, and matrix operations. With the addition of key based indices (such as pointers to strings) and semilinks, GraphBLAS can become a richer associative array algebra and be a plug-in replacement for spreadsheets, database tables, and data centric operating systems, enhancing the navigation of unstructured data found in digital hyperspace.
arXiv comment9 pages, 8 figures, 2 tables, accepted to GrAPL 2021. arXiv admin note: text overlap with arXiv:1807.03165, arXiv:2004.01181, arXiv:1909.05631, arXiv:1708.02937
References in corpus (20)
- Random hypergraphs and their applications
- On data lake architectures and metadata management
- Mathematical Foundations of the GraphBLAS
- D4M 2.0 Schema: A General Purpose High Performance Schema for the Accumulo Database
- Graphulo: Linear Algebra Graph Kernels for NoSQL Databases
- Enabling Massive Deep Neural Networks with the GraphBLAS
- Graphulo Implementation of Server-Side Sparse Matrix Multiply in the Accumulo Database
- Achieving 100,000,000 database inserts per second using Accumulo and D4M
- D4M: Bringing Associative Arrays to Database Engines
- Associative Array Model of SQL, NoSQL, and NewSQL Databases
- RedisGraph GraphBLAS Enabled Graph Database
- Polystore Mathematics of Relational Algebra
- Novel Graph Processor Architecture, Prototype System, and Results
- Julia Implementation of the Dynamic Distributed Dimensional Data Model
- 75,000,000,000 Streaming Inserts/Second Using Hierarchical Hypersparse GraphBLAS Matrices
- Benchmarking SciDB Data Import on HPC Systems
- Lustre, Hadoop, Accumulo
- TabulaROSA: Tabular Operating System Architecture for Massively Parallel Heterogeneous Compute Engines
- Database Operations in D4M.jl
- D4M 3.0: Extended Database and Language Capabilities