419 citations · 682 across the 54 of their papers we have counts for
6 papers · 1 filter
AGIBench: A Multi-granularity, Multimodal, Human-referenced, Auto-scoring Benchmark for Large Language Models
Fei Tang, Wanling Gao, Luzhou Peng +1
Large language models (LLMs) like ChatGPT have revealed amazing intelligence. How to evaluate the question-solving abilities of LLMs and their degrees of intelligence is a hot-spot…
Does AI for science need another ImageNet Or totally different benchmarks? A case study of machine learning force fields
Yatao Li, Wanling Gao, Lei Wang +3
AI for science (AI4S) is an emerging research field that aims to enhance the accuracy and speed of scientific computing tasks using machine learning methods. Traditional AI benchma…
IterLara: A Turing Complete Algebra for Big Data, AI, Scientific Computing, and Database
Hongxiao Li, Wanling Gao, Lei Wang +1
\textsc{Lara} is a key-value algebra that aims at unifying linear and relational algebra with three types of operation abstraction. The study of \textsc{Lara}'s expressive ability…
WPC: Whole-picture Workload Characterization
Lei Wang, Kaiyong Yang, Chenxi Wang +7
This article raises an important and challenging workload characterization issue: can we uncover each critical component across the stacks contributing what percentages to any spec…
DCNetBench: Scaleable Data Center Network Benchmarking
Ke Liu, Wanling Gao, Chunjie Luo +7
Data center networking is the central infrastructure of the modern information society. However, benchmarking them is very challenging as the real-world network traffic is difficul…
CMLCompiler: A Unified Compiler for Classical Machine Learning
Xu Wen, Wanling Gao, Anzheng Li +3
Classical machine learning (CML) occupies nearly half of machine learning pipelines in production applications. Unfortunately, it fails to utilize the state-of-the-practice devices…