activity
20242026
most citedOlympicArena Medal Ranks: Who Is the Most Intelligent AI So Far?

8 citations · 20 across the 15 of their papers we have counts for

collaborators
Showing 2024Show all

7 papers · 1 filter

cs.AI2024★ 1 cited

PC Agent: While You Sleep, AI Works -- A Cognitive Journey into Digital World

Yanheng He, Jiahe Jin, Shijie Xia +5

Imagine a world where AI can handle your work while you sleep - organizing your research materials, drafting a report, or creating a presentation you need for tomorrow. However, wh…

cs.CL2024★ 1 cited

O1 Replication Journey -- Part 2: Surpassing O1-preview through Simple Distillation, Big Progress or Bitter Lesson?

Zhen Huang, Haoyang Zou, Xuefeng Li +7

This paper presents a critical examination of current approaches to replicating OpenAI's O1 model capabilities, with particular focus on the widespread but often undisclosed use of…

cs.AI2024★ 3 cited

O1 Replication Journey: A Strategic Progress Report -- Part 1

Yiwei Qin, Xuefeng Li, Haoyang Zou +8

This paper introduces a pioneering approach to artificial intelligence research, embodied in our O1 Replication Journey. In response to the announcement of OpenAI's groundbreaking…

cs.CL2024

SAFETY-J: Evaluating Safety with Critique

Yixiu Liu, Yuxiang Zheng, Shijie Xia +4

The deployment of Large Language Models (LLMs) in content generation raises significant safety concerns, particularly regarding the transparency and interpretability of content eva…

cs.CL2024★ 8 cited

OlympicArena Medal Ranks: Who Is the Most Intelligent AI So Far?

Zhen Huang, Zengzhi Wang, Shijie Xia +1

In this report, we pose the following question: Who is the most intelligent AI model to date, as measured by the OlympicArena (an Olympic-level, multi-discipline, multi-modal bench…

cs.CL2024★ 2 cited

OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI

Zhen Huang, Zengzhi Wang, Shijie Xia +25

The evolution of Artificial Intelligence (AI) has been significantly accelerated by advancements in Large Language Models (LLMs) and Large Multimodal Models (LMMs), gradually showc…

cs.CL2024★ 2 cited

Evaluating Mathematical Reasoning Beyond Accuracy

Shijie Xia, Xuefeng Li, Yixin Liu +2

The leaderboard of Large Language Models (LLMs) in mathematical tasks has been continuously updated. However, the majority of evaluations focus solely on the final results, neglect…