📄 中文摘要
Arena AI(前身为 LMSYS 聊天机器人竞技场)是 AI 模型排名的黄金标准,但没有公开 API 和历史数据。为了解决这一问题,开发者创建了一个名为 arena-ai-leaderboards 的 GitHub 仓库,能够每日自动获取所有 10 个 Arena AI 排行榜,并将其转换为结构化 JSON 格式。该项目利用 GitHub Actions 工作流,自动发现 arena.ai 上的所有排行榜类别,获取完整的模型排名,解析为结构化 JSON,验证数据格式,并提交到指定的日期目录中。此系统无需硬编码类别列表,Arena AI 添加新排行榜时,系统会自动更新。该项目涵盖 10 个类别,超过 300 个模型。
📄 English Summary
I Built an Auto-Updating Archive of Every AI Arena Leaderboard
Arena AI, formerly known as LMSYS Chatbot Arena, is the gold standard for AI model rankings but lacks a public API and historical data. To address this, a GitHub repository named arena-ai-leaderboards was created to automatically fetch all 10 Arena AI leaderboards daily and convert them into structured JSON format. A GitHub Actions workflow runs daily, auto-discovering all leaderboard categories from arena.ai, fetching full model rankings, parsing them into structured JSON, validating against a schema, and committing to a date-specific directory. The system does not require a hardcoded category list; when Arena AI adds a new leaderboard, it is automatically picked up. The project covers 10 categories and over 300 models.
Powered by Cloudflare Workers + Payload CMS + Claude 3.5
数据源: OpenAI, Google AI, DeepMind, AWS ML Blog, HuggingFace 等