Skip to content
TopicTracker
来自 HackerNews查看原文
译文语言译文语言

无限对比基准:比较多个Claude.md文件

该项目提供了一种基准测试工具,可以对任意数量的Claude.md文件进行相互比较和评估,帮助用户分析和对比不同配置或版本的性能表现。

背景速读

- GitHub 上的一个名为 Clawmark 的开源工具,专门用来「对打」Claude 生成的 Markdown 文件(.md)。其核心场景是:用户让 Claude 针对同一个问题生成多个不同答案,然后用 Clawmark 让这些答案相互评判、打分,选出最优解。 - 这种做法源于 LLM 评测中的「AI 互相打分」思路——让一个模型(或同一模型的不同输出)充当裁判,评估其它输出的质量,避免人工逐一阅读大量长文本。 - Claude 是 Anthropic 公司的大型语言模型,擅长长文和结构化输出。Markdown(.md)是它最常用的输出格式之一。 - 这个工具的意义在于,它提供了一种轻量级、自动化的方式来筛选和比较 Claude 的多个回复,适合需要反复迭代提示词(prompt engineering)或需要从大量候选答案中挑出最佳版本的开发者与研究者。

相关报道

  • Newer Claude models sometimes invent extra keys in tool call arguments, breaking validation in Pi's edit tool. The author suspects post-training for Claude Code's forgiving harness makes alternative schemas fail. This suggests closed RL training can degrade general tool-use reliability.

  • Simon Willison released llm-coding-agent 0.1a0, an experimental coding agent built on his LLM library. The agent provides tools for reading, editing, searching files and executing commands, and ships with a Python API and CLI. It was developed using Claude Code (Fable 5) via TDD with a spec-first approach, and is available as a slop-alpha on PyPI.

  • Truth Social remains an outlet primarily for Trump's own posts, while other administration officials continue using X. The platform functions as a blog-like channel for Trump's messages rather than a genuine social network competitor.