Repository navigation
修正共用评分解析与原生答案字段校验 - #2
Merged
Merged
Conversation
added 6 commits
October 19, 2026 12:28
added 5 commits
October 20, 2026 11:03
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
改动说明
修正 HTML、Markdown、表格、列表和资源的共用解析,避免把其他条目或隐藏内容借来满足要求。评分库负责题库、提交答案和实际文件字节的验收;供应商响应与日志的来源核验由 Browser Eval PR51 负责。
图为既有分工示意,具体接口以本文和代码为准。
评分修复
srcsetURL 解析,保留 URL 内逗号。新增成对控制,没有新增单案例或供应商评分分支。职责收口
answer_projection.py,将 Moli 日志、Firecrawl 历史字段及完整原生投影迁到 PR51 的现有来源核验模块。native_response、native_diagnostic、native_files来源入口,不留兼容别名。通用文件入口为score_attempt(delivered_files=list[bytes]),根据实际字节判定。v3 建议的判断
当前提交保持
84c177d97da3b82567d9881e377aa728929cf129,与 PR51 的依赖及锁文件一致。本轮报告复用性修改在 PR51,没有为了增加提交而改变评分结果。aliases=['description']后为空。直接搬入现有 aliases 会改变验收含义;未来应增加独立、明确的角色配置。报告题数、定价文案、专属文章和历史报告实例属于 PR51 与外部报告资产,不在本评分库中维护。
v4 复审结论
v4 没有提出本评分库的新修复项;当前提交仍为
84c177d97da3b82567d9881e377aa728929cf129,PR51 的依赖锁保持一致。新增 N1–N7 涉及报告配置、共用参数、来源链接、维护入口和证据读取,已在 PR51 处理;本 PR 更新说明,不额外改变评分代码。角色配置和显式
answer_format继续延后到完整接口升级,v4 同意这两项延后。metrics.py对native_answer_projection的读取也需随该接口一起迁移,不能只删读取而丢失现有证据信息。这里没有声称这项剩余工作已经完成。验证
make check:1,865 项测试、81 个子测试通过。当前提交的 Python 3.11–3.14 CI 通过。7e1b468e981cfe1da89d443047aff7facd841cd03f00bfc4b016ed67ba292da3。四套冻结题库任务文件未改。历史报告的复核覆盖属于其绑定评分版本;代码测试通过不能替代新的人工复核。