Skip to content

Commit e6a07de

Browse files
authored
Merge pull request #10 from sqlancer/impact
Add an /impact/ section: what SQLancer found, who uses it, who writes…
2 parents 156b782 + d5cb802 commit e6a07de

1,240 files changed

Lines changed: 347918 additions & 110 deletions

File tree

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

.cache/impact/README.md

Lines changed: 23 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,23 @@
1+
# Collector caches
2+
3+
Everything here is an optimisation. The pipeline produces the same records with
4+
this directory empty as with it warm, and a test asserts that.
5+
6+
What is committed is decided by one question: could a fresh checkout get this
7+
back by itself? A fetched page could, so it is not committed. An answer that
8+
cost tokens, a transcript a person had to read out of a browser, and the record
9+
of how far each source has been scanned could not.
10+
11+
| Path | Committed | What it holds |
12+
| --- | --- | --- |
13+
| `state.json` | yes | Last successful scan and last full reconciliation per source. This is what makes weekly runs incremental. |
14+
| `classifications/` | yes | Every classifier answer, including the negative and uncertain ones, keyed so that a change to the evidence, policy, taxonomy, prompt version or model forces a fresh answer and nothing else does. Only the answer and a hash of the evidence are stored, never the evidence itself. |
15+
| `talk-transcripts/` | yes | Windows of caption text around the moments a talk mentions SQLancer. Committed because a person had to obtain them by hand -- YouTube serves caption tracks only to its own player -- so no rerun can recover them. See that directory's README. |
16+
| `derived/` | yes | Deterministic extraction results, keyed by source id + content hash + extractor version. Empty so far: nothing has cost enough to keep. |
17+
| `http/`, `github/`, `papers/`, `artifacts/` | no | Fetched bodies with their ETag / Last-Modified / upstream `updated_at` validators. Large, re-fetchable, and restored from the GitHub Actions cache instead. |
18+
| `papers-pdf/`, `papers-text/` | no | Supplied PDFs and the text extracted from them. Deliberately never committed; only the two Markdown files explaining the directory are. |
19+
20+
Committing the classification cache is what keeps the weekly token cost
21+
proportional to genuinely new evidence: a paper that turned out to only cite
22+
SQLancer, or an issue that turned out to be unrelated, is never asked about
23+
again.

.cache/impact/classifications/.gitkeep

Whitespace-only changes.
Lines changed: 22 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,22 @@
1+
{
2+
"key": "github:sourcenetwork/defradb.rs#157|sha256:0159711df6fd52cd2a699b6c60acd1bc8047472e69973af3824d6a7ef28c924c|bug-attribution-v1|impact-policy-v1|taxonomy-v2|claude-opus-5",
3+
"stored_at": "2026-09-13T03:09:23Z",
4+
"value": {
5+
"classified_at": "2026-09-13T03:09:23Z",
6+
"classifier_version": "bug-attribution-v1",
7+
"model": "claude-opus-5",
8+
"policy_version": "impact-policy-v1",
9+
"result": {
10+
"answer": "no",
11+
"excerpts": [],
12+
"extra": {
13+
"finder": null,
14+
"technique": null
15+
},
16+
"reason": "Names SQLancer, but as work to be done rather than as the source of a defect: adoption, CI plumbing, a feature SQLancer needs, a release checklist or a roadmap. Decided by reading the issue in this session rather than by an API call; the excerpt was checked to be literally present in the text the classifier would have been given."
17+
},
18+
"source_hash": "sha256:0159711df6fd52cd2a699b6c60acd1bc8047472e69973af3824d6a7ef28c924c",
19+
"source_id": "github:sourcenetwork/defradb.rs#157",
20+
"taxonomy_version": "taxonomy-v2"
21+
}
22+
}
Lines changed: 22 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,22 @@
1+
{
2+
"key": "github:apache/datafusion#14535|sha256:9fceee6658a445ab1f52c3c607ce61416d06f32872dd4d16b38e5da1f3896984|bug-attribution-v1|impact-policy-v1|taxonomy-v2|claude-opus-5",
3+
"stored_at": "2026-09-13T03:09:23Z",
4+
"value": {
5+
"classified_at": "2026-09-13T03:09:23Z",
6+
"classifier_version": "bug-attribution-v1",
7+
"model": "claude-opus-5",
8+
"policy_version": "impact-policy-v1",
9+
"result": {
10+
"answer": "no",
11+
"excerpts": [],
12+
"extra": {
13+
"finder": null,
14+
"technique": null
15+
},
16+
"reason": "Names SQLancer, but as work to be done rather than as the source of a defect: adoption, CI plumbing, a feature SQLancer needs, a release checklist or a roadmap. Decided by reading the issue in this session rather than by an API call; the excerpt was checked to be literally present in the text the classifier would have been given."
17+
},
18+
"source_hash": "sha256:9fceee6658a445ab1f52c3c607ce61416d06f32872dd4d16b38e5da1f3896984",
19+
"source_id": "github:apache/datafusion#14535",
20+
"taxonomy_version": "taxonomy-v2"
21+
}
22+
}
Lines changed: 22 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,22 @@
1+
{
2+
"key": "github:cockroachdb/cockroach#171420|sha256:a3c4e88181f416bcfcc47103f659f614cea733da51110147d481b561a1de04f0|bug-attribution-v1|impact-policy-v1|taxonomy-v2|claude-opus-5",
3+
"stored_at": "2026-09-13T03:09:23Z",
4+
"value": {
5+
"classified_at": "2026-09-13T03:09:23Z",
6+
"classifier_version": "bug-attribution-v1",
7+
"model": "claude-opus-5",
8+
"policy_version": "impact-policy-v1",
9+
"result": {
10+
"answer": "no",
11+
"excerpts": [],
12+
"extra": {
13+
"finder": null,
14+
"technique": null
15+
},
16+
"reason": "\"cert\" here is a TLS certificate -- --ca-cert, cert-password, a cert file or a certificate warning -- not Cardinality Estimation Restriction Testing. Decided by reading the issue in this session rather than by an API call; the excerpt was checked to be literally present in the text the classifier would have been given."
17+
},
18+
"source_hash": "sha256:a3c4e88181f416bcfcc47103f659f614cea733da51110147d481b561a1de04f0",
19+
"source_id": "github:cockroachdb/cockroach#171420",
20+
"taxonomy_version": "taxonomy-v2"
21+
}
22+
}
Lines changed: 24 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,24 @@
1+
{
2+
"key": "github:yugabyte/yugabyte-db#10236|sha256:d009f54b290299815ca53cce87b5723188d8f2c320cae0c72c694d475c419ecf|bug-attribution-v1|impact-policy-v1|taxonomy-v2|claude-opus-5",
3+
"stored_at": "2026-09-13T03:09:23Z",
4+
"value": {
5+
"classified_at": "2026-09-13T03:09:23Z",
6+
"classifier_version": "bug-attribution-v1",
7+
"model": "claude-opus-5",
8+
"policy_version": "impact-policy-v1",
9+
"result": {
10+
"answer": "yes",
11+
"excerpts": [
12+
"SQLancer: IOException occurs on UDPATE statement"
13+
],
14+
"extra": {
15+
"finder": "sqlancer",
16+
"technique": null
17+
},
18+
"reason": "The report attributes the find to SQLancer. Decided by reading the issue in this session rather than by an API call; the excerpt was checked to be literally present in the text the classifier would have been given."
19+
},
20+
"source_hash": "sha256:d009f54b290299815ca53cce87b5723188d8f2c320cae0c72c694d475c419ecf",
21+
"source_id": "github:yugabyte/yugabyte-db#10236",
22+
"taxonomy_version": "taxonomy-v2"
23+
}
24+
}
Lines changed: 22 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,22 @@
1+
{
2+
"key": "github:databendlabs/databend#9448|sha256:7dcd4cd0e809656806ecd0d617ff11284dd2f7b0cc9704140858aafaf661f416|bug-attribution-v1|impact-policy-v1|taxonomy-v2|claude-opus-5",
3+
"stored_at": "2026-09-13T03:09:23Z",
4+
"value": {
5+
"classified_at": "2026-09-13T03:09:23Z",
6+
"classifier_version": "bug-attribution-v1",
7+
"model": "claude-opus-5",
8+
"policy_version": "impact-policy-v1",
9+
"result": {
10+
"answer": "no",
11+
"excerpts": [],
12+
"extra": {
13+
"finder": null,
14+
"technique": null
15+
},
16+
"reason": "Names SQLancer, but as work to be done rather than as the source of a defect: adoption, CI plumbing, a feature SQLancer needs, a release checklist or a roadmap. Decided by reading the issue in this session rather than by an API call; the excerpt was checked to be literally present in the text the classifier would have been given."
17+
},
18+
"source_hash": "sha256:7dcd4cd0e809656806ecd0d617ff11284dd2f7b0cc9704140858aafaf661f416",
19+
"source_id": "github:databendlabs/databend#9448",
20+
"taxonomy_version": "taxonomy-v2"
21+
}
22+
}
Lines changed: 22 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,22 @@
1+
{
2+
"key": "github:cockroachdb/cockroach#10517|sha256:9e8fa41de7c8985480545d2866fc42c35d16c68a9008682756189cd329c45ef2|bug-attribution-v1|impact-policy-v1|taxonomy-v2|claude-opus-5",
3+
"stored_at": "2026-09-13T03:09:23Z",
4+
"value": {
5+
"classified_at": "2026-09-13T03:09:23Z",
6+
"classifier_version": "bug-attribution-v1",
7+
"model": "claude-opus-5",
8+
"policy_version": "impact-policy-v1",
9+
"result": {
10+
"answer": "no",
11+
"excerpts": [],
12+
"extra": {
13+
"finder": null,
14+
"technique": null
15+
},
16+
"reason": "\"cert\" here is a TLS certificate -- --ca-cert, cert-password, a cert file or a certificate warning -- not Cardinality Estimation Restriction Testing. Decided by reading the issue in this session rather than by an API call; the excerpt was checked to be literally present in the text the classifier would have been given."
17+
},
18+
"source_hash": "sha256:9e8fa41de7c8985480545d2866fc42c35d16c68a9008682756189cd329c45ef2",
19+
"source_id": "github:cockroachdb/cockroach#10517",
20+
"taxonomy_version": "taxonomy-v2"
21+
}
22+
}
Lines changed: 22 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,22 @@
1+
{
2+
"key": "github:cockroachdb/cockroach#84484|sha256:137209a7e0f3d138ec5dd07b57203cc45d4c97a57dd67f856d396f16cd8daacf|bug-attribution-v1|impact-policy-v1|taxonomy-v2|claude-opus-5",
3+
"stored_at": "2026-09-13T03:09:23Z",
4+
"value": {
5+
"classified_at": "2026-09-13T03:09:23Z",
6+
"classifier_version": "bug-attribution-v1",
7+
"model": "claude-opus-5",
8+
"policy_version": "impact-policy-v1",
9+
"result": {
10+
"answer": "no",
11+
"excerpts": [],
12+
"extra": {
13+
"finder": null,
14+
"technique": null
15+
},
16+
"reason": "The TLP roachtest failed for a reason that is not a finding: an expired licence, a cluster that would not start, a library that would not load, a timeout, or no stated cause at all. Decided by reading the issue in this session rather than by an API call; the excerpt was checked to be literally present in the text the classifier would have been given."
17+
},
18+
"source_hash": "sha256:137209a7e0f3d138ec5dd07b57203cc45d4c97a57dd67f856d396f16cd8daacf",
19+
"source_id": "github:cockroachdb/cockroach#84484",
20+
"taxonomy_version": "taxonomy-v2"
21+
}
22+
}
Lines changed: 22 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,22 @@
1+
{
2+
"key": "github:cockroachdb/cockroach#144923|sha256:e736395c073f9f044c9d08687afc01f28a64ead7fa9871a03d3b34f4539e8bc3|bug-attribution-v1|impact-policy-v1|taxonomy-v2|claude-opus-5",
3+
"stored_at": "2026-09-13T03:09:23Z",
4+
"value": {
5+
"classified_at": "2026-09-13T03:09:23Z",
6+
"classifier_version": "bug-attribution-v1",
7+
"model": "claude-opus-5",
8+
"policy_version": "impact-policy-v1",
9+
"result": {
10+
"answer": "no",
11+
"excerpts": [],
12+
"extra": {
13+
"finder": null,
14+
"technique": null
15+
},
16+
"reason": "The TLP roachtest failed for a reason that is not a finding: an expired licence, a cluster that would not start, a library that would not load, a timeout, or no stated cause at all. Decided by reading the issue in this session rather than by an API call; the excerpt was checked to be literally present in the text the classifier would have been given."
17+
},
18+
"source_hash": "sha256:e736395c073f9f044c9d08687afc01f28a64ead7fa9871a03d3b34f4539e8bc3",
19+
"source_id": "github:cockroachdb/cockroach#144923",
20+
"taxonomy_version": "taxonomy-v2"
21+
}
22+
}

0 commit comments

Comments
 (0)