Grid Detection — Evaluation milestones
13 milestones · 18 PDFs · linear evolution over time
Intersection F1
0.821
+0.118
Fiducial F1
0.918
+0.067
Label accuracy
1.000
Leader accuracy
0.901
+0.592
Trace IoU
0.869
+0.161
End-to-end F1
0.759
+0.272
Seconds / PDF
13.8s
-14.8s
Metric comparison (normalized)
Each metric scaled to [0,1] so you can see correlation and co-movement
Intersection F1
Fiducial F1
Label accuracy
Leader accuracy
Trace IoU
End-to-end F1
Seconds / PDF
Timing heatmap
Seconds per sample × milestone. Red = above 30s budget.
| sample | m01-v2-weights | m02-v3-weights | m03-v4-weights | m04-classifier | m05-llm-initial | m06-grid-bbox | m07-full-detector | m08-spatial-index | m09-current-logic | m10-v5-weights | m11-latest-pipeline | auto-fbce4876 | auto-b62c0378 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| lodge-p1 | |||||||||||||
| merck-p1 | |||||||||||||
| merck-p2 | |||||||||||||
| milford-p1 | |||||||||||||
| milford-p2 | |||||||||||||
| newman-p1 | |||||||||||||
| newman-p2 | |||||||||||||
| newman-p3 | |||||||||||||
| outback_page_007 | |||||||||||||
| science-build-p1 | |||||||||||||
| science-build-p2 | |||||||||||||
| siu-p1 | |||||||||||||
| stloius-p1 | |||||||||||||
| stloius-p2 | |||||||||||||
| villanova_p1 | |||||||||||||
| wpd-p1 | |||||||||||||
| yampa-p1 | |||||||||||||
| yampa-p2 |
| Milestone | Description | Intersection F1 | Fiducial F1 | Label accuracy | Leader accuracy | Trace IoU | End-to-end F1 | Seconds / PDF | PDFs | When |
|---|---|---|---|---|---|---|---|---|---|---|
| m01-v2-weights | v2 weights | 0.703 | 0.852 | 1.000 | 0.309 | 0.708 | 0.487 | 28.6s | 18 | 2026-04-13 22:26 |
| m02-v3-weights | v3 weights | 0.669-0.033 | 0.852 | 1.000 | 0.332+0.023 | 0.740+0.031 | 0.536+0.049 | 30.2s+1.6s | 18 | 2026-04-13 22:36 |
| m03-v4-weights | v4 weights | 0.745+0.076 | 0.852 | 1.000 | 0.426+0.094 | 0.833+0.094 | 0.652+0.116 | 36.8s+6.6s | 18 | 2026-04-13 22:47 |
| m04-classifier | classifier | 0.814+0.068 | 0.852 | 1.000 | 0.902+0.476 | 0.862+0.028 | 0.684+0.031 | 32.2s-4.6s | 18 | 2026-04-13 22:57 |
| m05-llm-initial | llm initial | 0.802-0.011 | 0.872+0.020 | 1.000 | 0.910+0.008 | 0.861-0.001 | 0.705+0.022 | 34.7s+2.5s | 18 | 2026-04-13 23:08 |
| m06-grid-bbox | grid bbox | 0.803 | 0.866-0.006 | 1.000 | 0.920+0.010 | 0.871+0.010 | 0.711+0.005 | 34.1s-0.6s | 18 | 2026-04-13 23:19 |
| m07-full-detector | full detector | 0.812+0.010 | 0.889+0.023 | 1.000 | 0.903-0.017 | 0.856-0.016 | 0.712+0.002 | 32.9s-1.2s | 18 | 2026-04-13 23:29 |
| m08-spatial-index | spatial index | 0.742-0.070 | 0.868-0.021 | 1.000 | 0.921+0.019 | 0.875+0.019 | 0.712 | 21.8s-11.1s | 18 | 2026-04-13 23:36 |
| m09-current-logic | current logic | 0.786+0.043 | 0.875+0.007 | 1.000 | 0.916-0.005 | 0.875 | 0.718+0.006 | 22.5s+0.7s | 18 | 2026-04-13 23:43 |
| m10-v5-weights | v5 weights | 0.768-0.017 | 0.868-0.006 | 1.000 | 0.921+0.005 | 0.879+0.004 | 0.730+0.013 | 22.9s+0.4s | 18 | 2026-04-13 23:51 |
| m11-latest-pipeline | latest pipeline | 0.776+0.008 | 0.883+0.015 | 1.000 | 0.919-0.003 | 0.873-0.006 | 0.741+0.011 | 23.3s+0.4s | 18 | 2026-04-14 01:28 |
| auto-fbce4876🤖 auto | auto fbce4876 | 0.796+0.020 | 0.881-0.002 | 1.000 | 0.909-0.010 | 0.867-0.006 | 0.728-0.013 | 14.2s-9.2s | 18 | 2026-04-14 09:06 |
| auto-b62c0378🤖 auto | auto b62c0378 | 0.821+0.025 | 0.918+0.037 | 1.000 | 0.901-0.008 | 0.869+0.003 | 0.759+0.032 | 13.8s-0.4s | 18 | 2026-04-20 05:24 |
Color scale: metric value normalized across all milestones (red = worst, green = best). Delta shown in small text below each value.
First milestone: m01-v2-weights · latest: auto-b62c0378.