m05-llm-initial
models_v4/grid_tracer_v2_final.pt · commit 0a18d6c2 · 2026-04-13 23:08:29
Intersection F1
0.802
-0.011 vs prev
Fiducial F1
0.872
+0.020 vs prev
Label accuracy
1.000
Leader accuracy
0.910
+0.008 vs prev
Trace IoU
0.861
-0.001 vs prev
End-to-end F1
0.705
+0.022 vs prev
Seconds / PDF
34.7s
+2.532 vs prev
Per-pdf breakdown
Sorted worst-first by End-to-end F1
| Intersection F1 | Fiducial F1 | Label | Leader | Trace IoU | e2e F1 | Seconds / PDF | |
|---|---|---|---|---|---|---|---|
| wpd-p1 | 0.573 | 0.563 | 1.000 | 0.974 | 0.795 | 0.415 | 55.5s |
| newman-p3 | 0.871 | 0.655 | 1.000 | 1.000 | 0.861 | 0.504 | 56.7s |
| milford-p2 | 0.948 | 0.857 | 1.000 | 0.800 | 0.812 | 0.586 | 52.8s |
| stloius-p2 | 0.621 | 1.000 | 1.000 | 0.600 | 0.619 | 0.600 | 6.7s |
| outback_page_007 | 0.832 | 0.600 | 1.000 | 1.000 | 0.996 | 0.600 | 53.3s |
| science-build-p2 | 0.814 | 0.816 | 1.000 | 0.935 | 0.807 | 0.605 | 20.6s |
| milford-p1 | 0.200 | 0.958 | 1.000 | 0.857 | 0.748 | 0.622 | 13.5s |
| science-build-p1 | 0.805 | 0.809 | 1.000 | 1.000 | 0.846 | 0.643 | 33.7s |
| merck-p1 | 0.957 | 0.840 | 1.000 | 1.000 | 0.917 | 0.680 | 23.5s |
| yampa-p1 | 0.846 | 0.981 | 1.000 | 0.596 | 0.784 | 0.698 | 51.0s |
| yampa-p2 | 0.875 | 0.852 | 1.000 | 0.913 | 0.883 | 0.704 | 26.1s |
| stloius-p1 | 0.483 | 0.824 | 1.000 | 0.857 | 0.862 | 0.706 | 7.9s |
| lodge-p1 | 0.831 | 0.942 | 1.000 | 0.931 | 0.884 | 0.774 | 104.3s |
| siu-p1 | 0.924 | 1.000 | 1.000 | 0.985 | 0.908 | 0.821 | 24.4s |
| newman-p1 | 0.960 | 1.000 | 1.000 | 0.927 | 0.915 | 0.881 | 31.0s |
| merck-p2 | 0.994 | 1.000 | 1.000 | 1.000 | 0.916 | 0.923 | 13.3s |
| newman-p2 | 0.995 | 1.000 | 1.000 | 1.000 | 0.982 | 0.964 | 24.1s |
| villanova_p1 | 0.911 | 1.000 | 1.000 | 1.000 | 0.958 | 0.968 | 25.8s |