Fig. 1 The held-out record
319 chronological fix rowsLines join measured checkpoints, including the dip. Between checkpoints, the score stays at the last measurement. Function Acc@10 ends at 48.28%. Baselines are single-point references.
FIG. 3 Checkpoint register / File Acc@1, not a mutation log.
03206419611281
Read the checkpoint data
| Fixes learned | RepoCortex | Dense | Frozen | BM25 |
|---|---|---|---|---|
| 0 | 41.07% | 35.74% | 41.07% | 34.48% |
| 92 | 41.69% | 35.74% | 41.07% | 34.48% |
| 183 | 41.69% | 35.74% | 41.07% | 34.48% |
| 274 | 41.69% | 35.74% | 41.07% | 34.48% |
| 366 | 41.38% | 35.74% | 41.07% | 34.48% |
| 458 | 41.69% | 35.74% | 41.07% | 34.48% |
| 549 | 42.01% | 35.74% | 41.07% | 34.48% |
| 640 | 42.32% | 35.74% | 41.07% | 34.48% |
| 732 | 42.32% | 35.74% | 41.07% | 34.48% |
| 824 | 42.32% | 35.74% | 41.07% | 34.48% |
| 915 | 42.63% | 35.74% | 41.07% | 34.48% |
| 1006 | 42.63% | 35.74% | 41.07% | 34.48% |
| 1098 | 44.2% | 35.74% | 41.07% | 34.48% |
| 1190 | 45.14% | 35.74% | 41.07% | 34.48% |
| 1281 | 44.51% | 35.74% | 41.07% | 34.48% |
The frozen reference is this pass's step 0 graph, with learning off. Playback starts paused, including with reduced motion.