$ python report.py
Task: follow two links in an eight-node permutation
20,264 parameters | CPU | 1,200 updates x 128 examples
4,096 distinct evaluation inputs, excluded from training
Each run: 4,800 training block iterations

                 Accuracy at inference loop
training seed       2       4       8      16      24
fixed      11   97.39  100.00   99.98   97.97   92.41
fixed      22   96.78  100.00  100.00   98.85   95.24
fixed      33   95.63  100.00   99.98   95.95   87.82
mixed      11  100.00  100.00  100.00  100.00  100.00
mixed      22  100.00  100.00  100.00   99.95   99.83
mixed      33  100.00  100.00  100.00  100.00  100.00

Seed 11 / fixed-four / evaluation item 21
node:    0 1 2 3 4 5 6 7
points:  1 7 0 4 2 5 3 6
start=3   path=3 -> 4 -> 2   expected=2
loops   answer   softmax of chosen answer
    2        2                   0.5975
    4        2                   0.9976
    8        2                   0.9973
   16        2                   0.8091
   24        5                   0.9322

PASS: labels, unique test inputs, split, counts and checkpoint replay
