Est. 2026 • Members Welcome

⛳

Gradient Descent Country Club

Members-only scorecards from the Parameter Golf circuit

The Members' Scorecard

The full tournament card, organized by 18-hole rounds first and individual holes second.

Rounds At A Glance

Each round gets its own card, its own read, and its own 18-hole arc.

Round 1 18/18 holes logged

The round drifted 0.0687 BPB from its opening line.

Best hole H1 · 1.2244
Biggest gain H12 · 0.0685
5 free lunches 6 encouraging misses 5 dead ends

Round 1

The round drifted 0.0687 BPB from its opening line.

18 of 18 holes posted Best: H1 at 1.2244 BPB
H1 Par H2 Triple Bogey H3 Triple Bogey H4 Triple Bogey H5 Triple Bogey H6 Triple Bogey H7 Triple Bogey H8 Triple Bogey H9 Triple Bogey H10 Triple Bogey H11 Triple Bogey H12 Bogey H13 Bogey H14 Bogey H15 Bogey H16 Bogey H17 Bogey H18 Bogey
R1 · H1 Par Safe Tweaks Baseline Mar 18

The Practice Round

Steady opening hole. Good enough to map the course, not good enough to lead the clubhouse.

1.2244 BPB
2.0727 Loss
15.82 MB
600s Time
R1 · H2 Triple Bogey Safe Tweaks Baseline Mar 18

First Contact

Necessary calibration hole. Bad score, useful signal.

1.4361 BPB
2.4249 Loss
10.63 MB
600s Time
R1 · H3 Triple Bogey Safe Tweaks Dead End Mar 18

Grip It and Rip It

Clear dead end on this hardware and timescale. Proven idea, wrong course.

2.0574 BPB
3.4738 Loss
7.61 MB
300s Time
MATRIX_LR=0.06WARMDOWN_ITERS=3600MAX_WALLCLOCK_SECONDS=300
R1 · H4 Triple Bogey Safe Tweaks Dead End Mar 18

Leaving It Short

Useful bracket, but not where the strokes are hiding.

1.9464 BPB
3.2865 Loss
7.49 MB
300s Time
MATRIX_LR=0.02MAX_WALLCLOCK_SECONDS=300
R1 · H5 Triple Bogey Safe Tweaks Free Lunch Mar 18

More Swings, Less Club

Picked up 0.0222 BPB from the last hole.

1.4139 BPB
-0.0222 Vs Prev
2.3873 Loss
13.35 MB
300s Time
TRAIN_BATCH_TOKENS=131072MAX_WALLCLOCK_SECONDS=300
R1 · H6 Triple Bogey Safe Tweaks Encouraging Miss Mar 18

The Quant Gap Fix

Basically level with the last hole.

1.4141 BPB
+0.0002 Vs Prev
2.3876 Loss
13.68 MB
300s Time
TRAIN_BATCH_TOKENS=131072FP16_EMBED=trueMAX_WALLCLOCK_SECONDS=300
R1 · H7 Triple Bogey Medium Risk Free Lunch Mar 18

Traveling Light

Basically level with the last hole.

1.4140 BPB
-0.0001 Vs Prev
2.3875 Loss
13.85 MB
300s Time
NUM_KV_HEADS=2TRAIN_BATCH_TOKENS=131072MAX_WALLCLOCK_SECONDS=300
R1 · H8 Triple Bogey Medium Risk Dead End Mar 19

The Skinny Iron

Dropped 0.0130 BPB versus the last hole.

1.4270 BPB
+0.0130 Vs Prev
2.4095 Loss
10.25 MB
300s Time
MLP_MULT=1TRAIN_BATCH_TOKENS=131072MAX_WALLCLOCK_SECONDS=300
R1 · H9 Triple Bogey Medium Risk Dead End Mar 19

The Short Game

Dropped 0.0155 BPB versus the last hole.

1.4425 BPB
+0.0155 Vs Prev
2.4357 Loss
13.53 MB
300s Time
TRAIN_SEQ_LEN=512TRAIN_BATCH_TOKENS=131072MAX_WALLCLOCK_SECONDS=300
R1 · H10 Triple Bogey Medium Risk Free Lunch Mar 19

The Extra Set of Eyes

First real engineering win. Not a free lunch, but absolutely worth a permanent locker in the bag.

1.4057 BPB
-0.0082 Vs Prev
2.3734 Loss
14.48 MB
300s Time
TRAIN_BATCH_TOKENS=131072SCRIPT=train_gpt_valemb.pyMAX_WALLCLOCK_SECONDS=300
R1 · H11 Triple Bogey Medium Risk Encouraging Miss Mar 19

Stacking the Gains

Respectable second-best finish, but the combo diluted the better ingredient.

1.4079 BPB
+0.0022 Vs Prev
2.3772 Loss
14.45 MB
300s Time
NUM_KV_HEADS=2TRAIN_BATCH_TOKENS=131072SCRIPT=train_gpt_valemb.pyMAX_WALLCLOCK_SECONDS=300
R1 · H12 Bogey Safe Tweaks Encouraging Miss Mar 19

Finishing the Swing

Picked up 0.0685 BPB from the last hole.

1.3394 BPB
-0.0685 Vs Prev
2.2615 Loss
16.72 MB
600s Time
TRAIN_BATCH_TOKENS=131072SCRIPT=train_gpt_valemb.pyMAX_WALLCLOCK_SECONDS=600
R1 · H13 Bogey Safe Tweaks Encouraging Miss Mar 19

Trimming the Bag

Dropped 0.0020 BPB versus the last hole.

1.3414 BPB
+0.0020 Vs Prev
2.2649 Loss
16.20 MB
600s Time
TRAIN_BATCH_TOKENS=131072SCRIPT=train_gpt_valemb_slim.pyMAX_WALLCLOCK_SECONDS=600
R1 · H14 Bogey Safe Tweaks Dead End Mar 19

Two Tables, Same Story

Picked up 0.0010 BPB from the last hole.

1.3404 BPB
-0.0010 Vs Prev
2.2631 Loss
16.20 MB
600s Time
TRAIN_BATCH_TOKENS=131072SCRIPT=train_gpt_valemb_2tab.pyMAX_WALLCLOCK_SECONDS=600
R1 · H15 Bogey Safe Tweaks Free Lunch Mar 19

Reading Every Green

Picked up 0.0349 BPB from the last hole.

1.3055 BPB
-0.0349 Vs Prev
2.2043 Loss
16.71 MB
600s Time
TRAIN_BATCH_TOKENS=131072VAL_SW_STRIDE=256SCRIPT=train_gpt_valemb_sw.pyMAX_WALLCLOCK_SECONDS=600
R1 · H16 Bogey Medium Risk Free Lunch Mar 19

Fitting Through the Door

Dropped 0.0231 BPB versus the last hole.

1.3286 BPB
+0.0231 Vs Prev
2.2433 Loss
12.62 MB
600s Time
TRAIN_BATCH_TOKENS=131072VAL_SW_STRIDE=256QUANT_BITS=6SCRIPT=train_gpt_valemb_sw_int6.pyMAX_WALLCLOCK_SECONDS=600
R1 · H17 Bogey Medium Risk Encouraging Miss Mar 19

The Big Iron

Dropped 0.0066 BPB versus the last hole.

1.3352 BPB
+0.0066 Vs Prev
2.2544 Loss
15.40 MB
600s Time
MLP_MULT=3TRAIN_BATCH_TOKENS=131072VAL_SW_STRIDE=256QUANT_BITS=6SCRIPT=train_gpt_valemb_sw_int6.pyMAX_WALLCLOCK_SECONDS=600
R1 · H18 Bogey Safe Tweaks Encouraging Miss Mar 19

The Signature Hole

Picked up 0.0421 BPB from the last hole.

1.2931 BPB
-0.0421 Vs Prev
2.1833 Loss
16.04 MB
600s Time
MLP_MULT=3TRAIN_BATCH_TOKENS=131072VAL_SW_STRIDE=256QUANT_BITS=6SCRIPT=train_gpt_valemb_sw_int6.pyMAX_WALLCLOCK_SECONDS=600

Club Championship Standings

Best score wins, but the deltas tell the real story.

# Hole Shot Risk Call BPB Vs Base Vs Prev Loss Size
1 R1 · H1 The Practice Round Safe Baseline 1.2244 0.0000 - 2.0727 15.82 MB
2 R1 · H18 The Signature Hole Safe Encouraging Miss 1.2931 +0.0687 -0.0421 2.1833 16.04 MB
3 R1 · H15 Reading Every Green Safe Free Lunch 1.3055 +0.0811 -0.0349 2.2043 16.71 MB
4 R1 · H16 Fitting Through the Door Medium Free Lunch 1.3286 +0.1042 +0.0231 2.2433 12.62 MB
5 R1 · H17 The Big Iron Medium Encouraging Miss 1.3352 +0.1108 +0.0066 2.2544 15.40 MB
6 R1 · H12 Finishing the Swing Safe Encouraging Miss 1.3394 +0.1150 -0.0685 2.2615 16.72 MB
7 R1 · H14 Two Tables, Same Story Safe Dead End 1.3404 +0.1160 -0.0010 2.2631 16.20 MB
8 R1 · H13 Trimming the Bag Safe Encouraging Miss 1.3414 +0.1170 +0.0020 2.2649 16.20 MB
9 R1 · H10 The Extra Set of Eyes Medium Free Lunch 1.4057 +0.1813 -0.0082 2.3734 14.48 MB
10 R1 · H11 Stacking the Gains Medium Encouraging Miss 1.4079 +0.1835 +0.0022 2.3772 14.45 MB
11 R1 · H5 More Swings, Less Club Safe Free Lunch 1.4139 +0.1895 -0.0222 2.3873 13.35 MB
12 R1 · H7 Traveling Light Medium Free Lunch 1.4140 +0.1896 -0.0001 2.3875 13.85 MB
13 R1 · H6 The Quant Gap Fix Safe Encouraging Miss 1.4141 +0.1897 +0.0002 2.3876 13.68 MB
14 R1 · H8 The Skinny Iron Medium Dead End 1.4270 +0.2026 +0.0130 2.4095 10.25 MB
15 R1 · H2 First Contact Safe Baseline 1.4361 +0.2117 - 2.4249 10.63 MB
16 R1 · H9 The Short Game Medium Dead End 1.4425 +0.2181 +0.0155 2.4357 13.53 MB
17 R1 · H4 Leaving It Short Safe Dead End 1.9464 +0.7220 - 3.2865 7.49 MB
18 R1 · H3 Grip It and Rip It Safe Dead End 2.0574 +0.8330 - 3.4738 7.61 MB

All Holes

Power-user view of the entire archive with filters.

Filter:
R1 · H18 Bogey Safe Tweaks Encouraging Miss Mar 19

The Signature Hole

Picked up 0.0421 BPB from the last hole.

1.2931 BPB
-0.0421 Vs Prev
2.1833 Loss
16.04 MB
600s Time
MLP_MULT=3TRAIN_BATCH_TOKENS=131072VAL_SW_STRIDE=256QUANT_BITS=6SCRIPT=train_gpt_valemb_sw_int6.pyMAX_WALLCLOCK_SECONDS=600
R1 · H17 Bogey Medium Risk Encouraging Miss Mar 19

The Big Iron

Dropped 0.0066 BPB versus the last hole.

1.3352 BPB
+0.0066 Vs Prev
2.2544 Loss
15.40 MB
600s Time
MLP_MULT=3TRAIN_BATCH_TOKENS=131072VAL_SW_STRIDE=256QUANT_BITS=6SCRIPT=train_gpt_valemb_sw_int6.pyMAX_WALLCLOCK_SECONDS=600
R1 · H16 Bogey Medium Risk Free Lunch Mar 19

Fitting Through the Door

Dropped 0.0231 BPB versus the last hole.

1.3286 BPB
+0.0231 Vs Prev
2.2433 Loss
12.62 MB
600s Time
TRAIN_BATCH_TOKENS=131072VAL_SW_STRIDE=256QUANT_BITS=6SCRIPT=train_gpt_valemb_sw_int6.pyMAX_WALLCLOCK_SECONDS=600
R1 · H15 Bogey Safe Tweaks Free Lunch Mar 19

Reading Every Green

Picked up 0.0349 BPB from the last hole.

1.3055 BPB
-0.0349 Vs Prev
2.2043 Loss
16.71 MB
600s Time
TRAIN_BATCH_TOKENS=131072VAL_SW_STRIDE=256SCRIPT=train_gpt_valemb_sw.pyMAX_WALLCLOCK_SECONDS=600
R1 · H14 Bogey Safe Tweaks Dead End Mar 19

Two Tables, Same Story

Picked up 0.0010 BPB from the last hole.

1.3404 BPB
-0.0010 Vs Prev
2.2631 Loss
16.20 MB
600s Time
TRAIN_BATCH_TOKENS=131072SCRIPT=train_gpt_valemb_2tab.pyMAX_WALLCLOCK_SECONDS=600
R1 · H13 Bogey Safe Tweaks Encouraging Miss Mar 19

Trimming the Bag

Dropped 0.0020 BPB versus the last hole.

1.3414 BPB
+0.0020 Vs Prev
2.2649 Loss
16.20 MB
600s Time
TRAIN_BATCH_TOKENS=131072SCRIPT=train_gpt_valemb_slim.pyMAX_WALLCLOCK_SECONDS=600
R1 · H12 Bogey Safe Tweaks Encouraging Miss Mar 19

Finishing the Swing

Picked up 0.0685 BPB from the last hole.

1.3394 BPB
-0.0685 Vs Prev
2.2615 Loss
16.72 MB
600s Time
TRAIN_BATCH_TOKENS=131072SCRIPT=train_gpt_valemb.pyMAX_WALLCLOCK_SECONDS=600
R1 · H11 Triple Bogey Medium Risk Encouraging Miss Mar 19

Stacking the Gains

Respectable second-best finish, but the combo diluted the better ingredient.

1.4079 BPB
+0.0022 Vs Prev
2.3772 Loss
14.45 MB
300s Time
NUM_KV_HEADS=2TRAIN_BATCH_TOKENS=131072SCRIPT=train_gpt_valemb.pyMAX_WALLCLOCK_SECONDS=300
R1 · H10 Triple Bogey Medium Risk Free Lunch Mar 19

The Extra Set of Eyes

First real engineering win. Not a free lunch, but absolutely worth a permanent locker in the bag.

1.4057 BPB
-0.0082 Vs Prev
2.3734 Loss
14.48 MB
300s Time
TRAIN_BATCH_TOKENS=131072SCRIPT=train_gpt_valemb.pyMAX_WALLCLOCK_SECONDS=300
R1 · H9 Triple Bogey Medium Risk Dead End Mar 19

The Short Game

Dropped 0.0155 BPB versus the last hole.

1.4425 BPB
+0.0155 Vs Prev
2.4357 Loss
13.53 MB
300s Time
TRAIN_SEQ_LEN=512TRAIN_BATCH_TOKENS=131072MAX_WALLCLOCK_SECONDS=300
R1 · H8 Triple Bogey Medium Risk Dead End Mar 19

The Skinny Iron

Dropped 0.0130 BPB versus the last hole.

1.4270 BPB
+0.0130 Vs Prev
2.4095 Loss
10.25 MB
300s Time
MLP_MULT=1TRAIN_BATCH_TOKENS=131072MAX_WALLCLOCK_SECONDS=300
R1 · H7 Triple Bogey Medium Risk Free Lunch Mar 18

Traveling Light

Basically level with the last hole.

1.4140 BPB
-0.0001 Vs Prev
2.3875 Loss
13.85 MB
300s Time
NUM_KV_HEADS=2TRAIN_BATCH_TOKENS=131072MAX_WALLCLOCK_SECONDS=300
R1 · H6 Triple Bogey Safe Tweaks Encouraging Miss Mar 18

The Quant Gap Fix

Basically level with the last hole.

1.4141 BPB
+0.0002 Vs Prev
2.3876 Loss
13.68 MB
300s Time
TRAIN_BATCH_TOKENS=131072FP16_EMBED=trueMAX_WALLCLOCK_SECONDS=300
R1 · H5 Triple Bogey Safe Tweaks Free Lunch Mar 18

More Swings, Less Club

Picked up 0.0222 BPB from the last hole.

1.4139 BPB
-0.0222 Vs Prev
2.3873 Loss
13.35 MB
300s Time
TRAIN_BATCH_TOKENS=131072MAX_WALLCLOCK_SECONDS=300
R1 · H4 Triple Bogey Safe Tweaks Dead End Mar 18

Leaving It Short

Useful bracket, but not where the strokes are hiding.

1.9464 BPB
3.2865 Loss
7.49 MB
300s Time
MATRIX_LR=0.02MAX_WALLCLOCK_SECONDS=300
R1 · H3 Triple Bogey Safe Tweaks Dead End Mar 18

Grip It and Rip It

Clear dead end on this hardware and timescale. Proven idea, wrong course.

2.0574 BPB
3.4738 Loss
7.61 MB
300s Time
MATRIX_LR=0.06WARMDOWN_ITERS=3600MAX_WALLCLOCK_SECONDS=300
R1 · H2 Triple Bogey Safe Tweaks Baseline Mar 18

First Contact

Necessary calibration hole. Bad score, useful signal.

1.4361 BPB
2.4249 Loss
10.63 MB
600s Time
R1 · H1 Par Safe Tweaks Baseline Mar 18

The Practice Round

Steady opening hole. Good enough to map the course, not good enough to lead the clubhouse.

1.2244 BPB
2.0727 Loss
15.82 MB
600s Time