← OpenFluke

Chapter 63

Validation report — full suite

github.com/openfluke/w2a✅ 228k cells


Why it exists

Claims are cheap; a stamped matrix is not. This is the actual output of one full w2a run so the book's ✅ marks are backed by numbers you can reproduce, not asserted.

What it is

Every timed layer sweeps its dtype × format × backend matrix; every suite runs its case checks. Latest full board: FAIL 0, cases all PASS; honesty stamps still record GAP cells (not silent skips).

Full suite: PASS228,054 matrix cells — OK 227,194 · GAP 860 · FAIL 0. 456 suite cases — PASS 456 · FAIL 0. Elapsed 1h21m32s. Good enough for Caber / GitHub release: no fails, gaps are declared.

Coverage by layer (highlights)

LayerCellsOKGAPCases
step43,90343,903013
tween32,45732,457010
dna16,15916,15906
evolution16,15216,15206
dense5,7755,774125
mha · swiglu · cnn* · rnn/lstm · norms · …~5,763 ea~all OK0–few14–23 ea
parallel6,4156,3694620
convt1–35,763 ea5,649 ea114 ea14 ea
gdn5559346217
mamba5,7635,755814
Total228,054227,194860456

GAPs are honesty stamps (paths not claimed done) — concentrated in gdn / convt / a few poly_train cells. Case-only stubs: seed, serialization, memory, donate, fountain, hardware, helpers, weights.

Cross-numeric train

W2A Step includes Cross-Numeric Train (kinds × weight dtype × act host; full census ~10.7k under the train op). Storage truth checked after StepMesh — no retained f32 master for non-float32 FormatNone. Public Dense demotion + W×A showcase: down-the-dem (chapter 65).

Go example

examples/63-validation/main.go

Run:cd welvet/examples/63-validation && source ../env.sh && go run .
package main

import "fmt"

func main() {
	cells, ok, gap, cases := 228054, 227194, 860, 456
	fmt.Printf("w2a suite: %d cells (OK %d GAP %d FAIL 0)\n", cells, ok, gap)
	fmt.Printf("cases: %d/%d PASS   result: PASS\n", cases, cases)
}

Output

exit 0 · last run via go run .

w2a suite: 228054 cells (OK 227194 GAP 860 FAIL 0)
cases: 456/456 PASS   result: PASS

Validate (harness)

cd w2a && go run .   # full timed suite (~1h20m); writes logs/suite.txt