Factory Docs
Start here for the retained factory contracts. They are runnable lab material,
not an active project queue; use them only after the fresh-experiment gate in
../NEXT.md is met.
posttrainllm’s retained product loop is:
target -> data -> post-training -> eval -> package -> report
Files
-
specialist-labs.md— owner-authorized Issue #210: decision, Timestral forecasting and learned-terminal Python/browser modes. -
../README.md— golden path through state, attempts, reviewed products, roadmap, and learning. -
overview.md— what the factory is and what counts as proof. -
post-training-factory.md— how data, post-training, evals, performance, packaging, and public artifacts fit together. -
../attempt-ledger.md— all 127 final worked, failed, regressed, inconclusive, superseded, and rejected attempts. -
../external-products-reviewed.md— external products and techniques reviewed or adopted. -
case-study-template.md— public artifact report shape: baseline, failed attempts, slices, trace review, performance, and blockers. -
batch-posttraining.md— batch rollout, offline scoring, compact adapter update, eval, and decision loop. -
lora-geometry.md— adapter effective-update diagnostics for rank and module targeting. -
Closed autocorrect foundation (training was rejected after the bounded bake-off):
autocorrect-foundation.md— contract, evaluator, simulator, and manifests;autocorrect-model-shortlist.md— the measured base bake-off and selection;autocorrect-adapter-recipe.md— the frozen LoRA recipe, the encoder-decoder training path, and its load-parity evidence. -
run-schema.md— local run directory contract. -
artifact-lifecycle.md— relocatable artifact identity, provenance, runtime compatibility, and legal-next-action contract. -
run-lifecycle.md— durable phase/revision state, metadata-only operator commands, advisory discovery, and recovery. -
report-card.md— portable before/after proof contract: measurement states, decision semantics, JSON + static report, publication gate. -
report-card-cohort.md— the published report-card cohort, documented absences, and the mapping gaps the review found. -
enforcement.md— native validation plus stricter publish-check requirements. -
eval-protocol.md— baseline, regression, and ship/reject rules. -
packaging.md— specialist package layout and lock metadata. -
reports.md— before/after report template. -
public-artifacts.md— public artifact registry, release states, and blockers. -
../techniques/README— method-vs-recipe registry. Use this before selecting a post-training run so “try DPO/RLVR/LoRA” becomes a concrete recipe with data, eval, slices, and stop rule.
Rule
Use existing primitives first. Add new tooling only when it directly improves data preparation, post-training, eval, packaging, or reporting for the current factory target.
Do not treat a method name as a plan. A run is ready only when it has a recipe: target, failure mode, data, reward or labels, eval gates, slice gates, and a ship/retry/reject threshold.