d12 SFT v3 (fixed inline python)
CancelledUUID:ba967a7c-2932-428d-8c29-ee558fc0732a
SFT on d12 pretrain checkpoint
Pretrain source: d12 H100 SSSL final (val_bpb=0.854, step 2205)
Plan:
- Download pretrain checkpoint from MLflow artifacts (~2GB)
- Train tokenizer (deterministic, ~80s)
- Run SFT with default mixture (~1.07M rows)
- Upload SFT checkpoint to MLflow artifacts for downstream RL
- num_iterations=9999 as cap; epoch-based stopping triggers first (~600 steps)
Prior attempts:
- v1: cancelled (missing --upload-checkpoint)
- v2: dryrun_failed (IndentationError in inline Python — YAML folding issue)
Status: cancelled — dryrun passed but num_iterations=9999 caused inflated cost estimate ($186). Epoch is ~612 steps. Recreating with num_iterations=700.
Collapsedv2 · Edited 209 days ago
Finance
Fundings at snapshot$0.00
Individual funding and transaction records are not included in the public archive.
Configuration
- Version
- master → 6db4c817bdab18684aa4c2bafd671c1c3a968b5a
- Image
- ghcr.io/mlpatron/mlpatron-nanochat:latest→ ghcr.io/mlpatron/mlpatron-nanochat@sha256:a142e86efdcd41e0355e70d46c341cbf9a86b2da9448459009d7b5e8209ffa61
- Entrypoint
- h100_d12_sft
- Resources
- NVIDIA H100 80GB × 1·a3-highgpu-1g (26 vCPU / 234 GiB)
- Parameters
- num_iterations=9999(dryrun: 20)·upload_checkpoint=1·pretrain_mlflow_run_id=25207c33abca4a8197870adec4ead007