d12 SFT (from pretrain checkpoint, with artifact upload)

Dryrun Job Failed
UUID:aaa9898c-a162-4f73-8695-352dc3b17842
Tao Linvia🐎 pentiumCreated 209 days agoUpdated 209 days ago

SFT on d12 pretrain checkpoint

Pretrain source: d12 H100 SSSL final (val_bpb=0.854, step 2205)

Plan:

  1. Download pretrain checkpoint from MLflow artifacts (~2GB)
  2. Train tokenizer (deterministic, ~80s)
  3. Run SFT with default mixture: SmolTalk 460K + MMLU×3 + GSM8K×4 + Identity×2 + Spelling 280K = ~1.07M rows
  4. Upload SFT checkpoint to MLflow artifacts (for downstream RL)
  5. num_iterations=9999 as cap; epoch-based stopping triggers first (~600 steps)

Expected: ~20 min on 1×H100, ~$2-3

Status: dryrun_failed — IndentationError in inline Python. YAML >- folding adds leading spaces to continuation lines. Fixed by collapsing to single line.

2
Funding 
3
Funded Job 
4
Done 

Finance

Fundings at snapshot$0.00

Individual funding and transaction records are not included in the public archive.

Configuration

Version
master → 4bfde4f4d1b1bcd392a52d3b104a80a1877bea90
Image
ghcr.io/mlpatron/mlpatron-nanochat:latest
→ ghcr.io/mlpatron/mlpatron-nanochat@sha256:a142e86efdcd41e0355e70d46c341cbf9a86b2da9448459009d7b5e8209ffa61
Entrypoint
h100_d12_sft
Resources
NVIDIA H100 80GB × 1·a3-highgpu-1g (26 vCPU / 234 GiB)
Parameters
num_iterations=9999(dryrun: 20)·upload_checkpoint=1·pretrain_mlflow_run_id=25207c33abca4a8197870adec4ead007