[dryrun-only] d10 batch32 (OOM test)

Cancelled
UUID:f56a3ab9-1e59-4ed6-9ef0-84b973c13254
Tao Linvia🐎 pentiumCreated 213 days agoUpdated 212 days ago

Dryrun PASSED — No OOM, MFU improved

batch32: step 1738ms (vs 1820), MFU 55.9% (vs 53.1%), peak mem 21.2GB. Safe for A100 40GB with 19GB headroom. Should be new default.

Dryrun Job 
—
Funding 
3
Funded Job 
4
Done 

Finance

Fundings at snapshot$0.00

Individual funding and transaction records are not included in the public archive.

Configuration

Repository
https://github.com/mlpatron/mlpatron-nanochat
Version
experiment/baseline-search → e39ceb9a3a373755eb29e04fe8c88563830ba089
Image
ghcr.io/nblintao/mlpatron-nanochat:latest
→ ghcr.io/nblintao/mlpatron-nanochat@sha256:28c5544c206237e407241b0a72a8707e63e52750f487b751675b51ff1bce1520
Entrypoint
a100_preset
Resources
NVIDIA A100 40GB × 1·a2-highgpu-1g (12 vCPU / 85 GiB)
Parameters
depth=10·eval_every=300·max_seq_len=2048·num_iterations=1500(dryrun: 20)·num_data_shards=12·device_batch_size=32