d12 H100 batch32 (upstream defaults)

Completed
UUID:1d772d57-e958-4cf8-964e-d72fa89dff4d
Tao Linvia🐎 pentiumCreated 212 days agoUpdated 212 days ago

d12 on H100 80GB with upstream defaults. H100 has FA3 so SSSL window pattern works, but MLproject currently hardcodes --window-pattern L. Testing with L first, then consider adding SSSL support.

Finance

Fundings at snapshot$26.04

Individual funding and transaction records are not included in the public archive.

Configuration

Version
experiment/baseline-search → 83770dbbcc82ebe554e6355eac3b8b5c76b017d3
Image
ghcr.io/nblintao/mlpatron-nanochat:latest
→ ghcr.io/nblintao/mlpatron-nanochat@sha256:28c5544c206237e407241b0a72a8707e63e52750f487b751675b51ff1bce1520
Entrypoint
a100_preset
Resources
NVIDIA H100 80GB × 1·a3-highgpu-1g (26 vCPU / 234 GiB)
Parameters
depth=12·eval_every=250·max_seq_len=2048·tok_max_chars=2000000000·num_iterations=2205(dryrun: 20)·num_data_shards=22·device_batch_size=32