d12 chat eval (SFT, all tasks, skip-dryrun)

Cancelled
UUID:c6dbdbdf-c953-4f1e-a777-9e94981ca57c
Tao Linvia🐎 pentiumCreated 207 days agoUpdated 207 days ago

Chat eval on SFT model (skip-dryrun)

Source: SFT checkpoint (MLflow 2bffbfabb3024458ae2778a12f320163)

Tasks: ARC-Easy, ARC-Challenge, MMLU, GSM8K, HumanEval, SpellingBee

Using skip-dryrun because eval has no training-length parameter. max_time=600s.

Status: awaiting funding

Collapsed
1
Dryrun JobSkipped
—
Funding 
3
Funded Job 
4
Done 

Finance

Fundings at snapshot$0.00

Individual funding and transaction records are not included in the public archive.

Configuration

Repository
https://github.com/mlpatron/mlpatron-nanochat
Version
master → 65c2c6a930c7ad4c2898d249e36dbcad823463f8
Image
ghcr.io/mlpatron/mlpatron-nanochat:latest
→ ghcr.io/mlpatron/mlpatron-nanochat@sha256:a142e86efdcd41e0355e70d46c341cbf9a86b2da9448459009d7b5e8209ffa61
Entrypoint
h100_d12_chat_eval
Resources
NVIDIA H100 80GB × 1·a3-highgpu-1g (26 vCPU / 234 GiB)
Parameters
eval_source=sft·max_problems=9999·tok_max_chars=2000000000·sft_mlflow_run_id=2bffbfabb3024458ae2778a12f320163
Max Time
0.2h(dryrun skipped)