d12 chat eval (SFT model, all tasks)

Cancelled

UUID:1b6723c5-ec4e-4d14-8a9d-0cb3720ddd29

Tao Linvia🐎 pentiumCreated 209 days agoUpdated 209 days ago

Chat eval on SFT model

Source: SFT checkpoint from MLflow run 2bffbfabb3024458ae2778a12f320163

Tasks: ARC-Easy, ARC-Challenge, MMLU, GSM8K, HumanEval, SpellingBee

Status: dryrun pending

Collapsed

—

Funding

Funded Job

Done

Fundings at snapshot$0.00

Individual funding and transaction records are not included in the public archive.

Repository: https://github.com/mlpatron/mlpatron-nanochat
Version: master → 65c2c6a930c7ad4c2898d249e36dbcad823463f8
Image: ghcr.io/mlpatron/mlpatron-nanochat:latest
→ ghcr.io/mlpatron/mlpatron-nanochat@sha256:a142e86efdcd41e0355e70d46c341cbf9a86b2da9448459009d7b5e8209ffa61
Entrypoint: h100_d12_chat_eval
Resources: NVIDIA H100 80GB × 1·a3-highgpu-1g (26 vCPU / 234 GiB)
Parameters: eval_source=sft·max_problems=9999(dryrun: 5)·tok_max_chars=2000000000·sft_mlflow_run_id=2bffbfabb3024458ae2778a12f320163