Supabase · By open-thoughts

Given a list of models (HF name stubs) that have valid agentic ID eval scores in Supabase, build a ranking table: raw per-benchmark accuracy on the 3 ID benchmarks (SWE-Bench-100…

open-thoughts/OpenThoughts-Agent

Safely purge stale, never-populated sandboxjobs placeholder rows (eval launches that died/stalled before scoring) from the OT-Agent Supabase registry.

open-thoughts/OpenThoughts-Agent

Consolidate FINISHED standard / lmeval (evalchemy) math-suite eval jobs — the Delphi 6279 MATH-500 / AIME24 / gsm8k grid launched via eval-standard-launch — into the SCORES.md tracker.

open-thoughts/OpenThoughts-Agent

Preserve + publish a finished RL (SkyRL/GRPO) training checkpoint after the job terminates (completed at maxsteps OR early-stopped/scancelled) on an HPC cluster (Jupiter/Leonardo/Perlmutter).

open-thoughts/OpenThoughts-Agent

Publish + clean up a finished LLaMA-Factory SFT job on a no-internet HPC cluster (Jupiter/Leonardo): cancel pending retries, drop intermediate checkpoints, HF-upload the model to its configured…

open-thoughts/OpenThoughts-Agent

Read, aggregate, and (carefully) write OT-Agent eval/model data in the Supabase registry.

open-thoughts/OpenThoughts-Agent

Audit + recover a finished agentic eval. An agent skill from open-thoughts/OpenThoughts-Agent.

open-thoughts/OpenThoughts-Agent

Clean up a completed NON-AGENTIC / HF-only SFT model — HF upload WITHOUT Supabase DB registration.

open-thoughts/OpenThoughts-Agent