Compare top models

LLM Benchmarks

See how today's leading models write Spacetime code, scored task by task on live modules.

← Back

DeepSeek V4 Pro

TypeScript · With Guidelines · 2026-07-14
0.0%Task Pass Rate
0/89Checks Passed
47Total Evals

Pass Rate Over Time

Click a data point to view results from that date.

auth

0% · 8 evals
PassTaskChecksRun Time
✗Auth Identity Check0/13.6s
✗Private Vs Public Table0/15s
✗Registered User Gate0/14.4s
✗Admin Bootstrap0/124.8s
✗Role Based Access0/124.6s
✗Ban List0/16s
✗Rate Limit0/15.2s
✗Shared Document0/16.6s

basics

0% · 15 evals
PassTaskChecksRun Time
✗Empty Reducers0/13.4s
✗Basic Tables0/115.1s
✗Scheduled Table0/16.4s
✗Struct In Table0/113.8s
✗Insert0/217s
✗Update0/37.6s
✗Delete0/34.5s
✗Crud0/415.2s
✗Index Lookup0/37.4s
✗Init0/42.8s
✗Connect0/12.5s
✗Helper Function0/321.3s
✗Schedule At Time0/15.8s
✗Cancel Schedule0/13.2s
✗Lifecycle Player0/17.8s

data modeling

0% · 6 evals
PassTaskChecksRun Time
✗Event Table0/12.7s
✗Optional Fields0/16.3s
✗Cascade Delete0/120.1s
✗Filter And Aggregate0/19.5s
✗Wo Table Join0/121.5s
✗Unique Constraint0/111.8s

queries

0% · 8 evals
PassTaskChecksRun Time
✗View Basic0/14.2s
✗View Per User0/13.3s
✗Range Query0/15.4s
✗Sort And Limit0/14.9s
✗Find First0/12.8s
✗Select Distinct0/121.4s
✗Count Without Collect0/13.5s
✗Multi Column Filter0/18.4s

schema

0% · 10 evals
PassTaskChecksRun Time
✗Spacetime Product Type0/33.4s
✗Spacetime Sum Type0/32.9s
✗Elementary Columns0/32.7s
✗Product Type Columns0/33s
✗Sum Type Columns0/318s
✗Scheduled Columns0/225.5s
✗Constraints0/318.8s
✗Many To Many0/54.5s
✗Ecs0/74.8s
✗Multi Column Index0/515.3s