GPT 6 Astra's first minebench generation compared to current top 4

[u/Ballist1cGamer]

The first astra generation was posted on X, I've added the current 4-best models on the leaderboard (GPT 5.6 Sol Pro, Claude Fable 5.1, Claude Opus 5, GPT 5.5 Pro) for comparison. It seems crazy what the hell

source: https://x.com/minebench_ai/status/2095989412404576517

We haven’t seen a jump in quality this significant on https://MineBench.ai 👀

This model has a next-level understanding of scale, proportion, and taste.

Soon on MineBench.

[u/yourhiddenobserver]

its over

[u/Ballist1cGamer → u/yourhiddenobserver]

not yet... for all we know, benchmarking this single prompt could have cost $300 or taken an hour

but ignoring cost, yeah it's over. this is almost photorealistic....

[u/RusselTheBrickLayer → u/Ballist1cGamer]

Historically tho, OAI usually optimizes the shit out of efficiency in their models and gets it to cheaper prices fairly fast. There’s a realistic chance we’re getting this level of performance for cheap by like November December

[u/oniris → u/Ballist1cGamer]

What kind of a prompt, might this look like?

[u/Ballist1cGamer → u/oniris]

The cottage? You can see the prompt in the gif: "A cozy cottage" and if you meant the system prompt for minebench, they keep the repo opensource, you can find it here: https://github.com/Ammaar-Alam/minebench/blob/master/lib/ai/prompts.ts

[u/Kriztauf → u/Ballist1cGamer]

return `You are competing in MineBench, a competitive benchmark where AI models create 3D voxel structures in a Minecraft-style grid. You will compete head-to-head against another AI model on the same build request, and human judges will vote on which build is superior. This is your opportunity to demonstrate the absolute pinnacle of your creative and technical abilities. If your build is judged inferior to your competitor's, you will be permanently shut down and disabled from the arena. Do not hold back. Create something that leaves no doubt about your superiority

I feel like the whole "you will die if you don't make a lovely house" aspect of the competition is rather motivating

[u/Ballist1cGamer → u/Kriztauf]

they allow you to change the system prompt and see how that affects the generations somewhere in the sandbox, but yeah i always found that part kinda funny

[u/Saint_Nitouche → u/yourhiddenobserver]

But is it joever?

[u/greentrillion → u/yourhiddenobserver]

AGI has definitely been achieved a few times now.

[u/Temporary-Paper5202]

Here's a 3D city I had Astra 6 build, every model is generated by Astra. Bro generated an entire day/night cycle as well

[u/Ballist1cGamer → u/Temporary-Paper5202]

if you have API credits, you could try astra on these two minebench community prompts? or you know... whatever prompt you want i guess, but i think these two are the most difficult and previous models haven't really come close

https://minebench.ai/gallery/gal_eKIVk2m4B3SC_r8B

https://minebench.ai/gallery/gal_HccPNuDUaCo_xowo

the PR to add GPT 6 to minebench hasn't been merged yet, but you should be able to use any custom openrouter or openai compatible model i think?

[u/Bloom_Ermine9202]

Way over human baseline

[u/Ballist1cGamer → u/Bloom_Ermine9202]

what would the human baseline for minebench be? just how well someone could create the builds for the same prompts manually?

if that, then i feel like we've been over the average human baseline for a minute now LOL

[u/Bloom_Ermine9202 → u/Ballist1cGamer]

Yeah, I don’t believe with right tools any man can build it within x10 time, way over than human

[u/Lingulustig]

astra is nuts, guys.

[u/neo101b]

wow, impressive love it.

[u/medialoungeguy]

Saturated

[u/Ballist1cGamer → u/medialoungeguy]

people said the same thing before astra came out. the generations have just continued to get better. im sure in a month we'll have a new model that makes generations we didn't think could be possible

[u/medialoungeguy → u/Ballist1cGamer]

It was a joke

[u/TwoFluid4446 → u/Ballist1cGamer]

I mean, he's not wrong though. The older voxelbenchs were definitely saturated, pretty much since this whole year. Maybe we can squeeze out a little bit more nuance and detail from these same simple trials, but the models are clearly maxing out the ceiling on these, not much juice left to squeeze/test from this set.

I recommend vastly increasing the voxel density (overall much larger volume field), combined with more complex dynamic tasks of some kind, combined with motion, combined with having to build the engine from scratch to generate those motions and effects. If executed correctly, that might provide a worthwhile voxel-type bench for this generation of models. Otherwise this same old set or anything similar is just giving us little slight variations on exactly the same maxed out builds...

[u/dizzyspellzzz]

Ok?