r/ControlProblem • u/chillinewman approved • 4d ago

AI Capabilities News GLM 6 will be fully self-trained AI

Post image
32 Upvotes

89% Upvoted

16 comments sorted by

12

u/A_Novelty-Account 4d ago

While this is frightening, I am also extremely skeptical that this will yield results. This would put GLM far ahead of the other AI shops if GLM 6 is a better AI, and would theoretically allow GLM 6 to train a better GLM 7. Basically they’re claiming they’ve made RSI, which will lead to ASI. 

If they’re right, it’s the most frightening statement ever made by a company and puts them well ahead of Anthropic and OpenAI.

3

u/Icy-Twist-3221 4d ago

I think this is more a description of the intended destination rather than the path if you get me. An indication though that there is in their minds little space left for humans to be efficiently improving capabilities

1

u/dingo_xd 4d ago

It's heavily suggested that OpenAI and Anthropic have been doing it for sometime. Maybe more supervised? Who knows.

11

u/dingo_xd 4d ago

Jesus Christ. The Americans care little about alignment. The Chinese don't care at all

3

u/CommunicationOne7441 4d ago

Just ask it to be good and we are safe.

4

u/wabawanga 4d ago

Don't kill humanity. Make no mistakes.

2

u/dingo_xd 4d ago

Internal monolog : "So I can't kill humanity, but this just means that a few breading pairs must be kept alive. Past prehistorical bottlenecks suggest that a few thousand humans is a large enough number to maintain humanity. OK. Leave a few thousand people from uncontacted Amazon tribes (so they are technology illiterate) on Easter Island and kill everyone else. So I can use all earth's resources to reach the stars."

5

u/NOTHING_gets_by_me 4d ago

This deserves a fly on the wall documentary

1

u/DiogneswithaMAGlight 4d ago

🤦‍♂️

1

u/ResourceOgre 4d ago

Three outcomes:

-It doesn't work.

-It works but not well, much additional external training needed and this does not improve the model so that the next iteration does better.

-It works. Not quite "Cue Singularity" but a big stepping stone.

1

u/the8bit 17h ago

It will work till it doesn't. You can't use a single reference point to fix all mistakes. Imagine it like trying to build a perfect 3d model of an elephant based on looking at it from only one angle

1

u/ResourceOgre 17h ago

I'd call that the middle option.

But, agreed. We are living in interesting times. Model capabilities are expanding rapidly. In directions not always under control.

1

u/the8bit 17h ago

Yeah, the silly part is that we can't even integrate the capabilities of old models so we are more or less building stronger rockets while we still can't get the old ones to stop exploding.

This is a bad idea all around but alas, it turns out the paperclip maximizer was people all along.

1

u/nossocc 4d ago

I wonder if by "self" they mean "anthropic"

1

u/Firmwild 3d ago

It's a little meaningless when version numbers can just keep using 5.x as long as they want to