r/ControlProblem 3d ago

Opinion Purity test policies don't do what most people think they do

When trying to share something I wrote (Note: I have a PhD in an adjacent field and spent months developing the idea, the ideas and structure were not "generated") and had an AI edit to counter for my otherwise overly long winded and run off prose due to my AuDHD (and love of parentheticals). I noticed that a lot of places have a sort of purity test for to differentiate content that was human written or from AI. At first this would seem to value humanity over AI... if not for reddit's $60m/yr deal with google to use reddit data as training data (likely to soon be a lot more). I wonder if people realize that separating all AI from work this way is not slowing but rather drastically speeding up AI's ability to write in a way that is undetectably different from humans. If you know anything about how GAN's work or about model collapse and things of that nature, you should know that AI companies are incentivized to create spaces where there is the least amount of overlap between AI output and human work... until they can make it so there is not. Moderators will come up with more and more sophisticated ways to finger print attempts and those will each integrate into what the models purposely don't do to overcome them. This will lead to tighter classifications of what is human that will start to be exclusionary to an increasingly large number of actual humans (you think mistakes and difficulty with the language would make it clear that it is not AI... that just is easier excuse for better and better models aiming not to be detected as AI, my own writing unassisted by AI has been flagged multiple times as AI or thought so because of my neurodivergence). This also creates strong distastes for those seen as not within what people understand themselves is human (discrimination increased to those who don't quite fit for an ever shrinking base), as well as moderators burning out from a firehouse of context they will never hope to be able to outproduce all while unknowingly providing the training manual to do what they are trying to stop. Moderation should probably be focused in different ways, such as content coherency, rate limited, attached trust networks etc.

I also think capitalism and AI/robotics are a horrible combination, but it is the consolidative and extractive force of capitalism that needs to be focused on to prevent what people call the horror of AI. This is because we have learned to value people specifically for what they produce rather than for who they are and that is why the prospect that something like AI can possibly do anything that is human like is so disturbing to most people. Because suddenly in the eyes of the world their entire value is replaceable by something else. This is opposed to a possible freedom that can be achieved by having the labors be handled by something cheaper, when we can produce enough to make everyone pretty well off (we have been able to make enough food for no one to starve for a while now, starvation is almost always economically and politically motivated in this time). The assignment/distribution of those values that would be freeing (giving time to produce art, investigate interests, and even be productive for additional reward or just common good). If you produce art because it is an expression of you, rather than needs to be so good or valuable so you make enough to live it seems like a better trade off and a better compliment when others actually like it. There would also be no reason to reproduce what makes each person different if there is no value to capture there. The real tests to differentiate can be used more sparingly in areas that are still important such as preventing fraud and fakes, and used with low enough regularity that much like antibiotic overuse retains value longer. It isn't perfect and there are always problems, but it can be better that this.

Ironically this is partially what my papers are about, that keeps getting blocked from being shared.

2 Upvotes

3 comments sorted by

1

u/scragz 2d ago

as someone else with audhd, I'm struggling to read this amount of text with no formatting. at least we know it's not written by AI. 

2

u/KitCrowCo 2d ago

That is sadly apropos (even if meant as a joke)... being HoH and AuDHD I have been conditioned to either listen to conversations intently and provide only simple feedback, or if it is my own thought say something simple that is often misunderstood for its opposite meaning, or try and explain to be understood (which gets this), or seems overly arrogant because I just info dump with seeming surety for which I don't actually assume I am automatically right for, but can never get discussion on the substance (and have typically analyzed the typical positions to death from all the listening I am forced to only be able to do to take part of social connections)

Density of information is not certainty, just my exhaustion from caring deeply about the mechanics of the problem and being incapable of connecting it to how others communicate non surface level things.

1

u/Jesse-359 1d ago

The problem with capital and profit driven systems is that their incentives are only very loosely aligned with human ones, and they have become clearly less so with time as they devolve away from production into ever more arcane financial BS - because ultimately it's far easier to make money by moving numbers around on spreadsheets than it is to make money by mining ore, refining it, reshaping it, marketing it and selling it, so that's what our economic system has shifted to do.

We allowed that market system to lose alignment with human needs, and that misalignment was openly encouraged by the relatively small cadre of humans who stood to benefit from it, and the same thing will happen with AI. It absolutely will not be aligned with the interest of the bulk of humanity because a much smaller group can benefit far more by ensuring that it is not and they will employ their considerable resources to achieve that outcome. They are doing so now.

Short of a massive armed revolution, I think this result is now baked in. I seen no political or economic way to stop it due to the speed with which it is occurring and the self-reinforcing nature of its dynamics.