Discussion about this post

User's avatar
Peter Greene's avatar

This is so gut-wrenching to read-- the parts about the AI shit, not the parts about the reporting.

It underlines what I've come to think of as a central irony of AI-- it's really only safe to use if you are already an expert on whatever you're using it for.

Thank you for sharing your father's story.

Kotzsu's avatar

I think the 'defenestration' as you called it is important, necessary work.

I feel like I'm taking crazy pills ala Jacobim Mugatu describing how AI is hype and oversold and everyone else keeps talking about how none of us will have jobs in the near future.

So far as I have seen, AI tools we have cannot work independently on anything that requires technical, specialized, or expert knowledge; it cannot work independently on detailed work that requires accuracy. This sort of AI is fine for a 'good-enough,' 'slap some paint on it' type jobs - like summarizing meeting notes or helping to draft an email. But as 'spicy autocorrect' or extra mathy-Markov Chain babblers, the tools we have don't *know* things so they can't actually do knowledge work - not work that needs to be done properly, at least.

AI can *maybe* help workers do their jobs. But I keep hearing from line worker programmer friends at tech companies with these AI mandates that the AI tools essentially create babysitting tasks for programmers. The immediate native output code will be a mess, or buggy, or won't compile, or won't adhere to required standards or practices, and so on. And we have multiple cases now of lawyers being laughed out of court for relying too much on AI. And we are getting stories now like your dad's of AI leading to bad health outcomes.

I think in the era of algorithmic social media, and everyone being pushed to their spiciest and most confrontation takes, and the death of nuance and context --- sure, I grant that AI is impressive and can do some cool things.

But increasingly to me the maximalist (or doomist) AGI hype looks oversold. The tech broligarchs keep thinking if they throw more and more compute at their powerful predictive text tools they will get actual intelligence. But that isn't necessarily going to be the case. What is the case is that tech dudes do need to justify the continued fire house of money that is coming their way, so they have every incentive to keep doubling down on what they know, even if the ratio or oversold hype to genuine promise is getting wobbly and unbalanced.

Thanks for sharing and the writing you are doing!

11 more comments...

No posts

Ready for more?