AI should only run as fast as we can catch up
by yuedongze on 12/8/2025, 5:38:34 PM
https://higashi.blog/2025/12/07/ai-verification/
Comments
by: blauditore
All these engineers who claim to write most code through AI - I wonder what kind of codebase that is. I keep on trying, but it always ends up producing superficially okay-looking code, but getting nuances wrong. Also fails to fix them (just changes random stuff) if pointed to said nuances.<p>I work on a large product with two decades of accumulated legacy, maybe that's the problem. I can see though how generating and editing a simple greenfield web frontend project could work much better, as long as actual complexity is low.
12/8/2025, 6:26:11 PM
by: gradus_ad
The proliferation of nondeterministically generated code is here to stay. Part of our response must be more dynamic, more comprehensive and more realistic workload simulation and testing frameworks.
12/8/2025, 5:51:29 PM
by: cons0le
I directly asked gemini how to get world peace. It said the world should prioritize addressing climate change, inequality, and discrimination. Yeah - we're not gonna do any of that shit. So I don't know what the point of "superintelligent" AI is if we aren't going to even listen to it for the basic big picture stuff. Any sort of "utopia" that people imagine AI bringing is doomed to fail because we already can't cooperate without AI
12/8/2025, 6:20:25 PM
by: jascha_eng
Verification is key, and the issue is that almost all AI generated code looks plausible so just reading the code is usually not enough. You need to build extremely good testing systems and actually run through the scenarios that you want to ensure work to be confident in the results. This can be preview deployments or other AI generated end to end tests that produce video output that you can watch or just a very good test suite with guard rails.<p>Without such automation and guard rails, AI generated code eventually becomes a burden on your team because you simply can't manually verify every scenario.
12/8/2025, 6:31:39 PM
by: yannyu
I think there's a lot of utility to current AI tools, but it's also clear we're in a very unsettled phase of this technology. We likely won't see for years where the technology lands in terms of capability or the changes that will be made to society and industry to accommodate.<p>Somewhat unfortunately, the sheer amount of money being poured into AI means that it's being forced upon many of us, even if we didn't want it. Which results in a stark, vast gap like the author is describing, where things are moving so fast that it can feel like we may never have time to catch up.<p>And what's even worse, because of this industry and individuals are now trying to have the tool correct and moderate itself, which intuitively seems wrong from both a technical and societal standpoint.
12/8/2025, 6:19:56 PM
by: rogerkirkness
Appealing, but this is coming from someone smart/thoughtful. No offence to 'rest of world', but I think that most people have felt this way for years. And realistically in a year, there won't be any people who can keep up.
12/8/2025, 5:39:38 PM
by: CGMthrowaway
> AI should only run as fast as we can catch up<p>Good principle. This is exactly why we research vaccines and bioweapons side by side in the labs, for example.
12/8/2025, 5:53:35 PM