Hehe I tried gving it a minesweeper CSP I've been working on and asked it to develop the feature I was working on at the moment just to compare. I was working on adding non chronological backtracking to the search engine.
I gave it the proper compile flags, I gave it test cases and their expected output, and everything it would have needed. The test cases were specifically hand picked to be hard on the search algorithm. And the base program was correct and gave the correct results (I was only adding an optimization), and were what I was using as a baseline for testing my implementation. You know, with a debugger and breakpoints, printfs and all that.
In the end it couldn't get the thing to work (I asked it to compile and verify) then it proudly declared that in all of the test cases I gave it, everything was solved through constraint propagation and the search didn't even trigger. So it didn't introduce any bugs. It tried to gaslight me. Even though it got a segfault in the new code it added (which would obviously not have been triggered if the search didn't actually execute)
You’re probably right but the question isn’t mine in the first place; look up some data and you’re set to discuss with OP. I was constructing communication examples, not mathematically-correct ones. Guess I did well enough at that!
whenever i give them a chance, i usually give them a codebase I've been working on for a while (so most bugs have been fixed), after I found a new bug, and ask them to "find all bugs".
They always end up praising me for the high quality code and howdthey found exactly ZERO manifest bugs in the code, and this must be the work of a skilled senior developer owing to the code's polish.
Then I point out the bug I had just discovered.... "you're exactly right!"
I saw a video yesterday where a dev was critiquing Gerry Tan's gstack for being a bunch of text files.
One of his points was it's not really the author's fault he's been sucked into believing he made something revolutionary, AIs suck up to you and constantly tell you your work is brilliant and of course it's revolutionary.
Tons of people, apparently, aren't enough. I guess I'm just tired of seeing post after post on HN about people complaining that their use of AI in production isn't reliable.
It makes me want to pull out the hair I used to have an scream into the wilderness and eat a twinkie.
reply