I spent close to a full 8 hours last week trying to debug a production issue with different AI tools because I didn’t want to have to do the sort of step by step debugging you describe (and which has been a critical job skill for me for over 25 years). In my mind, it was too critical to spend that kind of time on and I’d hoped (wrongly) that the model would steer me to the root cause faster. And once I was invested in its path of investigation, I felt less and less like going it alone/bare metalling it. Even stack overflow can usually point a general direction. Anyways, the source of the issue was clearly beyond the model’s context/experience and it sent me around in the same circles. I ended up having to go step by step to find the issue - it took me about an hour and a half. It was (I guess) pretty specific to our system/technical history but also if I can narrow it down that quickly, surely the robot should have done a little better?
I guess the moral here is that I’ve probably (too quickly) become used to reaching for these tools
I spent close to a full 8 hours last week trying to debug a production issue with different AI tools because I didn’t want to have to do the sort of step by step debugging you describe (and which has been a critical job skill for me for over 25 years). In my mind, it was too critical to spend that kind of time on and I’d hoped (wrongly) that the model would steer me to the root cause faster. And once I was invested in its path of investigation, I felt less and less like going it alone/bare metalling it. Even stack overflow can usually point a general direction. Anyways, the source of the issue was clearly beyond the model’s context/experience and it sent me around in the same circles. I ended up having to go step by step to find the issue - it took me about an hour and a half. It was (I guess) pretty specific to our system/technical history but also if I can narrow it down that quickly, surely the robot should have done a little better?
I guess the moral here is that I’ve probably (too quickly) become used to reaching for these tools
Ha. Know the feeling, from trying to make agents do anything. Obi-Wan is rolling his eyes at both of us.