To test ChatGPT's general abilities and knowledge in this area, the system was asked a large number of software programming questions, more than half of which it got wrong.

Artificial Intelligence ChatGPT Answers Programming Questions Incorrectly 52% of the Time: Study To make matters worse, programmers in the study would often overlook the misinformation.

ChatGPT Answers to Computer Programming Questions More Than 50% Inaccurate, Study Shows The findings shed light on the inaccuracies inherent in ChatGPT's responses.