• A Purdue University study found that the ChatGPT OpenAI bot gave incorrect answers to programming questions half the time.
• However, 39.34% of participants preferred the ChatGPT responses due to their completeness and well-formulated language style.
• The study also showed that users can only identify errors in ChatGPT responses when they are obvious.
• Participants prefer ChatGPT's responses because of its polite language, articulated textbook-style responses, and comprehensiveness.
• The study is intended to complement the in-depth guidance and linguistic analysis of ChatGPT responses.
• The authors note that ChatGPT responses contain more "driving attributes" but do not describe risks as often as Stack Overflow posts.