ekZepp to [email protected]English • 4 months agoStudy Finds That 52 Percent of ChatGPT Answers to Programming Questions Are Wrongfuturism.comexternal-linkmessage-square139arrow-up1628arrow-down119
arrow-up1609arrow-down1external-linkStudy Finds That 52 Percent of ChatGPT Answers to Programming Questions Are Wrongfuturism.comekZepp to [email protected]English • 4 months agomessage-square139
minus-square@[email protected]linkfedilinkEnglish-1•4 months agoWe need a comparison against an average coder. Some fucking baseline ffs.
minus-square@[email protected]linkfedilinkEnglish8•4 months ago“Self driving cars will make the roads safer. They won’t be drunk or tired or make a mistake.” Self driving cars start killing people. “Yeah but how do they compare to the average human driver?” Goal post moving.
minus-square@[email protected]linkfedilinkEnglish1•4 months agoThe issue is the powers that be arent comparing chatgpt to a reference manual. Rather another human being.
minus-square@[email protected]linkfedilink5•4 months agoWhy would we compare it against an average coder? ChatGPT wants to be a coding aid/reference material. A better baseline would be the top rated answer for the question on stackoverflow or whether the answer exists on the first 3 Google search results.
minus-square@[email protected]linkfedilinkEnglish1•4 months agoCause people arent looking at chatgpt as an accurate simple code generator, rather a junior dev.
We need a comparison against an average coder. Some fucking baseline ffs.
“Self driving cars will make the roads safer. They won’t be drunk or tired or make a mistake.”
Self driving cars start killing people.
“Yeah but how do they compare to the average human driver?”
Goal post moving.
The issue is the powers that be arent comparing chatgpt to a reference manual. Rather another human being.
Why would we compare it against an average coder?
ChatGPT wants to be a coding aid/reference material. A better baseline would be the top rated answer for the question on stackoverflow or whether the answer exists on the first 3 Google search results.
Or a textbook’s explanation
Cause people arent looking at chatgpt as an accurate simple code generator, rather a junior dev.