ChatGPT generates cancer treatment plans that are full of errors — Study finds that ChatGPT provided false information when asked to design cancer treatment plans::Researchers at Brigham and Women’s Hospital found that cancer treatment plans generated by OpenAI’s revolutionary chatbot were full of errors.
I agree, but only because they used GPT 3.5 and not 4. Not that I think 4 would have been perfect or that you should follow medical advice from LLMs right now, but it would have been much more accurate.
I thought it was 4 before looking into it. It seems they ran the experiment in the same month GPT-4 was released, that’s unfortunate.
Yeah what’s interesting is it was just published this week even though they did the tests in April. April is like 100 AI years ago.
That’s actually a short time for peer-reviewed work. Most things being published now, unless they’re in pre-print servers, are results from studies that likely started at least 6 months ago.