The use of chatgpt for writing is so widespread in higher ed, it will cause serious problems to those students when entering the workforce.
Lots of fancy stuff is written about how we just have to change the way we teach!, and how we can use chatgpt in lessons! blablabla, but it’s all ignorant of the fact that some things need to be learnt by doing them, and students can’t understand how they hurt their own learning, because they don’t know what they don’t know.
There are a lot of entry level jobs that basically assume new employees know nothing, anyway. Seems like this will just further devalue degrees and emphasize work experience for hiring.
Once a detector is good, you can train a model to adjust its outputs to cause false negatives from the detector. Then the cycle repeats. It’s a cat and mouse game basically.
The only proper way I see is a system that is based ob cryptographic signatures. This ia easier said than done ofc.
It likely won’t be done at scale, but let’s say you are wildly successful and are now in line for a high-value position, where vetting is common. Might look pretty bad if you fabricated your whole thesis. Recently, Bill Ackman basically bullied several schools into firing their head administrators on the pretense of not citing sources correctly in their thesis papers.
Great points. Note: I’m not arguing against it as a concept. I’m just skeptical that it’ll happen, and even if it did, there wouldn’t likely be terrible consequences for the accused, especially as that’s what science is… new facts change the outcome vs choosing an outcome and matching facts to it.
I bet AI detection is going to get a lot better over time.
I doubt it. ChatGPT 3.5 is good enough to rewrite small snippets of text with better phrasing, ChatGPT 4.0 can write a paragraph if given enough support. Good enough as in "the output is indistinguishable from what a human would have written.
Of course you can do even more with the currently available tools - and get found out.
There is a way to make AI generated text detectable: by slightly pushing the output towards a consistent pattern a detector can reliably judge long pieces of text as AI generated.
Imagine if the AI is biased towards consecutive words starting with consecutive letters of the alphabet (e.g. “a blue car” instead of “a navy vehicle”.). Not strongly biased, but enough so that when there are 1000 words you can look at the probability of consecutive words starting with consecutive letters of the alphabet and get a clear result.
There are two problems though: this only works with proprietary systems and only with long texts.
Yes, but at some point it doesn’t matter. The AI is trained to replicate human writing. There will be a point where it becomes so good that the result is a perfect replica, where it is indistinguishable from human text. I.e. even a perfect detector will not be able to confidently declare it as AI written, not ever. Because there is no difference.
By that logic, we shouldn’t have to teach kids to walk, because they’ll be able to strap on an exoskeleton or sit in a floating chair. Heck, we will be able to make Dune style suits and never have to teach them to control their poopage.
It has been well documented that the act of hearing the letter, thinking about the letter and doing a physical motion to create the letter provides better connections for the learning and retaining.
Same for writing full cursive words. It will get dropped totally at some point, hopefully future generations always have OCR to read new found historic manuscripts.
Schools have moved to keyboarding skills and it has an impact on learning.
If all the knowledge you have in your society can be memorized and recited, writing it down means it can be changed.
On the other hand, if you have a society where you know of that there are over 500,000 types of beetles, it might be a better idea to come up with a way to record that information without memorization.
Just because an idea is new/old doesn’t mean it’s good/bad.
But over time looks like the snake eating it’s own tail as AI iterates over everything. Someone will have to create fuzzy AI to dilute the writing down.
When I was a kid people said the same about typing, homework has to be handwrittena because no boss will ever accept a typed report.
We had the same when media studies became a lesson, everyone freaking out that kids learning to watch TV is stupid but of course that’s not what they’re getting taught - media literacy turned our to be a hugely important subject even for those that don’t go on to work in the huge and ever growing media sector.
Teaching kids to use AI tools effectively is the same, you hear it and imagine ‘they put homework prompt into chatGPT and hand in the output’ it’s the same as imagining media studies as being nothing more than watching TV. AI is going to be an ever more present and useful tool in our lives so kids need to learn how to leverage and utilize it or they’ll be at a huge disadvantage.
You can’t hold back time by denying your kid a full education, they need to know how to effectively use the tools everyone else will be using.
The younger kids are using it as well, it’s a problem starting at an earlier age. I don’t see how chat gtp is gonna help those kids learn. AI sellers want us to think differently. But like silicon valley, their kids are not gonna be using it. Sell it to the poor schools as the future!
The use of chatgpt for writing is so widespread in higher ed, it will cause serious problems to those students when entering the workforce.
Lots of fancy stuff is written about how we just have to change the way we teach!, and how we can use chatgpt in lessons! blablabla, but it’s all ignorant of the fact that some things need to be learnt by doing them, and students can’t understand how they hurt their own learning, because they don’t know what they don’t know.
There are a lot of entry level jobs that basically assume new employees know nothing, anyway. Seems like this will just further devalue degrees and emphasize work experience for hiring.
Yeah, we don’t need higher education, just low skilled workers. That’ll sort things out. /s
I bet AI detection is going to get a lot better over time.
I wonder if there’s going to be retrospective testing of theses as time goes on.
Could really damage some careers down the line.
Edit: guys, retrospective testing means it was done later (i.e. with a more up to date AI detector).
Once a detector is good, you can train a model to adjust its outputs to cause false negatives from the detector. Then the cycle repeats. It’s a cat and mouse game basically.
The only proper way I see is a system that is based ob cryptographic signatures. This ia easier said than done ofc.
Yeah but if your wrote your thesis in 2024, and the detector is run on it in 2026…
You’re probably busted.
It’s not like you’ll re-write your thesis with every major ChatGPT release.
Are you expecting that the for-profit college will go back and retroactively rescind degrees? What’s the end-game for re-running the thesis?
It likely won’t be done at scale, but let’s say you are wildly successful and are now in line for a high-value position, where vetting is common. Might look pretty bad if you fabricated your whole thesis. Recently, Bill Ackman basically bullied several schools into firing their head administrators on the pretense of not citing sources correctly in their thesis papers.
It could be a new level added to the peer review of work. Nothing to do with the university. Just “other professionals”.
A thesis isn’t just an exam, it’s a real scientific paper.
And usually claims is contents as fact, which can be referenced by others as fact.
And absolutely should be open to scrutiny so long as it is relevant.
Great points. Note: I’m not arguing against it as a concept. I’m just skeptical that it’ll happen, and even if it did, there wouldn’t likely be terrible consequences for the accused, especially as that’s what science is… new facts change the outcome vs choosing an outcome and matching facts to it.
I doubt it. ChatGPT 3.5 is good enough to rewrite small snippets of text with better phrasing, ChatGPT 4.0 can write a paragraph if given enough support. Good enough as in "the output is indistinguishable from what a human would have written.
Of course you can do even more with the currently available tools - and get found out.
There is a way to make AI generated text detectable: by slightly pushing the output towards a consistent pattern a detector can reliably judge long pieces of text as AI generated.
Imagine if the AI is biased towards consecutive words starting with consecutive letters of the alphabet (e.g. “a blue car” instead of “a navy vehicle”.). Not strongly biased, but enough so that when there are 1000 words you can look at the probability of consecutive words starting with consecutive letters of the alphabet and get a clear result.
There are two problems though: this only works with proprietary systems and only with long texts.
If something was written by V3 and then published, that text doesn’t get updated every time a new version of chatGPT comes out.
The text isn’t dynamic.
Yes, but at some point it doesn’t matter. The AI is trained to replicate human writing. There will be a point where it becomes so good that the result is a perfect replica, where it is indistinguishable from human text. I.e. even a perfect detector will not be able to confidently declare it as AI written, not ever. Because there is no difference.
Or we’re going the other way and just accept it as a tool for performing tasks that would otherwise take too much time.
Granted that it makes the problem of teaching students the basics even more important.
By that logic, we shouldn’t have to teach kids to walk, because they’ll be able to strap on an exoskeleton or sit in a floating chair. Heck, we will be able to make Dune style suits and never have to teach them to control their poopage.
There’s no growth without struggle.
Writing is not similar to walking. It’s more like cursive. Perhaps writing every word will seem old fashioned someday?
I know that I learn better when I write things down on paper.
https://www.scientificamerican.com/article/a-learning-secret-don-t-take-notes-with-a-laptop/
So do I.
It has been well documented that the act of hearing the letter, thinking about the letter and doing a physical motion to create the letter provides better connections for the learning and retaining. Same for writing full cursive words. It will get dropped totally at some point, hopefully future generations always have OCR to read new found historic manuscripts. Schools have moved to keyboarding skills and it has an impact on learning.
https://www.weforum.org/agenda/2019/06/wait-what-new-research-says-internet-use-is-killing-your-memory/#:~:text=That’s the main takeaway from new research by,technologyso ubiquitous that opting out is nearly unimaginable.
Funny enough, this used to be an argument made against relying on writing.
And at the time it was true.
If all the knowledge you have in your society can be memorized and recited, writing it down means it can be changed.
On the other hand, if you have a society where you know of that there are over 500,000 types of beetles, it might be a better idea to come up with a way to record that information without memorization.
Just because an idea is new/old doesn’t mean it’s good/bad.
Things have to be judged on their own merits.
But over time looks like the snake eating it’s own tail as AI iterates over everything. Someone will have to create fuzzy AI to dilute the writing down.
When I was a kid people said the same about typing, homework has to be handwrittena because no boss will ever accept a typed report.
We had the same when media studies became a lesson, everyone freaking out that kids learning to watch TV is stupid but of course that’s not what they’re getting taught - media literacy turned our to be a hugely important subject even for those that don’t go on to work in the huge and ever growing media sector.
Teaching kids to use AI tools effectively is the same, you hear it and imagine ‘they put homework prompt into chatGPT and hand in the output’ it’s the same as imagining media studies as being nothing more than watching TV. AI is going to be an ever more present and useful tool in our lives so kids need to learn how to leverage and utilize it or they’ll be at a huge disadvantage.
You can’t hold back time by denying your kid a full education, they need to know how to effectively use the tools everyone else will be using.
The younger kids are using it as well, it’s a problem starting at an earlier age. I don’t see how chat gtp is gonna help those kids learn. AI sellers want us to think differently. But like silicon valley, their kids are not gonna be using it. Sell it to the poor schools as the future!