stopthatgirl7 to Technology • 1 year agoEverything Made By an AI Is In the Public Domaindoctorow.medium.commessage-square144fedilinkarrow-up1702arrow-down134file-text
arrow-up1668arrow-down1external-linkEverything Made By an AI Is In the Public Domaindoctorow.medium.comstopthatgirl7 to Technology • 1 year agomessage-square144fedilinkfile-text
minus-square@illusoryMechanistlinkEnglish3•1 year agoDoes this mean we can, indeed, train AI on ChatGPT/other AI outputs?
minus-squareNatanaellinkfedilinkEnglish9•1 year agoFYI there’s studies showing that repeatedly training ML on ML outputs degrades quality sharply after 4-5 cycles
minus-square@Prager_UlinkEnglish0•1 year agoThat is a used method for training other LLMs, I believe OpenAssistant did this.
minus-squareNatanaellinkfedilinkEnglish2•1 year agoIt does after 4-5 cycles yeah, built in algorithmic biases gets amplified to a degree that it breaks the model
Does this mean we can, indeed, train AI on ChatGPT/other AI outputs?
FYI there’s studies showing that repeatedly training ML on ML outputs degrades quality sharply after 4-5 cycles
What does ml stand for
Machine Learning in this context
That is a used method for training other LLMs, I believe OpenAssistant did this.
Doesn’t that break the models?
It does after 4-5 cycles yeah, built in algorithmic biases gets amplified to a degree that it breaks the model