Are you suggesting that these open problems in mathematics were in fact solved by someone who did not take any prize money for them or claim any credit, unbeknownst to the entire mathematical community, and the AI stole these secret solutions? Because in order for these solutions to be stolen that would need to be the scenario.
I am suggesting that someone was in the process of finalising publication of papers which might have asserted these. Papers such as these can take more than a year as a draft paper.
Draft papers are often made public for gasppeer review
Many of which were long standing problems. Not insignificant ones either: many computer science papers are now invalid because they based on the assumption that ETH is true - now proven false!
It’s highly inconceivable that all these problems had unpublished drafts waiting to be published all at the same time. If only one had been solved by a human it would be the biggest maths news of the decade.
Can you can give specific details about who specifically was robbed and what draft paper specifically was stolen? (Note the at OpenAI recently dumped nearly 300 new results so we’re talking about a lot of draft papers stolen here.)
There have been accusations by mathematicians that OpenAI used their (non-public, but fed to OpenAIs LLM) methods. It would have been very possible to take what they already did and throw as much compute as they had available at it as soon as the hard parts were done to race ahead at the final stretch.
LLMs fail badly at trying to do original research. There was a study where 4 not-yet published papers were used - they gave the LLM all the data the researchers had at the beginning of the study. The LLMs were not successful at reproducing anything of it.
These things are not intelligent. Just because they can remix existing content does not mean they have creativity. And they miss the entire “physicality”-aspect of human existence, which is a central part of how intelligence develops - by interacting with the world and creating an internal model of how it works. They do not have a sense of self - a bunch of matrix multiplication will never achieve this.
They can’t be creative, because for creativity (and therefor intelligence - these two things go hand in hand) you must be able to have thoughts that have never been thought in a specific context. All these transformer models do is to remix existing thoughts - this looks a bit like intelligence, but the contained data can never be expanded outside of training a new model at a large expense. Intelligence also means to be able to learn and adapt - outside of creating a text file where LLMs can store their non-original output and reading it again, they do not have this capability, especially the “adaptation” part.
Do not humanize these mathematical constructs. This thinking is what got us into the current mess to begin with.
I personally like the technology aspect of Transformer Models a lot! But what is done with it is not in the interest of humanity - at all. Just this morning we all were able to read in the news that Anthropic uses its LLM to do a “Minority Report” and contact the police when their LLM, which is being used to scrape socials and categorize people depending on how much “Threat” they pose, tells them someone might do something illegal in the future.
This is the real usage of this technology. We are nearing a future where our every step, action, word, and even thoughts in some cases (through the wonders of profiling) are ingested by one of these things, and we will get sorted into bins according to threat level and how much money we can provide them with. Tip your toe over the line by saying that this sucks ass, and find yourself in your friendly neighbourhood reeducation gulag.
If it was only Navier-Stokes I would agree. Now it has produced significant results for hundreds of high profile problems - many of which would be Fields medal worthy if solved by a human. It’s vanishingly unlikely that all of these already had unpublished solutions waiting.
I’m not trying to say that LLMs are on the whole good for humanity. I agree with you that they’re not. And I’m not trying to argue that OpenAI never steals intellectual property. Clearly they do.
But these mathematical problems were solved by OpenAI’s models. That much is indisputable. There was nothing in the training data that could have given them the solutions.
If you feed them the approach the mathematicians were using, they for sure can solve it! It has never been published what source material their LLM was provided with. This is the equivalent of someone telling you a result, but never telling you how they got the information needed to achieve it in the first place.
There is value in this technology. But we should do out best to not conflate remixing shit with intelligence - these things are not the same at all. LLMs are more like the proverbial infinite room of monkeys with typewriters, with the very important restriction that these monkeys can never type something that resembles an original thought.
If you feed them the approach the mathematicians were using, they for sure can solve it!
The solutions published by openAI contain techniques that have been reviewed by the mathematical community and determined to be novel. Maybe someone had used the technique before, but then wouldn’t they have published their solution or spoken up about openAI stealing their preprint?
Yes, but only for one result out of 275-ish, and as far as I understand it, the AI proof contained a lot more than their existing research. Failing to credit past work is an issue, and could easily be argued as theft, but this isn’t good evidence that AI cannot generate proofs that contain more than just stolen material.
I doubt they stole the results of quasi Riemann hypothesis, unique games conjecture and exponential time hypothesis.
Doubt all you like. But the idea a company stole something is hardly controversial or unlikely.
Only if that thing exists to steal in the first place. If it was stolen the people working on it would have made a claim, no?
Are you suggesting that these open problems in mathematics were in fact solved by someone who did not take any prize money for them or claim any credit, unbeknownst to the entire mathematical community, and the AI stole these secret solutions? Because in order for these solutions to be stolen that would need to be the scenario.
I am suggesting that someone was in the process of finalising publication of papers which might have asserted these. Papers such as these can take more than a year as a draft paper.
Draft papers are often made public for gasp peer review
And they robbed that person.
Yes
Many of which were long standing problems. Not insignificant ones either: many computer science papers are now invalid because they based on the assumption that ETH is true - now proven false!
It’s highly inconceivable that all these problems had unpublished drafts waiting to be published all at the same time. If only one had been solved by a human it would be the biggest maths news of the decade.
Can you can give specific details about who specifically was robbed and what draft paper specifically was stolen? (Note the at OpenAI recently dumped nearly 300 new results so we’re talking about a lot of draft papers stolen here.)
There have been accusations by mathematicians that OpenAI used their (non-public, but fed to OpenAIs LLM) methods. It would have been very possible to take what they already did and throw as much compute as they had available at it as soon as the hard parts were done to race ahead at the final stretch.
LLMs fail badly at trying to do original research. There was a study where 4 not-yet published papers were used - they gave the LLM all the data the researchers had at the beginning of the study. The LLMs were not successful at reproducing anything of it.
These things are not intelligent. Just because they can remix existing content does not mean they have creativity. And they miss the entire “physicality”-aspect of human existence, which is a central part of how intelligence develops - by interacting with the world and creating an internal model of how it works. They do not have a sense of self - a bunch of matrix multiplication will never achieve this.
They can’t be creative, because for creativity (and therefor intelligence - these two things go hand in hand) you must be able to have thoughts that have never been thought in a specific context. All these transformer models do is to remix existing thoughts - this looks a bit like intelligence, but the contained data can never be expanded outside of training a new model at a large expense. Intelligence also means to be able to learn and adapt - outside of creating a text file where LLMs can store their non-original output and reading it again, they do not have this capability, especially the “adaptation” part.
Do not humanize these mathematical constructs. This thinking is what got us into the current mess to begin with.
I personally like the technology aspect of Transformer Models a lot! But what is done with it is not in the interest of humanity - at all. Just this morning we all were able to read in the news that Anthropic uses its LLM to do a “Minority Report” and contact the police when their LLM, which is being used to scrape socials and categorize people depending on how much “Threat” they pose, tells them someone might do something illegal in the future.
This is the real usage of this technology. We are nearing a future where our every step, action, word, and even thoughts in some cases (through the wonders of profiling) are ingested by one of these things, and we will get sorted into bins according to threat level and how much money we can provide them with. Tip your toe over the line by saying that this sucks ass, and find yourself in your friendly neighbourhood reeducation gulag.
If it was only Navier-Stokes I would agree. Now it has produced significant results for hundreds of high profile problems - many of which would be Fields medal worthy if solved by a human. It’s vanishingly unlikely that all of these already had unpublished solutions waiting.
I’m not trying to say that LLMs are on the whole good for humanity. I agree with you that they’re not. And I’m not trying to argue that OpenAI never steals intellectual property. Clearly they do.
But these mathematical problems were solved by OpenAI’s models. That much is indisputable. There was nothing in the training data that could have given them the solutions.
If you feed them the approach the mathematicians were using, they for sure can solve it! It has never been published what source material their LLM was provided with. This is the equivalent of someone telling you a result, but never telling you how they got the information needed to achieve it in the first place.
There is value in this technology. But we should do out best to not conflate remixing shit with intelligence - these things are not the same at all. LLMs are more like the proverbial infinite room of monkeys with typewriters, with the very important restriction that these monkeys can never type something that resembles an original thought.
The solutions published by openAI contain techniques that have been reviewed by the mathematical community and determined to be novel. Maybe someone had used the technique before, but then wouldn’t they have published their solution or spoken up about openAI stealing their preprint?
They have spoken up! They accused OpenAI of accessing their chats: https://futurism.com/artificial-intelligence/drama-openai-supposed-mathematical-breakthrough.
Yes, but only for one result out of 275-ish, and as far as I understand it, the AI proof contained a lot more than their existing research. Failing to credit past work is an issue, and could easily be argued as theft, but this isn’t good evidence that AI cannot generate proofs that contain more than just stolen material.