2
Terence Tao (@[email protected])
mathstodon.xyzAs another minor experiment, I gave o1 the first half of my recent blog post https://terrytao.wordpress.com/2024/09/03/planar-point-sets-with-forbidden-four-point-patterns-and-few-distinct-distances/ , where I summarized the state of progress on a problem of Erdos that I was able to solve, and asked the model to find the missing ingredient needed to convert the previous partial progress on the problem into a full solution. Here the result was mildly disappointing: https://chatgpt.com/share/66e718ca-4714-800e-8a26-38b972386c85 . Essentially the model proposed the same strategy that was already identified in the most recent work on the problem (and which I restated in the blog post), but did not offer any creative variants of that strategy. Overall I feel that while there is some ability to randomly generate some creative strategies, this aspect of LLM tools is still rather weak. (2/2)
Just that one minor little aspect of LLMs is still… oh, just a little weak. LLMs aren’t just a complete scam. Just this one little aspect… needs a tiny bit of workshopping.