TL;DR: LLMs are just mimicking natural language and conversation. Fact checking and healthy skepticism is not part of their model. For example they can be easily tricked into advocating conspiracy theories, like a fake moon landing. Google Bard is even stating arithmetic falsehoods like 5*6 != 30
It’s the inability of LLMs to do maths which really ought to give some of its more naive proponents pause for thought. It can’t do what a pocket calculator could do 50 years ago. It can’t do what an abacus could do centuries ago. How is anyone still taking this
cheapexpensive magic trick so seriously?