Apple study exposes deep cracks in LLMs “Reasoning” capabilities

[MevetS]

Yes this is a very good paper. And reinforces that fact that these systems are not intelligent.

There is already a discussion here:

Can AI / LLM really reason - view from Apple Engineers

I stumbled across this article I thought some of you here would find interesting. It is based around the findings from Apple researchers who asked the question “can LLMs really reason?” (TL;DR the conclusion was no - not yet). The paper itself is academic and very mathematical (way beyond my capabilities) but I think there are many here who would understand and enjoy it. Here is the original article: An interesting thread on X.com: x.com The actual paper: https://arxiv.org/pdf/2410.05229

---

@geoffaire

This paragraph supports my stance that current “AI” products aren’t actually AI as they simply use pattern matching, i.e. they follow programming.

This is a textbook example of AI, a process done by a computer that would be considered intelligent if done by a human. Again we agree that LLMs are not intelligent.

And I would not be so dismissive of “pattern matching”. While there is much that we do not know about human intelligence (and biological based intelligence in general), it does appear that pattern matching is an important component of such systems. It is of course the “processing modules” after pattern matching has occurred that differentiate biological based intelligence from the current state of the art of AI systems.