Published: May 20, 2025
65
119
3.1k

LLMs have come a long way from being "stochastic parrots"

Image in tweet by Dimitris Papailiopoulos

@DimitrisPapail What if... they're still stochastic parrots? (Equivalently, what if we're just stochastic parrots?)

@roydanroy Indeed

@DimitrisPapail Nope, still are Markov chains

@aethrvmn Aren’t we all

@DimitrisPapail they are good parrots, sir

@DimitrisPapail stochastic math olympiad winners

@DimitrisPapail "LLMs do not reason."

@DimitrisPapail To parrots good at math

@DimitrisPapail "LLMs are no more intelligent than a house cat" ...Meanwhile, a year later...

@DimitrisPapail >Me when the LLM that was trained on the internet. Lietrally exabytes worth of data human would learn in a thousand lifetimes. >Computation, memory speeds trillion of times more >Is able to compete in a math competition literally meant for 17 year olds, and still not crush it.

@DimitrisPapail wait for the score on USAMO 2026 before jubilating too much though 😃😂

@DimitrisPapail Gary Marcus' cat is still way smarter!

@DimitrisPapail Intelligent regex machines are now grepping intelligence.

@DimitrisPapail LLMs are merely stochastic parrots.

@DimitrisPapail Parrots are very smart creatures man

@DimitrisPapail They are still stochastic... And parrots are probably more "intelligent". We just need different terminology to avoid confusion.

@DimitrisPapail Oh, they know a lot of stuff outside of their training data? Cool! ;)

@DimitrisPapail They're still stochastic parrots. This proves nothing.

@DimitrisPapail deterministic pigeons in shambles

@DimitrisPapail Lot of silence from that crowd lately!

@DimitrisPapail and people still will not admit that they reason.

@DimitrisPapail >I taught my parrot French so now it's not a parrot anymore.

@DimitrisPapail They're still parrots but great ones

@DimitrisPapail They’re still limited to whatever can be squeezed out of their training data, obvs.

@DimitrisPapail or... Humans have begun to realise that most of their behaviors are an example of them acting like "stochastic parrots" too.

@DimitrisPapail "a long way"

Image in tweet by Dimitris Papailiopoulos

@DimitrisPapail I just tried a pretty simple logic problem I created on o3, and it got it wrong. And yet they can do advanced math problems. 🤔

@DimitrisPapail No, they haven't. Like, at all. Lol

@DimitrisPapail No this is still that you fucking rube

@DimitrisPapail Stochastic pirated book referring parrots

@DimitrisPapail question is WHY it is not 100% how it even happens that it knows everything and can't solve definitely solvable high school math problems which are routinely solved by kids

@DimitrisPapail No, they just learned what to parrot better. theyre still just good guessers, no matter how good the guesses get

@DimitrisPapail We’re just stochastic parrots and they’re an extension of us.

@DimitrisPapail @grok where to get the source? I'm interested to see

@DimitrisPapail We need to start judging "it" not only by what it is but what it does. Yes they are "stochastic parrots" but pretty fancy once that can do tons of stuff that pretty much no human can do (in this time).

Share this thread

Read on Twitter

View original thread

Navigate thread

1/36