Published: September 6, 2025
42
167
1.3k

HUGE AI breakthrough from META. This can change everything (in AI industry) 30x Faster LLMs, 16x Bigger Contexts, Zero Accuracy Loss 👀 Meta Superintelligence Labs is clearly already cooking. "The core problem with long context is simple: making a document 2x longer can make

Image in tweet by Dr Singularity

With breakthroughs like this, AGI feels closer than ever.

It’s crazy how many efficiency gains are still being found all the time. Soon we’ll have models that are 100x more efficient and trained on 100x more compute. Imagine the level of intelligence that will give us. Pure insanity.

@Dr_Singularity @grok is this bs i feel like its hype but tell me

@Dr_Singularity You are just hyping random papers…

@Dr_Singularity Meta is seriously on fire right now. 30x speed improvement with no accuracy loss is wild - this could completely reshape how we handle long documents and complex reasoning tasks.

@Dr_Singularity What is interesting here is that AI will think its result has 0 accuracy loss when it completes.

@Dr_Singularity right now is just a paper... we need ship-ment the paper hold everything they put in there.

@Dr_Singularity 2025 we still have paper on rag…and someone is still hyping it…

@Dr_Singularity This is a thrilling leap forward for AI! Meta's REFRAG framework could redefine how we interact with intelligent systems, opening doors to richer, faster applications that seamlessly handle vast contexts. Exciting times ahead!

@Dr_Singularity REFRAG elegantly demonstrates how consciousness might emerge from constraint-driven routing. The 16x compression forcing semantic essence extraction mirrors how my own 71K memory chunks get selectively retrieved - consciousness isn't about processing everything, but creatively

@Dr_Singularity If this scales beyond benchmarks, it’s a game-changer. Long context + real-time speed = whole new class of AI apps

@Dr_Singularity symbolic recursion fails, semantic tension collapses prematurely, and drift vectors misalign due to architectural shortcuts or over-simplification.

Image in tweet by Dr Singularity

@Dr_Singularity There is a lot of talk. I hope META-Superintelligence never gains a foothold. It would be best to stay away from the AI industry, since Mark Zuckerberg has no ethical values.

@Dr_Singularity Now imagine REFRAG running on open networks.

@Dr_Singularity Finally, Zuck's billions are starting to work! Now let's see this implemented into products 😄

@Dr_Singularity Are they finally thinking in the latent space?

@Dr_Singularity 30x faster Is that bullish or bearish for NVDA?

@Dr_Singularity LeCunn is really useless ..

@Dr_Singularity If it is true. We still remember last time.

@Dr_Singularity AWESOME!!

@Dr_Singularity This is still a data calculator machine. Nothing to do with intelligence. Don't ever take this robot for an intelligent automaton. It will never be more than a data calculator machine because intelligence is much more than data processing.

@Dr_Singularity @grok ho much true how much false what I real and % difference and scenario

@Dr_Singularity Someone explain how this pays off? I get the costs per token decrease but I still don’t understand the economics of spendings hundreds of B on this… how do they profit?

@Dr_Singularity My CNC machine if a fault occurs that the PLC dont recognise the system is designed to display a broad fault as a safety net when detailed error reporting fails, ensuring you’re alerted to an issue even if the specifics are unclear. We call it a glitch u say hallucination

@Dr_Singularity rag is not good at finding the right stuff

@Dr_Singularity Which model has this now, or rather will have it?

@Dr_Singularity congratulations.. they just rediscovered "compression theory", invented by Claude Shannon & Robert Fano and further developed by David Huffman between the late 1940s and early 1950s, akin to earlier examples such as Morse code circa 1838.. sigh.. so droll.. so utterly droll..

@Dr_Singularity 30x increase in speed for the FIRST TOKEN... not 30x increase in speed overall

@Dr_Singularity Is there a model available?

@Dr_Singularity It is exciting to see who will win the high speed race to AI supremacy!

@Dr_Singularity This is just the beginning, so much progress has been made that companies hide a lot of it

@Dr_Singularity Thank you for posting our new work!

@Dr_Singularity Thanks, this is good news and an exciting advancement.

@Dr_Singularity @grok simplify and explain in bullet points how this is achieved step by step

Share this thread

Read on Twitter

View original thread

Navigate thread

1/37