Hacker Newsnew | past | comments | ask | show | jobs | submit | pertymcpert's commentslogin

Why would reallocating resources make a single inference run worse in quality?

Isn’t the idea that they’re limiting the amount of gpu time normal users get to spend on the “thinking” portion of their query?

I think that’s the claim in the post, that even though no one can see the true chain of thought, that even the “thinking” text that does get exposed to the user is shorter given the same prompts over time. Not saying it’s true but I think that’s the claim. I’ve personally never noticed the alleged “nerfing” with my enterprise use at work or my subscription use at home which is only during off hours.


Yes but it's their own design, not licensing Arm cores.

It's a custom Fujitsu micro-architecture.

It's ARM with extensions.

Previous generation of this was a monstrosity based on a custom SPARC with ARM front end grafted on top, supporting the version of SPARC extensions they created backported to ARM as a new extension.

So there's a good chance that it's still an optimized half-SPARC inside.


It's not ok if it uses resources that could be better spent elsewhere. At 3% share what do you expect them to do?


I feel like they failed upwards into the right strategy. I doubt it was deliberate and not because of the failure of their foundation models to decent.


> No, Meta just amplified

No. "Just" is understating the effect.


I tested all recent Opus versions and 4.6 and 4.7 were both fine FWIW. Seems 4.8 is when something started to go wrong.


That seems about right. 4.8 is like in between 4.6 and 5 in terms of capability and language and they are all pretty close honestly. I just default to using Opus 5 for a coding agent that I don't interact with and I like driving with Opus 4.6 or Fable. Fable thinks too much though. Fable is like that engineer on your team that will over-engineer the shit out of something if you let them. Fable was like, "Here are 34 yaks, which shall we shave first <hands rubbing together>" and I was like can't we just... write the script first and then decide of any of these poor yaks need shaving?


Meta employees reading this: whether you work in Reality Labs, ads, operations, ML compiler, LLMs, marketing, whatever. You're all complicit in the harm. Remember that.


Even those working on React? Asking for a friend


Even bigger harm since Vercel/nextjs takeover


Even React.


Absolutely! :D


You say that like what they were doing was a bad thing. It was a feature.


> So either the manufacturer-supplied originals are more dangerous than replacement tires

There's 3 main components to tire performance: efficiency, grip and longevity. OEM tires optimize for the first. They can compromise on grip and longevity. Most often I've experienced is the latter. So yes, OEM tires are "worse" in some aspects as replacements.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: