A LocalLLaMA Reddit post alleges ArtificialAnalysis’s benchmark recalibrations and Intelligence Index disadvantage open-weight models. The post offers no evidence that the changes were intentional or funded by outside parties.
A user post on r/LocalLLaMA claims that ArtificialAnalysis has recalibrated benchmarks when open-weight models approach proprietary U.S. models, making the open-weight models appear weaker. It also criticizes the Intelligence Index for comparing models on tasks the poster considers less relevant than coding.
The post does not provide benchmark data or other evidence to establish that recalibrations were designed to disadvantage open-weight models. Its suggestion that ArtificialAnalysis may be paid to do so is an unsupported allegation in the post.