Open A.I did the Unthinkable

Credibility score: 51/100 โ€” Mixed Credibility. Several questionable claims detected. Watch with healthy skepticism.

BSmeter analyzed "Open A.I did the Unthinkable" and rated it 51/100 for credibility (a BS score of 49/100 โ€” mixed credibility), on 2026-10-14. Its weakest claim โ€” "OpenAI claims success on 4,000 unsolved problems using cherry-picked results" โ€” scored 20/100 and was flagged as cherry-picked. 14 claims were checked against the video transcript. Scores are produced by BSmeter's AI analysis of the transcript, not independent human verification.

Of 14 claims analyzed: 3 scored under 40, 7 between 40 and 69, and 4 at 70 or above.

Claims analyzed

OpenAI dropped 722 papers via a model no one else can use โ€” No Frame (75/100)

At 0:00

Straight facts on the GitHub drop. No fluff, just the numbers ๐Ÿ“ˆ

Why this score: The speaker is citing specific dates and quantities regarding the OpenAI/math repository. It's a direct reporting of an event without heavy-handed emotional framing.

Original quote: โ€œWe have to look at what Open AI just did to the mathematics community. On October 6th, Open AI dropped 722 math papers onto GitHub in a public repository called Open AI/math. All of them were written by a model that nobody outside the company can currently use.โ€

OpenAI provided Lean proofs for 235 math families โ€” No Frame (75/100)

At 0:16

Just technical details about the Lean proofs. No tricks here ๐Ÿ› ๏ธ

Why this score: The speaker is explaining the technical structure of the dataset (families and Lean proofs). It's descriptive and factual rather than manipulative.

Original quote: โ€œThese papers are grouped into 372 families, which include a main result and its associated spin-offs. For 235 of those families, Open AI provided proofs in Lean, which is a programming language that allows a computer to double-check every single step.โ€

OpenAI claims success on 4,000 unsolved problems using cherry-picked results โ€” Cherry-Picked (20/100)

At 0:31

They only showed the 'significant' wins and ignored the 4,000 failures. That's not a breakthrough, that's a highlight reel ๐Ÿ’

Why this score: The speaker admits they only kept the 'significant results,' which is a classic move to hide the vast majority of data that didn't work out.

Original quote: โ€œOpen AI claims this model easily passed all their usual math tests, so they simply pointed it at around 4,000 real unsolved problems. They only kept the significant results.โ€

Sources: AI Math Proofs: How Anthropic and OpenAI Results Actually Compare | MindStudio, OpenAI's 377 Math Claims Spark Verification Fight [2026], Math Results: OpenAI Posts Hundreds More, a Surprising Risk

Listing a rapid-fire sequence of solved math problems to build hype โ€” Confidence Mismatch (45/100)

At 2:40

Stacking unsolved conjectures like they're solved chores. That's not math, that's a highlight reel of impossible wins ๐Ÿšฉ

Why this score: The speaker presents these massive mathematical breakthroughs in a rapid-fire list, creating an artificial sense of momentum and inevitability that ignores the actual complexity of mathematical proof.

Original quote: โ€œIt claimed the Kakeya problem in three and four dimensions. It settled a version of Hilbert's 10th problem from the year 1900. It proved Catalan's constant is impossible to write as a fraction. It knocked down the decades-old MEI conjecture in every dimension.โ€

OpenAI's transparency is a half-measure, hiding the real data ๐ŸŽญ โ€” Missing Context (45/100)

At 4:50

They're giving you the 'summary' but hiding the actual receipts. It's a shell game of transparency ๐Ÿ•ต๏ธ

Why this score: The speaker highlights the gap between what OpenAI shared and what they withheld, implying a strategic lack of transparency without explaining the technical or competitive reasons why those specific details were kept secret.

Original quote: โ€œOpenAI shared the average compute and reasoning summaries, but refused to release the prompts or the per problem results.โ€

Hype-building around a new model release ๐Ÿš€ โ€” Plain Sales Pitch (45/100)

At 5:54

Dropping a name like 'LeChunk' and calling it a 'flagship' is pure marketing energy ๐Ÿคก

Why this score: The segment shifts into promotional mode, using high-energy descriptors for a new product release. It's presenting the existence of 'LeChunk' as a major event without immediate critical context.

Original quote: โ€œMistral just dropped a preview of their new flagship AI model, Mistral Large 4. They are calling it LeChunk.โ€

Using specific benchmark scores to claim superiority ๐Ÿ“Š โ€” No Frame (75/100)

At 6:16

Actually giving me numbers and showing where they fall short. No games being played here โš–๏ธ

Why this score: The speaker provides specific percentage scores and compares them against other models, even acknowledging that it isn't the top performer. This is a direct, data-driven comparison.

Original quote: โ€œOn the Deep Eval coding benchmark, Mistral Large 4 scores around 62%. That puts it slightly ahead of GLM 5.3 and DeepSeek V4 Pro, though Kimiko 3 still leads at 68%.โ€

Comparing Mistral's 3,800 GPUs to OpenAI's 100,000+ via a massive ratio โ€” Cherry-Picked (45/100)

At 6:36

Using a massive '25x difference' to make one look small and the other look like a giant ๐Ÿšฉ

Why this score: He's isolating raw GPU counts to create a dramatic contrast, ignoring that efficiency and architecture matter more than just hardware volume.

Original quote: โ€œMistral trained this model on exactly 3,800 Nvidia Grace Blackwell GPUs inside their own European data centers. Greg Brockman previously stated that GPT-6 Astra was trained on more than 100,000 GPUs. That is a 25 times difference in pure GPU count.โ€

Claiming top models score zero because they 'refuse' tasks โ€” Loaded Language (45/100)

At 7:13

Using 'refuse' to turn a technical limitation into a personality flaw ๐Ÿ’€

Why this score: He's framing model behavior as 'compliance' vs 'capability,' which is a clever way to make the big players look stubborn rather than just different.

Original quote: โ€œThe leading closed models score near zero on these specific tasks because they actively refuse to do them. If one model attempts the task and another outright refuses, the score stops measuring pure capability and starts measuring compliance.โ€

Promoting Anthropic's new model as the ultimate efficiency play โ€” Plain Sales Pitch (50/100)

At 8:25

Ending on a hype-train of 'cheapest and fastest' superlatives ๐Ÿš€

Why this score: He pivots from the technical debate straight into a marketing pitch for Anthropic's new release.

Original quote: โ€œAnthropic just dropped Haiku 5.5. This is their cheapest, fastest, and mostโ€

Uses massive score gaps to highlight superiority โ€” Cherry-Picked (20/100)

At 8:30

Dropping a score that's double the old one is pure drama. ๐Ÿ’

Why this score: While the numbers may be real, highlighting a massive delta in one specific benchmark is designed to make the upgrade feel mandatory.

Original quote: โ€œIt costs roughly 75% less to run than Claude Haiku 4.5. On the GPQA benchmark for knowledge work, Haiku 5.5 scored 1620. The older 4.5 model scored only 735.โ€

Sources: 20 Highest Scoring College Football Games - College Transitions, Race gaps in SAT scores highlight inequality and hinder upward mobility | Brookings, Blowout (sports) โ€” Grokipedia

Claims superiority over a competitor using benchmark data โ€” No Frame (75/100)

At 8:46

Direct comparison. Hard to argue with the math if it's real. ๐ŸŸข

Why this score: The speaker is providing a direct comparison against a specific competitor model using numerical data.

Original quote: โ€œMore importantly, Haiku 5.5 outperforms OpenAI's GPT-6 Luna, which scores 1437.โ€

Uses a massive cost discrepancy to show the 'catch' โ€” Cherry-Picked (20/100)

At 10:00

A $23 difference for one task? That's a hell of a way to sell the 'catch'. ๐Ÿ’

Why this score: Using one specific, highly divergent cost example to illustrate the 'token hungry' nature of the model is a classic way to highlight a weakness.

Original quote: โ€œThe generation cost $1.91 on GPT-6 Luna. The exact same generation cost $24.96 on Haiku 5.5.โ€

Sources: Whatโ€™s the Catch? Uncovering the Hidden Costs Behind โ€œToo Good to Be Trueโ€ Offers, Pricing Discrepancy: Why Customers Leave Before Checkout, Invoice Discrepancies: Types, Causes & How to Resolve Them

OpenAI is 'entirely quiet' while doing a code update โ€” missing context โ€” Missing Context (45/100)

At 10:30

Calling them 'entirely quiet' is a massive reach when they're literally dealing with high-profile AI misconduct reports ๐Ÿšฉ

Why this score: The speaker frames OpenAI as being in a quiet lull, but ignores the heavy lifting they've been doing with safety disclosures and managing 'concerning behavior' reports in the public eye.

Original quote: โ€œOpenAI has been entirely quiet during this run. They are currently doing a 28 days of code updateโ€

See the full analysis with sources and timestamps โ†’