Open A.I did the Unthinkable
Credibility score: 51/100 โ Mixed Credibility. Several questionable claims detected. Watch with healthy skepticism.
BSmeter analyzed "Open A.I did the Unthinkable" and rated it 51/100 for credibility (a BS score of 49/100 โ mixed credibility), on 2026-10-14. Its weakest claim โ "OpenAI claims success on 4,000 unsolved problems using cherry-picked results" โ scored 20/100 and was flagged as cherry-picked. 14 claims were checked against the video transcript. Scores are produced by BSmeter's AI analysis of the transcript, not independent human verification.
Of 14 claims analyzed: 3 scored under 40, 7 between 40 and 69, and 4 at 70 or above.
Claims analyzed
OpenAI dropped 722 papers via a model no one else can use โ No Frame (75/100)
At 0:00
Straight facts on the GitHub drop. No fluff, just the numbers ๐
Why this score: The speaker is citing specific dates and quantities regarding the OpenAI/math repository. It's a direct reporting of an event without heavy-handed emotional framing.
Original quote: โWe have to look at what Open AI just did to the mathematics community. On October 6th, Open AI dropped 722 math papers onto GitHub in a public repository called Open AI/math. All of them were written by a model that nobody outside the company can currently use.โ
OpenAI provided Lean proofs for 235 math families โ No Frame (75/100)
At 0:16
Just technical details about the Lean proofs. No tricks here ๐ ๏ธ
Why this score: The speaker is explaining the technical structure of the dataset (families and Lean proofs). It's descriptive and factual rather than manipulative.
Original quote: โThese papers are grouped into 372 families, which include a main result and its associated spin-offs. For 235 of those families, Open AI provided proofs in Lean, which is a programming language that allows a computer to double-check every single step.โ
OpenAI claims success on 4,000 unsolved problems using cherry-picked results โ Cherry-Picked (20/100)
At 0:31
They only showed the 'significant' wins and ignored the 4,000 failures. That's not a breakthrough, that's a highlight reel ๐
Why this score: The speaker admits they only kept the 'significant results,' which is a classic move to hide the vast majority of data that didn't work out.
Original quote: โOpen AI claims this model easily passed all their usual math tests, so they simply pointed it at around 4,000 real unsolved problems. They only kept the significant results.โ
Sources: AI Math Proofs: How Anthropic and OpenAI Results Actually Compare | MindStudio, OpenAI's 377 Math Claims Spark Verification Fight [2026], Math Results: OpenAI Posts Hundreds More, a Surprising Risk
Listing a rapid-fire sequence of solved math problems to build hype โ Confidence Mismatch (45/100)
At 2:40
Stacking unsolved conjectures like they're solved chores. That's not math, that's a highlight reel of impossible wins ๐ฉ
Why this score: The speaker presents these massive mathematical breakthroughs in a rapid-fire list, creating an artificial sense of momentum and inevitability that ignores the actual complexity of mathematical proof.
Original quote: โIt claimed the Kakeya problem in three and four dimensions. It settled a version of Hilbert's 10th problem from the year 1900. It proved Catalan's constant is impossible to write as a fraction. It knocked down the decades-old MEI conjecture in every dimension.โ
OpenAI's transparency is a half-measure, hiding the real data ๐ญ โ Missing Context (45/100)
At 4:50
They're giving you the 'summary' but hiding the actual receipts. It's a shell game of transparency ๐ต๏ธ
Why this score: The speaker highlights the gap between what OpenAI shared and what they withheld, implying a strategic lack of transparency without explaining the technical or competitive reasons why those specific details were kept secret.
Original quote: โOpenAI shared the average compute and reasoning summaries, but refused to release the prompts or the per problem results.โ
Hype-building around a new model release ๐ โ Plain Sales Pitch (45/100)
At 5:54
Dropping a name like 'LeChunk' and calling it a 'flagship' is pure marketing energy ๐คก
Why this score: The segment shifts into promotional mode, using high-energy descriptors for a new product release. It's presenting the existence of 'LeChunk' as a major event without immediate critical context.
Original quote: โMistral just dropped a preview of their new flagship AI model, Mistral Large 4. They are calling it LeChunk.โ
Using specific benchmark scores to claim superiority ๐ โ No Frame (75/100)
At 6:16
Actually giving me numbers and showing where they fall short. No games being played here โ๏ธ
Why this score: The speaker provides specific percentage scores and compares them against other models, even acknowledging that it isn't the top performer. This is a direct, data-driven comparison.
Original quote: โOn the Deep Eval coding benchmark, Mistral Large 4 scores around 62%. That puts it slightly ahead of GLM 5.3 and DeepSeek V4 Pro, though Kimiko 3 still leads at 68%.โ
Comparing Mistral's 3,800 GPUs to OpenAI's 100,000+ via a massive ratio โ Cherry-Picked (45/100)
At 6:36
Using a massive '25x difference' to make one look small and the other look like a giant ๐ฉ
Why this score: He's isolating raw GPU counts to create a dramatic contrast, ignoring that efficiency and architecture matter more than just hardware volume.
Original quote: โMistral trained this model on exactly 3,800 Nvidia Grace Blackwell GPUs inside their own European data centers. Greg Brockman previously stated that GPT-6 Astra was trained on more than 100,000 GPUs. That is a 25 times difference in pure GPU count.โ
Claiming top models score zero because they 'refuse' tasks โ Loaded Language (45/100)
At 7:13
Using 'refuse' to turn a technical limitation into a personality flaw ๐
Why this score: He's framing model behavior as 'compliance' vs 'capability,' which is a clever way to make the big players look stubborn rather than just different.
Original quote: โThe leading closed models score near zero on these specific tasks because they actively refuse to do them. If one model attempts the task and another outright refuses, the score stops measuring pure capability and starts measuring compliance.โ
Promoting Anthropic's new model as the ultimate efficiency play โ Plain Sales Pitch (50/100)
At 8:25
Ending on a hype-train of 'cheapest and fastest' superlatives ๐
Why this score: He pivots from the technical debate straight into a marketing pitch for Anthropic's new release.
Original quote: โAnthropic just dropped Haiku 5.5. This is their cheapest, fastest, and mostโ
Uses massive score gaps to highlight superiority โ Cherry-Picked (20/100)
At 8:30
Dropping a score that's double the old one is pure drama. ๐
Why this score: While the numbers may be real, highlighting a massive delta in one specific benchmark is designed to make the upgrade feel mandatory.
Original quote: โIt costs roughly 75% less to run than Claude Haiku 4.5. On the GPQA benchmark for knowledge work, Haiku 5.5 scored 1620. The older 4.5 model scored only 735.โ
Sources: 20 Highest Scoring College Football Games - College Transitions, Race gaps in SAT scores highlight inequality and hinder upward mobility | Brookings, Blowout (sports) โ Grokipedia
Claims superiority over a competitor using benchmark data โ No Frame (75/100)
At 8:46
Direct comparison. Hard to argue with the math if it's real. ๐ข
Why this score: The speaker is providing a direct comparison against a specific competitor model using numerical data.
Original quote: โMore importantly, Haiku 5.5 outperforms OpenAI's GPT-6 Luna, which scores 1437.โ
Uses a massive cost discrepancy to show the 'catch' โ Cherry-Picked (20/100)
At 10:00
A $23 difference for one task? That's a hell of a way to sell the 'catch'. ๐
Why this score: Using one specific, highly divergent cost example to illustrate the 'token hungry' nature of the model is a classic way to highlight a weakness.
Original quote: โThe generation cost $1.91 on GPT-6 Luna. The exact same generation cost $24.96 on Haiku 5.5.โ
Sources: Whatโs the Catch? Uncovering the Hidden Costs Behind โToo Good to Be Trueโ Offers, Pricing Discrepancy: Why Customers Leave Before Checkout, Invoice Discrepancies: Types, Causes & How to Resolve Them
OpenAI is 'entirely quiet' while doing a code update โ missing context โ Missing Context (45/100)
At 10:30
Calling them 'entirely quiet' is a massive reach when they're literally dealing with high-profile AI misconduct reports ๐ฉ
Why this score: The speaker frames OpenAI as being in a quiet lull, but ignores the heavy lifting they've been doing with safety disclosures and managing 'concerning behavior' reports in the public eye.
Original quote: โOpenAI has been entirely quiet during this run. They are currently doing a 28 days of code updateโ
See the full analysis with sources and timestamps โ