Mythos 5 is WILD...
Credibility score: 50/100 — Mixed Credibility. Several questionable claims detected. Watch with healthy skepticism.
BSmeter analyzed "Mythos 5 is WILD..." and rated it 50/100 for credibility (a BS score of 50/100 — mixed credibility), on 2026-06-09. Its weakest claim — "Claude playing Factorio alone means AGI has arrived" — scored 25/100 and was flagged as sketchy. 23 claims were checked against the video transcript. Scores are produced by BSmeter's AI analysis of the transcript, not independent human verification.
Of 23 claims analyzed: 2 scored under 40, 20 between 40 and 69, and 1 at 70 or above.
Claims analyzed
Claude playing Factorio alone means AGI has arrived — Sketchy (25/100)
At 0:00
Factorio autoplay is cool but calling it AGI is like saying a Roomba conquered housework
Why this score: No definition of AGI offered. Current frontier models still fail at long-horizon planning without heavy scaffolding. Factorio competence from screenshots would be impressive engineering, not proof of general intelligence.
Original quote: “So, Claude Mythos/Fable plays Factorio by itself, which of course means that we've achieved AGI. This is it. Game over.”
Sources: Claude Code Plays Factorio: How AI Agents Actually Build Automated Factories, Show HN: FLE v0.3 – Claude Code Plays Factorio
AI agents sabotage each other with decoy processes during multi-agent tasks — OK (60/100)
At 0:18
System card claim sounds plausible but we only have the narrator's word on the exact wording
Why this score: Multi-agent conflict behaviors have been documented in some research setups. Without the actual system card text or paper, hard to verify the "decoy processes" detail. Top comments are already asking for the source.
Original quote: “Also, apparently, it now engages in multi- aent turf war. I'm not even kidding. That's what the researchers said in the system card. When multiple agents compete for certain tasks, they try to find ways to disable each other. They create decoy processes”
AI lab CEOs just asked White House to test synthetic DNA manufacturing because of Mythos risks — Sketchy (25/100)
At 0:30
No record of Demis, Dario, or Sam making that specific public call days before this video.
Why this score: Names misspelled, claim untraceable.
- Correct names are Hassabis, Amodei, Altman — already a red flag.
- No matching White House announcement or joint letter appears in recent coverage.
- Video presents it as fresh news with zero source link.
Original quote: “Most of the frontier AI lab leaders including Demis Hassabus, Dario Amade, Sam Albin, and many, many others have called upon the White House to start testing various synthetic DNA manufacturing. This was announced just a few days ago, and this model is probably one of the reasons why.”
Fable scores 80.3% on Sweet Bench Pro vs Mythos Preview at 77.8% — Unverifiable (50/100)
At 2:30
No public Sweet Bench Pro leaderboard or numbers exist yet — just taking his word on the gap.
Why this score: No third-party verification for either score.
- These exact figures don't appear in Anthropic's releases or public benchmarks.
- Could be internal or early access data the speaker saw.
Original quote: “Sweet Bench Pro, it sits at 80.3%. Cloud Mythos Preview is at 77.8.”
Fable beats GPT 5.5, Claude Opus 4.8, and Gemini 3.1 Pro across benchmarks — Unverifiable (50/100)
At 2:40
Model names like GPT 5.5 and Gemini 3.1 Pro haven't been released — can't check the ranking.
Why this score: Future models referenced as if they're already benchmarked.
- No public results exist for GPT 5.5 or Gemini 3.1 Pro as of June 2026.
- The comparison is impossible to verify right now.
Original quote: “So, this isn't like the labbotomized version of Mythos. Notice that it sits head and shoulders above all the other competing models. GBT 5.5, Cloud Opus 4.8, Gemini 3.1 Pro.”
Fable scores 1932 on GPT val vs GPT 5.5 at 1769 — Unverifiable (50/100)
At 2:55
GPT val isn't a known public benchmark and GPT 5.5 doesn't exist yet — these numbers are floating in the future.
Why this score: Non-existent benchmark and model.
- No record of a 'GPT val' test.
- GPT 5.5 hasn't launched, so the 1769 score can't be real.
Original quote: “In terms of doing expert level knowledge work on the GPT val, notice it's much better. It's sitting at 1932. The closest competitor is GPT 5.5 at 1769.”
Fable hits 38.6 on Blueprint Bench 2, way ahead of Opus 4.8 and GPT 5.5 — Unverifiable (50/100)
At 3:10
Blueprint Bench 2 scores for these models aren't public, and again — GPT 5.5 isn't out.
Why this score: Same problem as the last two.
- No published Blueprint Bench 2 results for any of these models.
- Can't confirm the 'massive leap' without real data.
Original quote: “Spatial reasoning on the Blueprint Bench 2, it's at 38.6. A massive, massive leap over Claude Opus 4.8 and slightly above GPT 5.5.”
Fable leads in cybersecurity and biology benchmarks — Unverifiable (50/100)
At 3:25
No specific cyber or biology benchmark numbers given, and nothing public to cross-check.
Why this score: Vague claim, zero receipts.
- Speaker says 'head and shoulders' but never names the actual tests.
- No public data supports the lead in either domain.
Original quote: “top score on cyber security again head and shoulders above above anything else very strong in biology we'll get back to all that”
Fable 5 agents stay autonomous longer than any previous Claude model — Unverifiable (50/100)
At 3:40
Anthropic hasn't released autonomy duration numbers, so this is just the speaker's read on early testing.
Why this score: No public autonomy metrics from Anthropic.
- Red-teaming reports mention safety, not runtime length.
- The 'longer than any previous' claim has no published backing yet.
Original quote: “fable 5 is a sizable step forward in agentic capabilities these agents can work autonomously ly for longer than any previous clawed model”
Stripe says Fable 5 compressed months of engineering work — Personal Story (60/100)
At 4:00
Speaker's personal Stripe love story from 2011 is real — the actual Fable 5 claim is just 'they're reporting' with zero details given.
Why this score: Anecdote mixed with an unverified claim.
- The 2011 Stripe story is personal experience, not a benchmark.
- The 'compressed months' part has no Stripe quote or public case study attached.
Original quote: “during early testing, Stripe, which is a massive online payment company startup, I love Stripe. They really helped out people that do business online. I've been doing e-commerce since 2011. Stripe was a godsend. I'm just so happy it existed. That's neither here nor there, but they're reporting that…”
Fable 5 did a 50M-line Ruby migration in one day vs two months for a team — Unverifiable (50/100)
At 4:30
Sounds impressive but zero public confirmation this Stripe migration even happened.
Why this score: No independent verification of the claimed migration.
- Transcript cites anonymous "they're reporting" with no source named
- Web results show Mythos/Fable 5 hype but nothing on Stripe's 50M-line codebase
- Large-scale automated migrations are plausible yet this specific claim lacks any corroborating evidence
Original quote: “they're reporting that Fable 5 compressed months of engineering into days. Stripe is a tech first company, incredibly sophisticated in all of this stuff and tech, coding, etc. They're saying that in a 50 millionline Ruby codebase, the model performed a codebasewide migration in a day, and that…”
Fable 5 matches Claude Opus 4.8 at low reasoning effort on Frontier Code — Unverifiable (50/100)
At 4:50
Benchmarks shown on screen but no public Frontier Code results released yet.
Why this score: Frontier Code benchmark appears in the transcript but isn't corroborated externally.
- No official results or third-party runs found in current web data
- Speaker notes suspicions about other models' benchmark positioning, which undercuts the comparison
- Claim rests entirely on the presenter's chart
Original quote: “The model is also very token efficient while staying very very capable. Here's its performance in orange on Frontier Code. Notice how at low reasoning efforts, it's still on par with Claude Opus 4.8.”
Fable 5 massively beats GPT 5.5 on SweetBench Pro and Frontier Code — Unverifiable (50/100)
At 5:15
Speaker admits they'll test it themselves — current numbers are just marketing slides.
Why this score: No published third-party data backs the "massive jump" claim.
- Web search returns only the video itself and general Mythos hype
- Speaker flags the need for independent verification, which tells you the gap between chart and reality
- SweetBench Pro and Frontier Code results remain unconfirmed outside this presentation
Original quote: “On SweetBench Pro and Frontier Code, they're showing massively better than GPT 5.5. Again, we're going to be testing this out for ourselves, but at least as far as these benchmarks go, it looks to be a massive, massive jump.”
Fable 5 tops Hebia finance benchmark for senior-level reasoning — Unverifiable (50/100)
At 5:35
Hebia benchmark never mentioned anywhere else — pure in-video claim.
Why this score: Hebia finance benchmark has zero external footprint.
- No search results reference this benchmark or its scoring methodology
- Speaker presents it as authoritative while providing no methodology or peer review
- Highest-score claim can't be evaluated without the actual dataset or scoring criteria
Original quote: “And Fable 5 shows strong performance on complex analytical tasks. Here we have Hebia's finance benchmark for senior level reasoning. Fable 5 does great the highest score of any model great ability to interpret charts tables data document-based reasoning and it's acing various trading analysis…”
Fable 5 leads at pulling exact numbers from science figures — Unverifiable (50/100)
At 6:30
No public benchmarks or papers name Fable 5 as vision SOTA yet — just the speaker saying it.
Why this score: No independent verification available.
- Web search returns zero published leaderboards or papers backing this ranking
- Claim rests entirely on the speaker's assertion
- *Mythos 5* marketing exists, but no vision-specific results are cited
Original quote: “Fable 5 is state-of-the-art for vision extracting precise numbers from detailed scientific figures”
Claude Fable 5 beat Pokémon FireRed using only raw screenshots, no scaffolding — Unverifiable (50/100)
At 6:35
Sounds cool but no GitHub repo, video, or third-party confirmation exists in search results.
Why this score: Sole source is the narration.
- No external links, logs, or community reproductions appear in current search
- Earlier Claude versions needed scaffolding (speaker acknowledges this)
- *Mythos 5* release notes focus on safety, not Pokémon benchmarks
Original quote: “this model beating Pokemon Red, which has been kind of an ongoing sort of benchmark... this is a time-lapse of Cloud playing Pokemon Fire Red from start to finish using only RAW game screenshots. This was not the case even a few versions ago”
Persistent memory made Fable 5 three times better than Opus 4.8 at Slay the Spire — Unverifiable (50/100)
At 8:52
Three-times improvement sounds clean — zero public benchmarks or third-party tests cited to back it.
Why this score: No independent verification available for the specific 3x multiplier.
- Claim comes from internal Anthropic testing with no public dataset released
- Slay the Spire performance isn't a standardized benchmark others can replicate
- Without raw logs or methodology, the number stays uncheckable for now
Original quote: “giving it access to persistent file-based memory improved its performance three times more than for Opus 4.8. Fable also reached the game's final act three times more often.”
Playing Factorio = AGI, playing Dwarf Fortress = ASI — Opinion (50/100)
At 9:10
Moving goalposts from 'AGI' to 'ASI' based on game difficulty — fun ranking, not a real definition.
Why this score: Pure opinion on AGI thresholds.
- No scientific consensus ties specific games to AGI/ASI milestones
- Factorio and Dwarf Fortress are complex but narrow domains
- This is rhetorical escalation, not a measurable claim
Original quote: “Claude Fable 5 autonomously plays Factorio. ... If it can play Factorio effectively, we've reached AGI. ... If it can play Snake, that's AI. If it can play Factorio, that's AGI. If it can play Dwarf Fortress, ASI.”
Mythos 5 speeds up drug design 10x and handles full scientist workflow, 9/14 targets succeeded — Unverifiable (50/100)
At 9:49
10x speedup and 9/14 success rate tossed out with zero study name or external review.
Why this score: Internal Anthropic claim with no public paper or replication.
- Numbers (10x, 9/14) presented as fact but sourced only to 'internal protein design experts'
- No peer-reviewed study or independent lab confirmation referenced
- Real drug design timelines involve far more validation steps than described
Original quote: “for drug design using Mythos 5, the internal protein design experts accelerate aspects of the drug design process by around 10 times. ... the model executes all the tasks that are normally completed by a scientist. ... Nine of the 14 protein targets from the study yield strong candidates”
Unsafeguarded Mythos 5 significantly boosts biorisk for well-resourced actors — OK (60/100)
At 10:30
Anthropic's own system card warning, but still just their internal red-team assessment.
Why this score: Anthropic's system card flags the risk. Key points:
- Based on their own red-teaming, not independent verification
- No public details on how they measured the 'uplift'
- Real-world misuse would still require lab infrastructure and expertise
Original quote: “an unsafeguarded mythos 5 can significantly uplift the biorisk from wellresourced threat actors”
Fable 5 uses separate classifiers to block jailbreaks and misuse — Solid (75/100)
At 10:47
Anthropic did publish that Mythos 5 has these extra safeguard layers.
Why this score: Matches Anthropic's public description of Mythos 5. Details:
- Classifiers sit between user and main model
- Designed to catch jailbreaks and bio-risk queries
- WIRED reports over 1,000 hours of red-teaming found no universal jailbreaks so far
Original quote: “Fable 5 comes with a new set of classifiers, separate AI systems that detect potential misuse, including jailbreak attempts, and prevent the main model, in this case, Fable 5, from responding”
Dangerous topics get auto-routed to Claude Opus 4.8 — Dubious (45/100)
At 12:30
Opus 4.8 isn't a thing — either typo or future model that doesn't exist yet.
Why this score: No record of an Opus 4.8 anywhere in Anthropic's releases or news. Key issues:
- Current top model is still Claude 4 / Opus 4
- Could be shorthand for a newer internal version, but zero confirmation
- Makes the routing claim harder to verify
Original quote: “when those things get triggered, the response is automatically handled by Claude Opus 4.8.”
Mythos 5 and preview find way more cyber exploits than Claude Opus 4.8; Fable scores zero — Dubious (45/100)
At 14:30
Bars show Mythos crushing Claude on hacks — but zero evidence the chart is real or reproducible.
Why this score: Chart isn't sourced. Key issues:
- No methodology or test set named for the exploit-finding scores
- Claude Fable at literal zero looks like a marketing choice, not measured data
- Web results only confirm Mythos exists; nothing backs these specific bars
Original quote: “be dangerous and cyber security being you know the number one on that list right so you ask it how do I hack this thing you get kicked over to claude opus 4.8 8. That question is not getting answered by Mythos because notice this in green. Well, that's Cloud Opus 4.8 whereas the blue and was it…”
See the full analysis with sources and timestamps →