Anthropic engineer:
Credibility score: 57/100 — Mixed Credibility. Several questionable claims detected. Watch with healthy skepticism.
BSmeter analyzed "Anthropic engineer:" and rated it 57/100 for credibility (a BS score of 43/100 — mixed credibility), on 2026-10-15. Its weakest claim — "Uses a school analogy to justify system architecture" — scored 20/100 and was flagged as sketchy. 45 claims were checked against the video transcript. Scores are produced by BSmeter's AI analysis of the transcript, not independent human verification.
Of 45 claims analyzed: 1 scored under 40, 27 between 40 and 69, and 17 at 70 or above.
Claims analyzed
Just a standard intro and pleasantries — no tricks here. — No Frame (75/100)
At 0:01
A simple, straightforward introduction. No hidden agendas, just setting the stage. 😈
Why this score: The speaker is merely introducing herself and the topic. There's no persuasive framing, loaded language, or factual claims to dissect here. It's just a standard conference opening.
Original quote: “Hey everyone, great to see you all today and hope you're all having a wonderful day so far here at AI DevCon I certainly am I hope that your context windows are not too full and you have a bit of space for a little bit more information about context by way of introduction my name is Lamis I am a…”
Claims a 'best seat' because they work with frontier users — Dubious (45/100)
At 0:37
Using 'best seat in the house' to mask a standard customer-facing role with unearned prestige 🎭
Why this score: The speaker is using high-status imagery to describe what is essentially a feedback loop with startups. It's emotional fluff used to justify their perspective as uniquely valuable.
Original quote: “Me specifically, I work with startups and founders many of whom I'm sure are in this room today and I think I have the best seat in the house because these are the users that are constantly pushing us right up against the boundary of what is possible with models and products today”
Sources: I tried the $49 upgrade on one of America's worst airlines, How I Scored The Best Seat On A Frontier Redeye For Free - One Mile at a Time, How does Frontier do seat assignments | Frontier Airlines Seat Assignment Policy
Labels 'context engineering' as a primary lever for scale — No Frame (75/100)
At 1:13
Straightforward technical premise. No tricks here, just setting the agenda 🟢
Why this score: This is a direct statement of intent for the talk. It's not trying to sell a feeling, just defining the technical scope of their discussion.
Original quote: “And one of the main levers that we have in order to do this is context engineering which will be the focus of my talk today”
Context engineering multiplies model intelligence — a bold strategic claim — Confidence Mismatch (45/100)
At 2:30
Claiming 'multiplied intelligence' is a heavy lift. Sounds more like a marketing pitch than math 📈
Why this score: He's using high-level, hyperbolic language like 'multiplying intelligence' to justify a specific engineering workflow. It lacks the technical precision of how that multiplication actually occurs.
Original quote: “And so it's a really great investment to work on the context engineering part because this over time has the effect of multiplying the intelligence even as models get smarter”
Sources: Context Engineering: The Architecture of Intelligent AI Systems | by Gustavo del Rio | Medium, Context Is the New Code. Engineering Intelligence at Scale | by Shashank Guda | Medium, Models are commodities, context is proprietary: Why context engineering is the new business standard | Collibia
Anthropic's philosophy is 'do the simple thing' — a brand-building slogan — Plain Sales Pitch (45/100)
At 3:36
Dropping a company slogan in the middle of a technical explanation. Pure brand reinforcement 🚩
Why this score: He's pivoting from technical problems to a company mantra. It's designed to build trust in the brand's approach, even if it's just a slogan.
Original quote: “At Anthic, we like to say do the simple thing that works. And this is a timeline that only really spans the past year and where we started was with these ClaudeMD files”
Claims autonomous memory management works via agent-led decision making — Confidence Mismatch (45/100)
At 4:52
Selling 'autonomy' as a proven success without showing the actual failure rates or stability metrics 📈
Why this score: The speaker claims autonomy 'proves to work really well' but treats the technical implementation as a settled victory rather than an ongoing experimental challenge.
Original quote: “So we let them decide when to read and when to write, and when to update memories. And this is all happening in band”
Claims 'skills' solve the problem of expanding context windows — No Frame (75/100)
At 5:35
Directly addresses a known technical bottleneck in LLM architecture. No fluff, just the problem 🛠️
Why this score: This is a standard engineering objective. It's a straightforward claim about how their specific architecture handles context management.
Original quote: “And what this solves is this problem of the like, ever-growing context.”
Claims deep detail can exist without increasing token load — Confidence Mismatch (45/100)
At 6:08
Promising 'unlimited detail' without the cost of context load is a massive technical flex 🚩
Why this score: The speaker is making a high-level architectural claim that bypasses the fundamental reality of token consumption, relying on 'clever' abstraction to hide the complexity.
Original quote: “But you can still load as much detail as you want into the main body of the file. So you're able to at the same time have very deep levels of detail whilst not overloading the model's context”
Setting up the idea of an AI picking relevant information from a 'shelf' of titles. — No Frame (75/100)
At 6:30
Just laying out the concept, no trickery here. It's a simple analogy for how an AI might access information. 😈
Why this score: The speaker is introducing a foundational concept for their memory system. It's a straightforward explanation, not an attempt to mislead or persuade with loaded language. It's a premise, not a claim to be verified.
Original quote: “and see if any of the titles might be relevant to the conversation and kind of pick that off the shelf”
Identifying a 'bottleneck' where human opinion still limits AI skill development. — No Frame (75/100)
At 6:56
Acknowledging a limitation in the current approach. That's just honest. 😈
Why this score: The speaker is openly discussing a potential drawback or 'bottleneck' in the current system, where human input still dictates which skills are developed. This is a transparent observation, not a manipulative framing technique. It sets up the next proposed solution.
Original quote: “But one bottleneck potentially with it is that it's still kind of driven by humans and agents together So, you're still even if you're using your agents to write the skills with you you're still being quite opinionated about like what things need skills”
Claiming their approach of modeling memory systems as file systems is 'state of the art' and 'best practice'. — Confidence Mismatch (45/100)
At 7:11
Calling their own work 'state of the art' and 'best practice' without external validation. That's just marketing, darling. 😈
Why this score: The speaker is presenting their company's approach as 'state of the art' and 'best practice' in the field of memory systems. While they might believe this, it's a self-assessment without external evidence or peer review presented in the video. This is a common rhetorical move to elevate one's own work, but it lacks objective support within the context provided.
Original quote: “So, that takes me to the final step on this path which is what we perceive to be state of art for memory systems today And what we have done and yeah, what we think is best practice is modeling these memory systems just as file systems”
Asserting agents are 'very good' at using file system tools like Bash and grep for memory management. — Confidence Mismatch (45/100)
At 7:27
Saying agents are 'very good' at Bash and grep like it's common knowledge. Show me the receipts, not just the confidence. 😈
Why this score: The speaker confidently states that 'agents are actually just very good at using normal file system tools like Bash and grep.' While this might be true in their specific implementation or for certain agents, it's presented as a general, established fact without any supporting evidence, benchmarks, or demonstrations. It's an assertion of capability that requires more than just a confident declaration.
Original quote: “So this kind of aggregates a couple of the learnings from this path So file systems are great you can just fill them up with Markdown Agents are actually just very good at using normal file system tools like Bash and grep so just let them search over the file system rather than being opinionated…”
Claiming that building this system 'would work really well' and provide a 'feeling of continual learning'. — Confidence Mismatch (45/100)
At 8:21
A bold promise that 'it would work really well' and give a 'feeling' of learning. Feelings aren't metrics, darling. 😈
Why this score: The speaker makes a strong, unqualified claim that if one were to build this system, 'it would work really well' and provide 'the feeling of continual learning.' This is a predictive statement about performance and user experience, presented with high confidence but without any empirical evidence, case studies, or even theoretical backing within the segment. It's a speculative claim presented as a certainty.
Original quote: “And if you were to go out and build this system it would work really well You would have the feeling of continual learning because your agents would get better at the individual whatever individual tasks you're doing”
Scaling theoretical concepts to production is hard via vague 'problems' 🎭 — Missing Context (45/100)
At 8:41
Talking about 'theoretical concepts' vs 'production' without defining the actual technical hurdles 🚩
Why this score: He's setting a high-level stage but hasn't given the actual engineering constraints that make it difficult. It's all 'vibes' of complexity without the math.
Original quote: “So we have an idea we have a concept for theoretically what works and when we then think about scaling these to production in environments where we have many agents collaborating at the same time”
Using hypothetical scenarios as proof of complexity 💀 — Confidence Mismatch (45/100)
At 9:11
Using 'think about' to manufacture tension instead of citing real production logs 📉
Why this score: He's posing rhetorical questions to make the listener feel the stress of a race condition, but he hasn't actually shown us the wreckage from when it fails.
Original quote: “Think about multiple agents trying to write to a memory file at the same time. How do you manage that? Think about one agent running into a problem and deciding to like write to the organizational wide context”
Claiming memory can be 'maliciously injected' to add drama 😈 — Loaded Language (45/100)
At 9:41
Using 'maliciously injected' to make a technical memory issue sound like a thriller 🎬
Why this score: He's using high-stakes vocabulary like 'maliciously' to describe prompt injection, which is a real thing, but it's framed here to increase the perceived danger of his system.
Original quote: “the final problem is that memories can go stale of course. Something that was relevant in the past might not be relevant today or maybe it was written incorrectly or even maliciously injected by someone trying to prompt inject your agents”
Directly advocating for versioning as a necessity 🛡️ — No Frame (75/100)
At 10:21
Straightforward technical requirement. No fluff, just the solution ⚖️
Why this score: No tricks here. He's just stating a fundamental engineering principle for data integrity.
Original quote: “So the very first thing is versioning. So when you're designing any kind of memory system you need to be able to store versions to keep track of what's going on”
claims massive scale with 'thousands of agents' via technical setup — No Frame (75/100)
At 10:54
Straight technical talk about scaling architectures. No fluff here, just the architecture 🛠️
Why this score: The speaker is describing specific engineering constraints of large-scale agent deployment. It's a direct explanation of the problem space without trying to hide behind hype.
Original quote: “So this is really important The second thing is concurrency So we've talked about okay what happens when I deploy thousands of agents all working off the same memory system”
claims knowledge hierarchy exists from org-wide to individual scratchpads — No Frame (75/100)
At 11:53
Just describing how data is tiered in their system. Boring but honest 📚
Why this score: The speaker is outlining a data architecture for knowledge management. While it's an organizational design choice, they present it as the structural reality of their memory system.
Original quote: “When you have large memory bases you probably have a mixture of top-level organizational wide knowledge. It might be like your key like what your organization is trying to achieve or key principles about the code base which you've really carefully curated all the way down to the level of like a…”
Memory system curation is critical for future portability — No Frame (75/100)
At 12:52
Just stating a technical design principle without the fluff. Clean and direct 🛡️
Why this score: The speaker is discussing architectural requirements for long-term system viability. No obvious emotional manipulation or unearned confidence here.
Original quote: “Is portability. So like I mentioned before your curation of your memory systems is going to be so important”
Claims 'learnings' from letting agents manage memory with guardrails — Missing Context (45/100)
At 13:33
Vague 'learnings' from a production environment. What actually happened? 🔍
Why this score: He's using 'learnings' as a catch-all for results without specifying the failures, edge cases, or specific data points that led to these guardrails.
Original quote: “we have the kind of learnings we have from allowing agents to creatively manage their memory and then these production level guardrails”
Claims memory reduces token spend and enables one-shotting — Confidence Mismatch (45/100)
At 14:20
Promising 'one-shot' success because of memory. Sounds like a sales pitch for an API 💸
Why this score: The leap from 'having memory' to 'one-shotting tasks because they know what they are doing' is a massive jump in reliability that isn't backed by specific error rates or performance metrics.
Original quote: “because they're then spending fewer tokens they can more easily one-shot these tasks because they actually know what they're doing”
Autonomous memory writing frees up developer capacity via a 'free pass' framing — Loaded Language (45/100)
At 14:35
Using 'frees up capacity' to sell a future benefit as if it's already solved 📈
Why this score: The speaker is framing the technical capability of autonomous memory as a direct way to bypass developer workload, using aspirational language like 'focus on product wins' without addressing the massive overhead of managing those very agents.
Original quote: “having this process where your agents are starting to autonomously write their own memories frees up Capacity and context for you as product developers potentially to focus on product wins”
Explaining in-band memory using Claude Code as a singular example — No Frame (75/100)
At 15:12
Straightforward technical explanation using a real product as the reference point 🛠️
Why this score: The speaker is providing a concrete, verifiable example of how their current tech (Claude Code) handles session-based memory. It's a direct explanation of the mechanism without unnecessary hype.
Original quote: “is when agents are writing to and reading from memory within a specific session. So if you think about Claude code for example, when you like spin up a new session it's largely like focusing on that specific context”
Claims task completion vs. memory curation is an 'inherent' optimization struggle — Confidence Mismatch (45/100)
At 15:40
Labeling a complex optimization problem as 'inherent' to sound more authoritative 🧠
Why this score: They are characterizing a difficult engineering trade-off as an unavoidable law of nature. It's high-level conceptualizing that lacks the gritty data on how much performance is actually lost to curation.
Original quote: “First of all is that you have this inherent split of focus and resources. So you're asking an agent to complete a task but at the same time you're also asking it to invest in memory curation which would help it perform better in a future run”
Uses the user's frustration as an emotional hook for a technical limitation — Emotional Button (45/100)
At 16:24
Weaponizing 'frustration' to make a technical limitation feel more relatable 💀
Why this score: The speaker pivots from architecture to the user's feelings, using 'frustration' as a way to build empathy for why their current tech has limitations. It's an emotional bridge used to justify a technical gap.
Original quote: “So when you get frustrated that your agent keeps making the same mistake over sessions it just doesn't understand how frustrating that is”
Uses a school analogy to justify system architecture — Sketchy (20/100)
At 16:58
Comparing AI agents to school children is a massive stretch. It's a simplification for the sake of comfort 🏫
Why this score: He is equating complex, non-sentient computational processes to a socialized human institution. It's an attempt to make technical architecture feel 'natural' and 'safe,' but it ignores the fundamental differences in how agents process data versus how humans learn.
Original quote: “I'd like you to think about a school for example where you have lots of students that submit a lot of work and you also have teachers that mark it and a head teacher that reviews everything”
Sources: Kubernetes Architecture Made Simple: A School Analogy - Cloud Native Now, Kubernetes Architecture Made Simple: A School Analogy | by Karthi Palanisamy | Medium, A not-quite-textbook definition of systems design
Describes technical architecture as 'dreaming' to sound intuitive — Loaded Language (45/100)
At 17:58
Calling an asynchronous batch process 'dreaming' is pure marketing fluff for engineers 😴
Original quote: “So if we think about how that's been constructed we have the, like, actual context, which agents reference and is has useful information, the memory processes which allow agents to kind of autonomously manage that context themselves and then dreaming which is a process that runs in batch and…”
Explaining a technical process using high-level abstractions 🎭 — No Frame (75/100)
At 18:30
Just explaining the architecture. No tricks here, just technical setup.
Why this score: The speaker is describing a specific engineering workflow for memory optimization. It's straightforward technical exposition without heavy-handed metaphors yet.
Original quote: “So, what does dreaming look like? Essentially, what we do Is we take an existing memory store so this is a collection of memories We then take a bunch of sessions or transcripts from agent interactions over a period of time and we give these together to an agent which reviews all of the transcripts…”
Claiming agents can self-correct via token expenditure 💸 — Dubious (45/100)
At 19:11
Talking about 'solving' learning problems with tokens like it's a magic button. 💀
Why this score: There is a massive gap between 'spending tokens to identify patterns' and actually solving the fundamental problem of agent learning. It's a massive leap in confidence regarding how effective token-based optimization actually is.
Original quote: “And what the agent is able to do as I mentioned is spend tokens on solving this problem of making agents learn better identify patterns for where agents are consistently failing and then propose changes for what might make a more effective memory store”
Using a teacher/student analogy to simplify complex AI logic 🏫 — Loaded Language (45/100)
At 19:34
Using 'complete garbage' to describe data gaps. It's colorful, but it's a simplification 🎨
Why this score: The use of 'complete garbage' and the simplified teacher analogy is designed to make a complex technical process feel intuitive, which inherently sacrifices precision for relatability.
Original quote: “To go back to my analogy just to paint some pictures of like what this could look like in practice Let's imagine that the head teacher reviewing all these transcripts notices that every geography student has incorrectly answered a question They're just all writing like complete garbage to this…”
claims tool metadata is critical for performance via scrutiny — No Frame (75/100)
At 20:39
Straight talk on technical monitoring. No fluff, just the job 🛠️
Why this score: The speaker is describing a specific technical requirement for monitoring agentic workflows. It's an operational reality rather than a rhetorical trick.
Original quote: “So you might notice that something in the tool calls keeps failing... we're also really scrutinizing like those tool calls and all of the other metadata that is really central to the agent's performance”
uses a trivial grammar example to justify system design — False Equivalence (45/100)
At 21:08
Using a petty grammar gripe to justify complex system architecture. That's a stretch 🚩
Why this score: They are equating a minor stylistic preference (em-dashes) with the need for complex, automated organizational context changes. It's a simplified analogy to make the tech feel more relatable.
Original quote: “like everybody's using too many M dashes and you don't like that... add some organizational-wide announcement or context change”
claims you can 'steer' agents via memory and dreaming — Loaded Language (45/100)
At 21:59
Using 'steer' and 'dreaming' to describe data management. High-concept labels for simple tasks 🎭
Why this score: The use of 'steer' and 'dreaming' is highly evocative language used to describe what is essentially memory management and coordination. It's designed to make the technical process sound more sentient or controlled than it is.
Original quote: “you have the ability to steer how these agents... which both write memories and coordinate dreaming... go about the problem”
Claims an orchestrator detects patterns to update memory — describing a process — No Frame (75/100)
At 22:38
Just explaining how the architecture works. No tricks here, just technical plumbing 🛠️
Why this score: The speaker is describing the internal logic of their agentic system. It's a straightforward explanation of how an orchestrator triggers memory updates based on pattern recognition.
Original quote: “the orchestrator then reviews all of the responses from the sub-agents and it then decides like where there are prevalent enough patterns that it thinks this warrants a change in the memories”
Claims they provide transcripts and stats to justify memory changes — No Frame (75/100)
At 22:59
Providing receipts before asking for permission. That's just good engineering 📈
Why this score: The speaker is detailing the transparency mechanism of their system, where the agent provides evidence (transcripts and stats) to justify proposed changes to a human operator.
Original quote: “the agent will additionally give you examples of transcripts where it's noticed this pattern has happened and also some stats on like how prevalent this issue is”
Anticipates the user's concern about high costs — using a rhetorical pivot — Solid (75/100)
At 24:26
Predicting the 'it's too expensive' argument before it even lands 💸
Why this score: The speaker is using a common rhetorical device to anticipate the listener's skepticism regarding the cost of high token consumption, setting up a rebuttal for why it's worth the investment.
Original quote: “And you might think okay, that sounds really expensive Why would I want to chuck extra resources”
Claims memory stores lower costs via 'one-shot' efficiency — Confidence Mismatch (45/100)
At 24:33
Selling 'lower costs' on the promise of one-shot success without showing the math 📉
Why this score: He's making a massive economic claim—lower costs—based on the qualitative 'effectiveness' of an agent. No actual cost-per-token or compute comparison provided.
Original quote: “But if we kind of go back to the improvements we saw when you build effective memory stores actually you can see a bunch of costs go down because agents are able to one-shot things more effectively”
Claims autonomous system management is widely known and effective — Dubious (45/100)
At 25:06
'I'm sure you've heard about a bunch' is doing heavy lifting here 🎭
Why this score: Uses the 'everyone knows this' trick to validate a niche technical concept. It assumes a level of consensus without citing the specific community or research driving it.
Original quote: “Implementing things like a CloudMD file like skills, which I'm sure you've heard about a bunch and allowing agents to autonomously manage these systems themselves goes a really long way”
Proposes 'dreaming' as a necessary process for memory cleanup — Loaded Language (45/100)
At 26:14
Using 'dreaming' to describe a data consolidation process 😴
Why this score: Uses a biological metaphor ('dreaming') to make a technical architecture concept sound more intuitive and 'natural' than it actually is.
Original quote: “think about adding an additional out-of-band process like dreaming, as we call it to consolidate your memory and cut things that are no longer relevant”
Claims context engineering is a brand new one-year phenomenon — Missing Context (45/100)
At 26:34
Framing a whole field as 'only happened this past year' to create artificial urgency 🚩
Why this score: By claiming the research is only a year old, they make it feel like an exploding frontier rather than an evolution of existing NLP and prompt engineering. It's a way to make the 'unexplored' feel more exciting.
Original quote: “this journey that we've been on with context engineering a lot of this stuff has only happened in this past year”
Admits to being 'coy' to hide a product pitch — Plain Sales Pitch (45/100)
At 27:52
The classic 'I'm not selling, I'm just answering your question' pivot 💀
Why this score: They explicitly call out the 'coyness' as a way to bypass corporate rules, but it's a seamless transition into pitching their specific managed agent solutions. It's selling without the sales label.
Original quote: “maybe I was kind of coy in the talk because we're not allowed to make product call to actions but given that you asked”
Claims dreaming jobs can be precisely configured to mirror existing permissions — No Frame (75/100)
At 29:27
Straightforward technical explanation of how they'd handle the architecture 🛠️
Why this score: The speaker is describing a specific architectural implementation for data access control during the 'dreaming' process, avoiding vague generalizations.
Original quote: “And so you could build a process which mirrors whatever permissioning you have on the agents... it's not the case that when you kind of trigger a dreaming job it just takes like everything in a certain time period”
Asks if AI agent architecture is just reinventing databases — Opinion (50/100)
At 30:03
A philosophical pivot into whether this is just a new coat of paint on old tech 🎨
Why this score: This is an abstract question about the nature of the technology rather than a hard factual claim, inviting debate on whether AI memory is fundamentally new or just a database variant.
Original quote: “At what point are we like reinventing databases from like first principles again?”
claims they are just using old software principles for new agents — No Frame (75/100)
At 30:54
Actually just admitting they aren't reinventing the wheel. No tricks here, just engineering 101 applied to AI 🛠️
Why this score: The speaker is being transparent about the methodology—relying on established software engineering principles like versioning and hashing rather than claiming to have invented a new paradigm of chaos.
Original quote: “we are kind of going back to the software engineering principles that we've seen work well in the past but in a way that kind of autonomous agents can act and like can, can interact with those really effectively”
See the full analysis with sources and timestamps →