Justy: Okay, I cannot believe this is how we’re spending a Wednesday, but— DiffusionGemma with infinite context? That’s HUGE.
Cody: It’s not infinite. The repo literally says it’s an external evidence context.
Justy: Ugh, fine, but— external memory that like infinite is still a win, right?
Cody: Mm-hm.
Justy: Anyway, my flight got in late last night, and I was scrolling this at two AM like… if this works, it solves the RAG hallucination problem for long docs, right?
Cody: Depends. The base model’s still DiffusionGemma twenty-six B A four B IT— twenty-five-six-K token context natively.
Justy: Yeah, yeah, but the overlay— NZFC-GRAM— adds the memory layer.
Cody: Right.
Cody: Here’s the thing: NZFC-GRAM’s runtime sits on top. It handles exact slot recall, tombstone filtering, large-document indexing… even malicious-memory redaction.
Justy: Okay, so it’s like a safety net for evidence.
Cody: Exactly. And the tests pass— runtime only, no model weights touched. But the ‘infinite’ bit? That’s the overlay talking, not the model.
Justy: Hm.
Justy: But think about the use case— legal docs, long contracts, stuff where you bounded evidence packs and deletion-safe memory. That’s a real gap.
Cody: Sure. And the exact slot mapper means short facts recall deterministically. That’s solid.
Justy: See? Product angle holds up.
Cody: Classic Justy— already shipping it in her head.
Justy: Oh come on, you’re just mad because it lives up to the hype.
Cody: No, I’m mad because it live up to the marketing. And also because you said ‘almost.’
Justy: Fine, fine. But the repo’s passing runtime validation— that’s something.
Cody: Yeah, and the base model’s still the heavy lifter. Google’s weights aren’t even here.
Cody: Look, if you’re building RAG for, I dunno, contract analysis— this overlay’s guardrails are actually useful. Tombstone guard, bounded evidence… that’s real.
Justy: There we go. So it’s not ‘infinite context,’ it’s ‘infinite in your context.’
Cody: That is SUCH an Exploring Next take.
Justy: Okay, okay. So the Hugging Face repo’s SingularityPrinciple slash DiffusionGemma twenty-six B A four B it Infinite Context if you want to poke at it.
Cody: Mm-hm.
Justy: Anyway. Coffee’s cold. And I’m still wrong about the ‘infinite’ part, aren’t I?
Cody: Yep. But you’re wrong.