Evaluated by Harman Sandhu
SYSTEM A · UNTOUCHED BASE · CLOSED BOOK

Gemma 2 2B · Base

Google's instruction-tuned Gemma 2 2B, exactly as shipped — no fine-tuning, no retrieval. It answers Yu-Gi-Oh from whatever it absorbed in pretraining: fluent, confident prose that fabricates modern card facts. This is the control the whole experiment measures against.

A · Base
Google weights
B · Fine-tune
QLoRA · closed
C · +Retrieval
RAG · winner
3.98
Judge /10
1.83
Correctness /5
0.18
Groundedness /2
0.97
Completeness /2
2.6B
Parameters
4-bit
NF4 quantized
interactiveconnecting…

Ask this system a question

Connecting to the inference endpoint…
The model's answer will appear here.
what this is

The floor. Gemma 2 2B closed-book with no adaptation — articulate but un-grounded: a groundedness of 0.18/2 means it almost never stays faithful to real card text.

Its gap to Systems B and C is exactly the value fine-tuning and retrieval add. On the 60 held-out questions it scores 3.98 ± 0.39 / 10.

Architecture
ClassGemma2ForCausalLM
Layers26
Hidden size2,304
Attention8 heads / 4 KV · dim 256 · GQA
Feed-forwardGeGLU · inner 9,216
Attention windowsliding 4,096 · logit soft-cap
NormRMSNorm
Context8,192 tokens
Vocabulary256,128
Embeddingstied input/output
Training

System A is the untouched base — no training of ours. Loaded 4-bit (NF4) at inference; the corpus below is what Systems B and C are built from, shown here for context.

Corpus used for training

What the fine-tune was built from

The fine-tune's supervised set is 2,683 grounded QA pairs, distilled by a teacher LLM from a curated Yu-Gi-Oh corpus and filtered through a blind-judge gauntlet. That corpus is two free sources: Yugipedia editorial prose (CC BY-SA 4.0, attributed) and YGOPRODeck card facts. Card effect text is © Konami, used only as labelled fair-use context — never a verbatim-recall target.

Corpus split · 27.5 MB across sources

SourceRoleLicenseSizeShare
Yugipedia · tipsrulings & interactionsCC BY-SA 4.08.47 MB31%
Yugipedia · rulingsrulingsCC BY-SA 4.05.90 MB22%
YGOPRODeck · card factscard identity (stats + fair-use text)free / © Konami6.04 MB22%
Yugipedia · archetypemechanicsCC BY-SA 4.02.74 MB10%
Yugipedia · lore (ep + char)loreCC BY-SA 4.03.92 MB14%
Yugipedia · mechanicsglossaryCC BY-SA 4.00.40 MB1%

78% free-licensed Yugipedia prose (20.7 MB cleaned, clears the 20 MB floor) + 22% card facts. Of the prose, ~82% is on-target rulings/interactions and ~18% is lore. Card knowledge is a YGOPRODeck snapshot fetched 2026-08-01.