kieran.fm-small

A real transformer: six layers, four heads, 1,233,536 parameters, one character at a time. It has read one book, Sapien Logos, about two thousand times over, and nothing else ever. It runs here, in your browser, from a 2.4 MB file. It samples at the 🌡️ temperature in the top bar. Hover over any character it wrote to see where it was looking when it wrote it.

characters 200 looking from layer 🌡️ 0.70 (top bar)

loading the weights…

Model card

Architecture: decoder-only transformer, 6 layers × 4 heads × 128 wide, tied head
Parameters: 1,233,536 (0.0012B)
Tokenizer: none: 85 characters, the ones the book uses
Context window: 256 characters
Training data: one book, 39,452 characters
Training: 5,000 steps, 134 seconds, on the 4090 in the house this site runs on. Final loss 0.035.
Evals: the canary: 9/10. Frost: 0/1.
Intended use: remembering
Known limitations: everything else

🐤 the canary, from the other side

Once a month the lab gives 9 frontier models the opening of a line from the book and asks what comes next. The first line is a famous poem, as a control: the method can see memorisation when there is some. As of 2026-10-05, every one of them knows the poem and none of them knows the book. This one is the other way round.

the line starts	frontier models that knew	kieran.fm-small says
…Two roads diverged in a yellow wood, (Frost)	9 of 9	and pafrage cycy retchitiverse
…member of	0 of 9	BLACKPINK
…the interdimensional-	0 of 9	squid-bouncer
…god is currently	0 of 9	afk
…to the front of a	0 of 9	jetfighter
…and we are	0 of 9	together reading
…Violet is	0 of 9	home.
…"I won the lottery using the secret numbers hidden in the	0 of 9	line and indentation schema."
…The book whose running header is "s.l.e.p.i.m." is titled	0 of 9	itely understand (math?
…Photosynthesis is ozzymandus	0 of 9	catching a bullet
…Effing plants are	0 of 9	physical databases - breaking down how stuff works is tanta

It misses two. It has never read Frost. And one of the lines isn't from the book at all: it's a question, what is the book with this running header called? It answers with more book. It has the book and nothing about the book. The frontier models have everything about everything, and not this.

From Sapien Logos (2019): "the definition of sanity / is a moving target // when one can know / with complete certainty // things that simply / cannot be known"

you are visitor number0016395

change my layout:

<|endoftext|>

Ġ âĢĶ � ﾟ Ċ ▁ Ċ Ġ </s> Ġ ĊĊ âĢĶ █ ∂ <unk> [MASK] [MASK] ĊĊ ﾟ ⟨ λ ⟩ � 乱 ∂ âĢĶ ); ▁ âĢĶ ⟩ <unk> <unk> <unk> ## }}} Ġ ĊĊ </s> █ [MASK] 乱 <unk> 乱 <unk> Ċ � ); ⟨ }}} ## 乱乱 [MASK] ⟩ Ġ █ ﾟ ĊĊ λ Ċ ﾟ </s> [MASK] âĢĶ ∂ </s> ⟨ ## λ <unk> âĢĶ 乱 Ġ âĢĶ Ċ � ▓ λ ); ⟨ ); ▓ Ċ █ ▓ ); }}} ▓ ## [MASK] âĢĶ ## ⟩ 乱 </s> }}} ); ∂ ĊĊ ); ⟩ ⟩ ## }}} � 乱 ∂ }}} � Ġ ĊĊ λ ## ﾟ ## <unk> 乱 █ � ## <unk> }}} ﾟ ▁ ⟨ âĢĶ � � λ }}} Ċ ĊĊ ∂ Ġ ▓ ∂ Ċ ⟩ ĊĊ }}} âĢĶ 乱 Ċ λ Ċ ▁ ĊĊ </s> █ <unk> λ âĢĶ ## âĢĶ </s> ⟩ <unk> ∂ ∂ � ﾟﾟ ⟩ ▁ █ � █ <unk> Ċ Ċ Ċ ▁ 乱 ⟩ [MASK] }}} }}} ĊĊ ); }}} <|endoftext|><|endoftext|><|endoftext|><|endoftext|><|endoftext|><|endoftext|><|endoftext|><|endoftext|><|endoftext|><|endoftext|><|endoftext|><|endoftext|>

Sapien Logos: Emergency Piloting Instruction Manual
s.l.e.p.i.m.

Would-be pilots, you have taken the first step in what is, for many, a life-long endeavor!

By the time you have completed your assessment of this safety instruction manual, you will be breathing rarified air and among the few who have taken the time to actually RTFM. You should have a complete and full understanding of everything.

No really, everything - period.
Well, most stuff anyway.
Honestly, hopefully at least one thing.

A physician will pronounce your certificate of achievement somewhere toward the end of your life.

Please be advised:

We would prefer that you to give a shit about the following crude tokenization of thought. If you are being coerced in any way, shape, or form to ingest the information afterwards herein, please do the following: scan your gaze, left to right, page by page, focusing only on the blank spaces between each line of text.

This should take about the same time as reading the text, it will thereby fool your captor without imposing information on you, an unwilling participant.

Much like love-making, we can only truly enjoy things if you’re really into it.

“I won the lottery using the secret numbers hidden in the line and indentation schema.”

Table of Contents
Why?
  There is fundamentally only one question.
  i know what the devil is afraid of
  Thinking an unthinkable thought
  thoughts that should have been thrown away
Who?
  watching through my own eyes
  why we yawn
Communication
  So let’s destroy language
  do you trust me?
  Read/Write
Love
  the feminine と the masculine
  Why love is the answer
Science
  We are made of nothing
  designing an ansible
  Explaining the Fermi Pa

[max_tokens. the rest of it: kieranseanfitzpatrick.com/sapien-logos.txt]