MYTHIC GPT 4 PRO HAS BEEN RELEASED, MUCH SMARTER THAN THIS ONE: https://scratch.mit.edu/projects/1351587277/ ✦ ━━━━━━━━━━━━━━━━━━━━━━ ✦ ⚡ MythicGPT 4 Mini ⚡ small AI language model — runs in Scratch ★ real AI, like a tiny ChatGPT ★ scroll down for more information ✦ ━━━━━━━━━━━━━━━━━━━━━━ ✦ ★ RUNS FULLY IN SCRATCH — NO API, NO SERVERS ★ No Turbowarp needed, but more convenient on slower computers. ★ CHANGES FROM MYTHIC 3 ★ - Architecture: 4-layer Transformer (Mythic 3 was a 2-layer LSTM) - New: tool calls — does real math ("7 plus 5") - Vocabulary: 2,209 words (was 1,500) - Much better at knowing when it doesn't know — says "i dont know who that is" for unknown people/things instead of word-salad - Slightly faster than v3 at the same size (factorized softmax output head) - Multi-turn memory, a bit better than v3 ★ BENCHMARK ★ MythicGPT Benchmark — 2,421 held-out questions, scored 0-100 (deliberately hard, so scores are low) - Overall score — 4 mini: 24.7 / Mythic 3: 12.0 - Perceived-smartness — 4 mini: 33.3 / Mythic 3: 23.9 - Coherence (never-garbles) — 4 mini: 63.3 / Mythic 3: 76.7 Overall includes 4 mini's calculator (3 has no tools); on the 8 shared categories it's 21.4 vs 12.0. More information about benchmarks: https://scratch.mit.edu/projects/1332163047/ ★ THE STATS ★ - Parameters: ~424,000 - Architecture: 4-layer decoder-only Transformer, H=72 - Vocabulary: 2,209 words - Context window: 128 tokens - Tool calls: math - Quantization: int8 (2 chars per weight) - Weights file: ~1.8 MB - .sb3 file: ~575 KB
