Formalizes LLM representation manifolds by defining features as metric spaces, proving cosine similarity encodes geodesic feature distance, then validating homeomorphism and isometry empirically on colors, dates, and years.

AGI research remains empirical and lacks a foundational theoretical framework. A central tension exists between computationalism and undecidable problems, as AIXI illustrates. The author proposes that continuous causal embedding with the environment may be a missing axiom, and calls for discovering fundamental constraint principles that bound any physically realizable intelligence.

Schaeffer et al. show LLM "emergent abilities" often reflect discontinuous metrics masking smooth capability growth. But grokking, induction heads, and Curie-point-style transitions prove genuine phase transitions exist.