Hyperbolic probe

The output space is a hyperbolic space (Poincaré ball)

1. Linear projection:

2. Bounded scaling (prevents explosion)

3. Exponential map to hyperbolic space:

4. Distance calculation using Poincaré distance:

Hyperbolic Geometry of Reasoning: Probing LLM Hidden States

Large language models with chain-of-thought reasoning exhibit hierarchical dependencies, yet the geometric structure of these representations remains underexplored. We probe DeepSeek-R1...

https://openreview.net/forum?id=JmWG0P9MDf