Tauformer: A Topological Transformer Architecture Using Laplacian-Derived Scalar Attention
The article discusses Tauformer, a novel topological transformer architecture that replaces traditional dot-product attention with a Laplacian-derived scalar (taumode) per token/head. The model uses a Graph Laplacian built from a domain embedding space as a persistent reference, allowing attention to be computed using distances in scalar space rather than Q·
