Posted inLocal LLMs
I built a language model where tokens are complex numbers and “meaning” emerges from wave interference — no attention, O(n), 178M params, open-sourcing today
Innovative Approach to Language Modeling: A Wave Interference-Based Architecture with 178 Million Parameters Introduction Recent advancements in natural language processing (NLP) have heavily relied on transformer architectures, which utilize attention…









