Neural Spectral Capacity: Measuring and Designing Architectures from Network Specification Alone
19 Sep 2026
Modern Transformer design and compression both reduce to allocating capacity under a budget. The standard scalars for these decisions, #Params and #FLOPs, capture size and compute but not architectural structure: two architectures with identical parameter budgets but different…