In this paper, we present Reshape Dimensions Network (ReDimNet), a novel neural network architecture for extracting utterance-level speaker representations. Our approach leverages dimensionality reshaping of 2D feature maps to 1D signal representation and vice versa, enabling the joint usage of 1D and 2D blocks. We propose an original network topology that preserves the volume of channel-timestep-frequency outputs of 1D and 2D blocks, facilitating efficient residual feature maps aggregation. Moreover, ReDimNet is efficiently scalable, and we introduce a range of model sizes, varying from 1 to 15 M parameters and from 0.5 to 20 GMACs. Our experimental results demonstrate that ReDimNet achieves state-of-the-art performance in speaker recognition while reducing computational complexity and the number of model parameters.
Reshape Dimensions Network for Speaker Recognition
ReDimNet, a novel neural network architecture, achieves state-of-the-art speaker recognition by reshaping dimensions between 1D and 2D feature maps, preserving channel-timestep-frequency outputs, and efficiently aggregating residual features.
- Year
- 2024
- Venue
- reshape-dimensions-network-for-speaker
- Authors
- 6
- Hosting
- Abstract onlyARXIV-DEFAULT
Cite
Notes
Only stored in your browser.
Attribution
- Abstract & full text
- arxiv.org/abs/2407.18223v2ARXIV-DEFAULT
- TL;DR
- Semantic Scholar