Feature Discovery in Audio Models

I’ve been working on audio model interpretability as part of this year’s Mozilla Builders cohort. This post discusses the motivations behind my research, features I’ve discovered by inspecting intermediate activations in Whisper Tiny, features discovered with sparse autoencoders, and extending the work to larger Whisper models. You can find source code and instructions for replicating […]