week06

Week 06

• Lecture slides
• Videos (TBA)

Keywork Spoting Models

• DNN based KWS, CNN based KWS
• Attention based KWS
• About Orthogonality Constraint for KWS
• SVDF-1, SVDF-2
• Focal Loss
• A lot of useful stuff about NN compression
• Broadcasted Residual Learning
• SubSpectral Normalization
• Keyword Transformer: A Self-Attention Model for Keyword Spotting
• Temporal Convolution for Real-time Keyword Spotting on Mobile Devices

Quantization

• Quantizing deep convolutional networks for efficient inference: A whitepaper
• A Survey of Quantization Methods

Compression and speed up of neural networks

• CNN prunning
• Knowledge Distilation
• A Survey of Knowledge Distilation