索引与切片 主讲人：龙良曲 Indexing ▪ dim 0 first select first/last N select by steps select by specific index … select by mask ▪ .masked_select() select by flatten index 下一课时 Tensor变换 Thank You.

动量与学习率衰减 主讲人：龙良曲 Tricks ▪ momentum ▪ learning rate decay Momentum https://distill.pub/2017/momentum/ No momentum With appr. momentum momentum Learning rate tunning Learning rate decay Scheme

激活函数与GPU加速 主讲人：龙良曲 Leaky ReLU simply SELU softplus GPU accelerated 下一课时 测试 Thank You.

How ▪ L1-regularization ▪ L2-regularization lambda L2-regularization L1-regularization 下一课时 动量与学习率衰 减 Thank You.