学在北邮

/ Study in BUPT

首页 · 学在北邮 · 学术活动 · 正文

Interleaved Group Convolutions for Efficient Deep Neural Networks

主讲人 :王井东 地点 :教三楼718会议室 开始时间 : 2018-04-23 14:00 结束时间 : 2018-04-23 16:00

报告摘要:

Eliminating the redundancy in convolution kernels has been attracting increasing interests for designing efficient convolutional neural network architectures with three goals: small model, fast computation, and high accuracy. Existing solutions include low-precision kernels, structured

sparse kernels, low-rank kernels, and the product of low-rank kernels. In this talk, I will introduce a novel framework: Interleaved Group Convolution (IGC),which uses the product of structured sparse kernels to compose a dense convolution kernel. It is a drop-in replacement of normal convolution and can be applied to any networks that depend on convolution. I present the

complementary condition and the balance condition to guide the design, obtaining a balance between three aspects: model size, computation complexity and classification performance. I will show empirical and theoretic justification of the advantage of the proposed approach over Xception and MobileNet. In addition, IGC raises a rarely-studied matrix decomposition problem: spars matrix factorization (SMF). I expect more research efforts in SMF from the researchers in the area of matrix analysis.

 

主讲人简介:

Jingdong Wang is a Senior Researcher at the Visual Computing Group, Microsoft Research, Beijing, China. His areas of interest include computer vision, machine learning, and multimedia. He is currently working on CNN architecture design, human understanding, person re-identification, multimedia search, and large-scale indexing. He has served as an area chair (or SPC) in prestigious conferences, including CVPR, ICCV, ECCV, ACMMM, AAAI, IJCAI, and so on. He is an editorial board member for IEEE Transactions on Circuits and Systems for Video Technology, IEEE Transactions on Multimedia, and Tools and Applications. He is a Fellow of the IAPR. He has shipped 10+ technologies to Microsoft products, including XiaoIce Chatbot, Microsoft cognitive service, and Bing search.

此讲座为前沿课题讲座,欢迎全校师生踊跃参加。

分享到