Output padding - max comparing beta e 150,528 Type Input convolution Max pooling Local RN 3x3_reduce convolution Local RN Max pooling Inception 3a Inception 3b Max pooling Inception 4a Patch size/S/P 7x7/2/3 3x3/2/0 3x3/1/1 3x3/1/1 3x3/2/0 1x1/1/0 1x1/1/0 3x3/1/1 1x1/1/0 5x5/1/2 3x3/1/1 MAX 1x1/1/0 PRO 1x1/1/0 1x1/1/0 3x3/1/1 1x1/1/0 5x5/1/2 3x3/1/1 MAX 1x1/1/0 PRO 3x3/2/0 1x1/1/0 1x1/1/0 3x3/1/1 1x1/1/0 224 x224 x3 112x112 x64 56x56 x64 56x56 x64 56x56 x64 56x56 x192 56x56 x192 28x28 x192 28x 28x192 28x 28x96 28x 28x128 28x 28x16 28x 28x32 28x 28x192 28x 28x32 28x 28x128 28x 28x128 28x 28x192 28x 28x32 28x 28x96 28x 28x256 28x 28x64 14x 14x480 14x 14x192 14x 14x96 14x 14x208 14x 14x16 x + 150,525 8,172 118,013,952 118,013,952 14,592 11,136 3,840 22,272 14,848 7,680 29,696 5,760 1,367,296 12,845,056 346,816,512 4,177,152 9,633,792 14,450,688 86,704,128 2,408,448 10,035,200 4,816,896 25,690,112 25,690,112 173,408,256 6,422,528 24,883,200 1,166,592 12,845,056 346,816,512 3,575,040 9,633,792 14,450,688 86,704,128 2,408,448 10,035,200 4,816,896 25,690,112 25,690,112 173,408,256 6,422,528 24,883,200 12,845,056 12,845,056 18,063,360 9,031,980 35,223,552 1,505,280 18,063,360 9,031,980 35,223,552 1,505,280 / 3 200,704 602,112 802,816 200,704 602,112 50,176 75,264 100,352 12,544 25,088 1,605,632 1,204,224 1,204,224 25,088 100,352 100,352 150,528 25,088 31,104 1,605,632 50,176 37,632 18,816 40,768 3,136 752,640 200,704 602,112 para 812,224 3 204,800 712,704 3 62,464 93,696 210,944 15,616 37,888 31,232 133,120 133,120 592,896 33,280 152,064 66,560 129,792 64,896 220,480 10,816 

5x5/1/2 3x3/1/1 MAX 1x1/1/0 PRO 1x1/1/0 1x1/1/0 3x3/1/1 1x1/1/0 5x5/1/2 3x3/1/1 MAX 1x1/1/0 PRO 1x1/1/0 1x1/1/0 3x3/1/1 1x1/1/0 5x5/1/2 3x3/1/1 MAX 1x1/1/0 PRO 1x1/1/0 1x1/1/0 3x3/1/1 1x1/1/0 5x5/1/2 3x3/1/1 MAX 1x1/1/0 PRO 1x1/1/0 1x1/1/0 3x3/1/1 1x1/1/0 14x 14x48 14x 14x480 2,048 19,200 3,763,200 3,763,200 14x 14x64 14x 14x160 14x 14x112 14x 14x224 14x 14x24 14x 14x64 14x 14x512 14x 14x64 14x 14x128 14x 14x128 14x 14x256 14x 14x24 14x 14x64 14x 14x512 14x 14x64 14x 14x112 14x 14x144 14x 14x288 14x 14x32 14x 14x64 14x 14x512 14x 14x64 14x 14x256 14x 14x160 14x 14x320 14x 14x32 6,720 3,072 30,720 7,680 3,072 30,720 8,640 4,096 30,720 9,600 6,021,120 16,056,320 11,239,424 44,255,232 2,408,448 7,526,400 6,422,528 12,845,056 12,845,056 57,802,752 2,408,448 7,526,400 6,422,528 11,239,424 14,450,688 73,156,608 3,211,264 10,035,200 6,422,528 26,492,928 16,558,080 90,316,800 3,311,616 6,021,120 16,056,320 11,239,424 44,255,232 2,408,448 7,526,400 6,422,528 12,845,056 12,845,056 57,802,752 2,408,448 7,526,400 6,422,528 11,239,424 14,450,688 73,156,608 3,211,264 10,035,200 6,422,528 26,492,928 16,558,080 90,316,800 3,311,616 Inception 4b Inception 4c Inception 4d Inception 4e 9,408 12,544 31,360 21,952 43,904 4,704 12,544 12,544 25,088 25,088 50,176 4,074 12,544 12,544 21,952 28,224 56,448 6,272 15,544 12,544 50,176 31,360 62,720 6,272 752,640 802,816 802,816 802,816 28,608 43,264 113,280 79,296 269,696 16,992 50,944 45,312 90,624 90,624 302,080 16,992 50,944 45,312 79,296 101,952 429,696 22,656 63,744 45,312 185,344 115,840 523,520 23,168 

14x 14x128 14x 14x528 4,096 31,680 20,070,400 20,070,400 14x 14x128 7x7x832 7x7x256 7x7x160 7x7x320 7x7x32 7x7x128 7x7x832 7x7x128 7x7x384 7x7x192 7x7x384 7x7x48 7x7x128 7x7x832 7x7x128 1x1x1024 1x1x1000 1x1x1000 5,120 2,304 26,624 6,144 3,456 26,624 13,246,464 13,246,464 10,436,608 6,522,880 22,579,200 1,304,576 5,017,600 5,218,304 15,654,912 7,827,456 32,514,048 1,956,864 7,526,400 5,218,304 1,024,000 10,436,608 6,522,880 22,579,200 1,304,576 5,017,600 5,218,304 15,654,912 7,827,456 32,514,048 1,956,864 7,526,400 5,218,304 49,152 1,024,000 999 380,332 1,552,888,620 1,552,286,480 5x5/1/2 3x3/1/1 MAX 1x1/1/0 PRO 7x7/2/0 1x1/1/0 1x1/1/0 3x3/1/1 1x1/1/0 5x5/1/2 3x3/1/1 MAX 1x1/1/0 PRO 1x1/1/0 1x1/1/0 3x3/1/1 1x1/1/0 5x5/1/2 3x3/1/1 MAX 1x1/1/0 PRO 7x7/2 7x7/2 7x7/2 共计 x Max pooling Inception 5a Inception 5b Ave pooling Linear (FC) Softmax padding 380,332 + / 1,552,888,620 1,552,286,480 804,843 - 151,528 1024 1000 804,843 1000 151,528 25,088 25,088 12,544 7,840 15,680 1,568 6,272 6,272 18,816 9,408 18,816 2,352 6,272 6,272 827,904 326,144 326,144 326,144 999 3,184,370 11,340,775 802,816 1000 1,000 127,488 92,672 225,536 140,960 476,480 28,192 108,672 112,768 338,304 169,152 682,368 42,288 159,872 112,768 1,024,000 10,394,614 9．91M max 3,184,370 comparing 11,340,775 beta 802,816 e 1,000 para 10,394,614 9．91M