๊ด€๋ฆฌ ๋ฉ”๋‰ด

๋ชฉ๋ก๋ฐฐ์น˜ ์ •๊ทœํ™” (1)

DATA101

[Deep Learning] Batch Normalization(๋ฐฐ์น˜ ์ •๊ทœํ™”) ๊ฐœ๋… ๋ฐ ์žฅ์ 

๐Ÿ“Œ ๋“ค์–ด๊ฐ€๋ฉฐ ๋ณธ ํฌ์ŠคํŒ…์—์„œ๋Š” ๋”ฅ๋Ÿฌ๋‹ Generalization ๊ธฐ๋ฒ• ์ค‘ ํ•˜๋‚˜์ธ ๋ฐฐ์น˜ ์ •๊ทœํ™”(Batch Normalization)์— ๋Œ€ํ•ด ์•Œ์•„๋ด…๋‹ˆ๋‹ค. ๋จผ์ €, ๋ฐ์ดํ„ฐ ์ •๊ทœํ™”์˜ ํ•„์š”์„ฑ์— ๋Œ€ํ•ด ์•Œ์•„๋ณด๊ณ , Batch Normalization์˜ ๋“ฑ์žฅ ๋ฐฐ๊ฒฝ์ธInternal Covariate Shift ํ˜„์ƒ์— ๋Œ€ํ•ด ์†Œ๊ฐœํ•ฉ๋‹ˆ๋‹ค. ์ดํ›„ Batch Normalization์˜ ๊ฐœ๋…๊ณผ ํŠน์ง•์— ๋Œ€ํ•ด ์•Œ์•„๋ณด๊ฒ ์Šต๋‹ˆ๋‹ค. ๐Ÿ“š ๋ชฉ์ฐจ 1. ๋ฐ์ดํ„ฐ ์ •๊ทœํ™” 1.1. ๊ฐœ๋… 1.2. ํ•„์š”์„ฑ 2. Internal Covariate Shift ํ˜„์ƒ 2.1. ๊ฐœ๋… 2.2. ๋ฌธ์ œ์  3. Batch Normalization 3.1. ๊ฐœ๋… 3.2. ์žฅ์  3.3. ๋‹จ๊ณ„๋ณ„ Batch Normalization 1. ๋ฐ์ดํ„ฐ ์ •๊ทœํ™” 1.1. ๊ฐœ๋… ๋ฐ์ดํ„ฐ ์ •๊ทœํ™”(No..