1Ŀ
ȵppʳƷԭϵIJُLUҴ_еĮa(chn)ƷͳZϷʴ_Ҍٌ
2m÷
mù˾a(chn)Ʒa(chn)ĸh(hun)(ji)ُӹ惦N۵
3؟
3.1|(zh)ؓ؟ļĔMӆĺͱO(jin)ܴʺ(zh)
3.2PTؓ؟ձļ(zh)
4
4.1ԃa(chn)ƷٻðLU
PɌԭϮa(chn)ٻðLUĹ朵ͬF(xin){Ϣ
ϢɁԴڣИI(y)f(xi)ʳƷW(wng)W(wng)վЈO(jin)l(wi)ίTȣ_l(f)¹̕rԃǷ(jng)О鱻W(wng)վع⣬Єtֹͣ_l(f)ԓҹڲԃϾW(wng)վ漰˾̵Įa(chn)Ʒzϸֹͣcԓҹ
4.2еʳƷԭϻԭϽMMгĵĴu
ʳƷȫСMMLMPˆT(j)˾ԭoϵeMдԷԷӛ䛡(jng)ʳƷȫСMӑՓ˺MLҪƵĴLU
Է(ni)£
4.2.1 ʳƷȫСM(j)Էӛ䛡ReΣ(j)Լl(f)ĿcСس̶Mз
4.2.2 ԭoϷrҪ](ni)ݣ
4.2.2.1ٻ^C(j)
4.2.2.2܌?lin)ٻðƸĽ?jng)
4.2.2.3ͨ^朽|ԭϵy׳̶
4.2.2.4ԭϵ|(zh)
ÿʳƷȫСMMLؓ؟MPܲTʳƷȫСMԷӛ䛡MuҪrM(zh)СļƳ
F(xin)rrReLU
Ҫԭϼb˺l(f)׃PʳƷȫɷҎ(gu)Ҫҹ˾ܵҪl(f)׃
4.3ԭƷēٱO(jin)
˾ĺϸвُԭc̺ӆԭϽֹٳZաُƳُԭ
}쌦MSԭbMաg|(zh)ԭϰƶԭ˜ԭϘ˜ʼշPԭχҘ˜ƶ
ͷؓ؟\ݔ˾ıO(jin)ʹY|(zh)\ݔ˾ҹ˾䰸\ݔ˾ÿΰl(f)؛ǰͷˆTO(jin)C(j)l(f)؛ʹý(jng)^\ݔ|(zh)u؛˾
ԭϱǓٻðƵضLUr£ȡCyԇԭϳɷMCҪr²ȡ͵zyCz
4.4 a(chn)^̵ēٿ
a(chn)ʹõԭϾǏĂ}Iȡκ˲Ôyδ(jng)ʵԭMa(chn)܇ga(chn)ST̎܇gбO(jin)أ24СrO(jin)
4.5 a(chn)ƷZĿ
繫˾a(chn)ƷƷbضĘʾ˺Դa(chn)GMOЙCȣҪ_͘˺Zһ˾a(chn)ƷD(zhun)B(ti)ˌÿһԭϵĠB(ti)
a(chn)ЙC϶YZrSSֱҪJCB(ti)@ӵijZ
˾ُӛԭʹõĿԺKĮa(chn)ƷbӛԌF(xin)ijZ
˾ضҪlʻȱʧضҪrÿ6һεMгĵƽyԇ
ӛZĮa(chn)Ʒa(chn)ļӹ̲ReȾ݁Gʧĝڅ^(q)m?sh)ĿƣԴ_a(chn)ƷZ