【DL輪読会】Diagnosing Vision-and-Language Navigation: What Really Matters
•
1 gefällt mir•945 views
2021/04/23 Deep Learning JP: http://deeplearning.jp/seminar-2/
![DEEP LEARNING JP
[DL Papers]
http://deeplearning.jp/
%JBHOPTJOH7JTJPOBOE-BOHVBHF/BWJHBUJPO
8IBU3FBMMZ.BUUFST
ൃදऀѨٱᖒ ܓদඌݚ%](https://image.slidesharecdn.com/20210423akuzawa-210423033955/85/DL-Diagnosing-Vision-and-Language-Navigation-What-Really-Matters-1-320.jpg?cb=1619149824)
Empfohlen
Empfohlen
Weitere ähnliche Inhalte
Mehr von Deep Learning JP
Mehr von Deep Learning JP (20)
【DL輪読会】Diagnosing Vision-and-Language Navigation: What Really Matters
- 1. DEEP LEARNING JP [DL Papers] http://deeplearning.jp/ %JBHOPTJOH7JTJPOBOE-BOHVBHF/BWJHBUJPO 8IBU3FBMMZ.BUUFST ൃදऀѨٱᖒ ܓদඌݚ%
- 2. ॻࢽใ w λΠτϧ%JBHOPTJOH7JTJPOBOE-BOHVBHF/BWJHBUJPO8IBU3FBMMZ.BUUFST w ஶऀ8BOSPOH;IV :VBOLBJ2J 1SBEZVNOB/BSBZBOB ,B[PP4POF 4VHBUP #BTV 9JOSJD8BOH 2J8V .JHVFMDLTUFJO 8JMMJBN:BOH8BOH w 6$4BOUB#BSCBSB 6OJWFSTJUZPGEFMBJEF (PPHMF 6$4BOUB$SV[ w ߘઌBSYJW w ֓ཁ7JTJPOBOEMBOHVBHFOBWJHBUJPOʹ͓͚ΔΤʔδΣϯτͷڍಈੳ
- 3. എܠ7JTJPOBOEMBOHVBHFOBWJHBUJPO 7-/ w 7-/ w ࣔࢦޠݴΛΤʔδΣϯτʹ༩͑ͯφϏήʔγϣϯΛߦΘͤΔ λεΫ w ڧԽֶशɾ฿ֶशͳͲͰΤʔδΣϯτΛ܇࿅͢Δ w ΤʔδΣϯτͷ؍ଌɿ w ࣔࢦޠݴɿΤϐιʔυ͝ͱ w ը૾ɿλΠϜεςοϓ͝ͱ w ΞΫγϣϯɿ w UVSOMFGU UVSOSJHIU HPGPSXBSEͳͲʢ͋ΔఔநԽ͞ ΕͨͷΛ͏͜ͱ͕ݱঢ়Ұൠతʣ OEFSTPOFUBM
- 8. BUUFOUJPO
- 10. 3FDVSSFOU.FDIBOJTN w 0VUEPPS 5% w 3$0/$5 $IFOFUBM 3//ϕʔεɼ506$)%08/ͷݪஶจͷϕʔεϥΠϯ w 3$ 9JBOHFUBM 3//ϕʔε
- 12. 3FTFBSDI2VFTUJPOT w ΤʔδΣϯτࣔࢦޠݴͷʮΦϒδΣΫτʯʮํʯʹؔ͢ΔτʔΫ ϯΛར༻Ͱ͖͍ͯΔ͔ w ΤʔδΣϯτը૾ೖྗΛͲ͏͍֮ͯ͠Δ͔ w ڑతʹ͍ۙԕ͍ͷʹҙΛ͚Δ͔ w ݸʑͷମγʔϯશମʹҙΛ͚Δ͔ w ΤʔδΣϯτͱޠݴը૾ͷFOUJUZΛ݁ͼ͚ͭΔ͜ͱͰ͖Δ͔
- 13. ࣮ݧ w తɿΤʔδΣϯτ͕ɼࣔࢦޠݴͷʮΦϒδΣΫτʯͱʮํʯʹؔ͢ΔใΛར༻Ͱ͖͍ͯΔ͔֬ೝ w ํ๏ɿʮΦϒδΣΫτʯͱʮํʯʹؔ͢Δ୯ʹޠϚεΫΛ͔͚ΔհೖΛߦͳͬͨ࣌ͷɼΤʔδΣϯτͷ ੑೳΛௐࠪʢϥϯμϜʹϚεΫΛ͔͚Δ߹ͱൺֱʣ w ϚεΫΛ͔͚Δͷςετ࣌ͷΈ
- 16. ࣮݁ݧ w తɿΤʔδΣϯτ͕ɼࣔࢦޠݴͷʮΦϒδΣΫτʯͱʮํʯʹؔ͢ΔใΛ ར༻Ͱ͖͍ͯΔ͔֬ೝ w ݁ɿ w 33ͰڥɼΦϒδΣΫτɾํͷτʔΫϯΛΤʔδΣϯτ͕ར༻Ͱ͖͍ͯΔ w 5%ͰڥɼΦϒδΣΫτʹؔ͢ΔใΛΤʔδΣϯτ͕ར༻Ͱ͖͍ͯͳ͍
- 17. ࣮ݧ w తɿΤʔδΣϯτ͕ը૾ͷʮΦϒδΣΫτʯʹؔ͢ΔใΛར༻Ͱ͖͍ͯΔ͔֬ೝ w ํ๏ɿΦϒδΣΫτΛ#PVOEJOH#PYͰݕ͠ɼNBTLΛ͔͚ͨͱ͖ͷΤʔδΣϯτͷ ੑೳΛௐࠪ w 33ڥͷΈͰ࣮ࢪ
- 18. ࣮݁ݧՌ w NBTL͢ΔΦϒδΣΫτ͕૿͑Δ͝ͱʹΤʔδΣϯτͷੑೳ͕Լ w NBTL͢ΔΦϒδΣΫτͱΤʔδΣϯτͷڑɼ 5SBOTGPSNFSCBTFEΤʔδΣϯτͷ߹ ͋·Γੑೳʹؔͳ͍ʢ͕ڑԕ͍ ΄Ͳ#PVOEJOH#PY͕খ͍͞ʹ1JYFMྖҬ͕খ͍͞ʹ͔͔ΘΒͣɼੑೳʹؔͳ͍ʣ w ΤʔδΣϯτલܠɾഎܠͷΦϒδΣΫτΛҙࢥܾఆʹར༻͍ͯ͠Δ
- 19. ࣮݁ݧ w తɿΤʔδΣϯτ͕ɼը૾ͷʮΦϒδΣΫτʯʹؔ͢ΔใΛͲΕͩ ͚ར༻Ͱ͖͍ͯΔ͔Λ֬ೝ w ݁ɿ w ΤʔδΣϯτը૾ͷΦϒδΣΫτʹؔ͢ΔใΛར༻͍ͯ͠Δ w ΤʔδΣϯτͱΦϒδΣΫτͷڑ 5SBOTGPSNFSCBTFEΤʔδΣϯ τͷ߹ ͋·Γؔͳ͍
- 20. ࣮ݧ w తɿΤʔδΣϯτ͕ɼࣔࢦޠݴͷʮΦϒδΣΫτʯͱը૾ͷʮΦϒδΣΫτʯΛ݁ͼ͚ͭΔ͜ͱ͕Ͱ͖͍ͯΔ͔֬ೝ w ํ๏ɿ w ࣔࢦޠݴͷհೖ w ը૾ͷհೖ
- 21. ࣮ݧ w ํ๏ɿʮΦϒδΣΫτʯʹؔ͢Δ୯ޠΛଞͷ୯ Ͱޠஔ͖͑Δͱ͍ͬͨૢ࡞Λߦͳͬͨ࣌ͷɼ ΤʔδΣϯτͷੑೳΛௐࠪ w ݁Ռɿ w 5SBOTGPSNFSܥͷख๏SFQMBDFʹΑͬͯੑೳ ͕େ͖͘Լ͢Δ w 5SBOTGPSNFSܥͷख๏ɼΦϒδΣΫτʹ ؔ͢Δޠݴɾࢹ֮ใΛ݁ͼ͚ͭΔ͜ͱ͕Մೳ
- 22. ࣮ݧ w ํ๏ɿը૾͔ΒʮΦϒδΣΫτʯΛ#PVOEJOH#PYͰݕ͠ɼͦͰࣔࢦޠݴͷΦϒδΣΫτ͕͞ٴݴΕ͍ͯΔ߹ͷΈNBTL Λ͔͚Δ w JF λεΫʹͱͬͯඞཁͳΦϒδΣΫτʹϚεΫΛ͔͚Δ w ݁ՌɿϥϯμϜʹϚεΫΛ͔͚ͨ߹ͱɼ͋·Γੑೳ͕มΘΒͳ͍ w ߟɿ࣮ݧΑΓɼޠݴͷհೖੑೳʹେ͖ͳӨڹɽ࣮ݧΑΓɼը૾ͷհೖੑೳʹখ͞ͳӨڹ w ը૾ͱޠݴͷΦϒδΣΫτΛରͰରԠ͍ͤͯ͞ΔΘ͚Ͱͳ͘ɼը૾ͷ(MPCBMͳಛΛͱޠݴରԠ͚͍ͮͯΔͷͰʁ
- 23. ࣮݁ݧ w తɿΤʔδΣϯτ͕ɼࣔࢦޠݴͷʮΦϒδΣΫτͱը૾ͷʮΦϒδΣ ΫτʯΛ݁ͼ͚ͭΔ͜ͱ͕Ͱ͖͍ͯΔ͔֬ೝ w ݁ɿ w 5SBOTGPSNFSܥͷख๏ɼΦϒδΣΫτʹؔ͢Δޠݴɾࢹ֮ใΛ݁ͼ ͚ͭΔ͜ͱ͕Մೳ w ͨͩ͠ɼࢹ֮ใͷதͷΦϒδΣΫτͷ#PVOEJOH#PYͱޠݴΛਖ਼֬ʹ݁ ͼ͚͍ͭͯΔͷͰͳ͘ɼγʔϯશମͱޠݴΛ݁ͼ͚ͭͯཧղ͍ͯ͠ΔՄ ೳੑ͕͋Δ
- 24. 3FTFBSDI2VFTUJPOTͱ,FZpOEJOHT·ͱΊ w ࣔࢦޠݴͷʮΦϒδΣΫτʯʮํʯʹؔ͢ΔτʔΫϯΛར༻Ͱ͖͍ͯΔ͔ w 5PVDIEPXOͰڥɼΤʔδΣϯτ͕ΦϒδΣΫτʹؔ͢ΔใΛ͋·Γར༻Ͱ͖͍ͯͳ ͍ɽΑΓ*ͳྗڧNBHF'FBUVSFYUSBDUPS 0CKFDU%FUFDUPST͕ඞཁʁ w ΤʔδΣϯτը૾ೖྗΛͲ͏͍֮ͯ͠Δ͔ w ڑతʹ͍ۙԕ͍ΦϒδΣΫτʹҙΛ͚Δ͔ 5SBOTGPSNFSCBTFEͩͱ ؔͳͦ͞͏ w ݸʑͷମγʔϯશମʹҙΛ͚Δ͔γʔϯશମར༻͍ͯ͠Δ w ΤʔδΣϯτςΩετͱը૾ͷFOUJUZΛ݁ͼ͚ͭΔ͜ͱͰ͖Δ͔ w ඞͣ݁͠ͼ͍͍ͭͯͳ͍ɽ͋ΔΦϒδΣΫτʹؔ͢Δ୯ͱޠɼͦΕʹରԠ͢ΔγʔϯશମΛ ݁ͼ͚͍ͭͯΔՄೳੑ͕͋Δ
- 25. ·ͱΊ w φϏήʔγϣϯΤʔδΣϯτ͕ͱޠݴը૾ͷϚϧνϞʔμϧσʔλΛͲͷ Α͏ʹղऍ͍ͯ͠Δ͔ௐࠪΛߦͬͨ w ͜ͷจͷݟΛλεΫͷઃఆφϏήʔγϣϯΤʔδΣϯτͷઃʹܭ ཱͯͯཉ͍͠ w 5PVDIEPXOͰڥɼΑΓ*ͳྗڧNBHF'FBUVSFYUSBDUPS 0CKFDU%FUFDUPST͕ඞཁ w (MPCBMͳը૾ಛʢγʔϯશମʣͷׂʹ͍ͭͯ͞ΒͳΔ͕ڀݚඞཁ
- 26. ൃදऀͷײ w ΤʔδΣϯτͷڍಈͷௐࠪΛߦ͏ํ๏ͱͯ͠ࢀߟʹͳΓ·ͨ͠ɽ w ࣮ݧͷɼޠݴͷΦϒδΣΫττʔΫϯʹհೖ͢Δ߹ͱɼը૾ͷΦ ϒδΣΫτ#PVOEJOH#PYʹհೖ͢Δ߹Ͱɼੑೳ͕ҟͳΔͱ͍͏ͷ໘ ന͍Ͱ͢ɽ w 'JHVSFͷɼʮਓؒͷੑೳʹٴͳ͍ʯͱ͍͏ٞʹ͍ͭͯɼαϯϓ ϧαΠζΛແ૿ʹݶ͢͜ͱ͕Ͱ͖ͳ͍ͷͰɼσʔλͷݶք͔ΞϧΰϦζ Ϝͷݶք͔ۃݟΊΔ͜ͱ͕Ͱ͖ͳ͍ͷ͕ͩͱࢥ͍·ͨ͠ɽ7-/ʹ͓͍ ͯαϯϓϧαΠζΛແ૿ʹݶͤΔγϛϡϨʔλ͕ཉ͍͠Ͱ͢ɽ
- 27. ࢀߟจݙ w OEFSTPOFUBM$713 7JTJPOBOE-BOHVBHF/BWJHBUJPO*OUFSQSFUJOHWJTVBMMZ HSPVOEFEOBWJHBUJPOJOTUSVDUJPOTJOSFBMFOWJSPONFOUT w $IFOFUBM$713 5PVDIEPXO/BUVSBM-BOHVBHF/BWJHBUJPOBOE4QBUJBM3FBTPOJOH JO7JTVBM4USFFUOWJSPONFOUT w 5BOFUBM-FBSOJOHUPOBWJHBUFVOTFFOFOWJSPONFOUT#BDLUSBOTMBUJPOXJUIFOWJSPO NFOUBMESPQPVU w )POHFUBMSFDVSSFOUWJTJPOBOEMBOHVBHF#35GPSOBWJHBUJPO w )BPFUBM$713 5PXBSETMFBSOJOHBHFOFSJDBHFOUGPSWJTJPOBOEMBOHVBHF OBWJHBUJPOWJBQSFUSBJOJOH w 9JBOHFUBM./-1 -FBSOJOHUPTUPQTJNQMFZFUF⒎FDUJWFBQQSPBDIUPVSCBO WJTJPOMBOHVBHFOBWJHBUJPO w ;IVFUBM.VMUJNPEBMUFYUTUZMFUSBOTGFSGPSPVUEPPSWJTJPOBOEMBOHVBHFOBWJHBUJPO
- 28. QQFOEJY