12æ18æ¥ãã¢ã¹ã¯ã¯ç©çæè¡ç 究æã®ãã¥ãŒã©ã«ã·ã¹ãã ãšãã£ãŒããã¬ãŒãã³ã°ã®ç 究æããã®DeepHack.Babelããã«ãœã³ãžã®åå ã®ããã®éžæãã¢ãŒãå§ãŸããŸããã ç 究ã³ãã¥ããã£ã§äººæ°ãåããŠããããã§ã«åçšè£œåã§äœ¿çšãããŠãããã¥ãŒã©ã«ãããã¯ãŒã¯æ©æ¢°ç¿»èš³ã«éç¹ã眮ãããŸãã ããã«ãäžè¬ã«åãå ¥ããããŠããæ £è¡ã«åããŠãé䞊åããŒã¿ã§æ©æ¢°ç¿»èš³ã·ã¹ãã ããã¬ãŒãã³ã°ããå¿ èŠããããŸããã€ãŸããæ©æ¢°åŠç¿ã®èŠ³ç¹ãããæåž«ã¯é¢äžããŸããã ãŸã ç»é²ãæ€èšããŠããå Žåããªããããå¿ èŠãªã®ãã説æããŸãã
以åã¯äœã§ããã
æè¿ãŸã§ïŒãã¥ãŒã©ã«ãããã¯ãŒã¯ãæ®åããåïŒãæ©æ¢°ç¿»èš³ã·ã¹ãã ã¯æ¬è³ªçã«ç¿»èš³ãªãã·ã§ã³ã®ããŒãã«ã§ããããœãŒã¹èšèªã®ååèªãŸãã¯ãã¬ãŒãºã«ã€ããŠãã¿ãŒã²ããèšèªãžã®å€æ°ã®å¯èœãªç¿»èš³ã瀺ãããŠããŸããã ãããã®ç¿»èš³ã¯ãåèªãšè¡šçŸã®åæçºçã®é »åºŠãåæããããšã«ãããå€æ°ã®äžŠè¡ããã¹ãïŒäºãã«æ£ç¢ºã«ç¿»èš³ããã2ã€ã®èšèªã®ããã¹ãïŒãšåºå¥ãããŸããã è¡ã翻蚳ããã«ã¯ãåã ã®åèªããã¬ãŒãºã®ç¿»èš³ãçµã¿åãããŠæç« ã«ãããã£ãšãããããªãã·ã§ã³ãéžæããå¿ èŠããããŸããã
ãer geht ja nicht nach hauseãïŒã圌ã¯å®¶ã«åž°ããªããïŒãšããæã®åã ã®åèªããã¬ãŒãºãè±èªã«ç¿»èš³ãããªãã·ã§ã³ã ãªãã·ã§ã³ã®å質ã¯ãããšãã°ã確çpïŒ e | f ïŒããã³pïŒ f | e ïŒãªã©ã®å±æ§ã®å€ã®å éåèšã«ãã£ãŠæ±ºãŸããŸããããã§ã eããã³fã¯ãœãŒã¹ããã³ã¿ãŒã²ããã®ãã¬ãŒãºã§ãã é©åãªç¿»èš³ã«å ããŠããã¬ãŒãºã®é åºãéžæããå¿ èŠããããŸãã ãã£ãªããã±ãŒã³ãã¬ãŒã³ããŒã·ã§ã³ããã®ã€ã©ã¹ãã
ããã§ãæ©æ¢°ç¿»èš³ã·ã¹ãã ã®2çªç®ã®ã³ã³ããŒãã³ããã€ãŸãèšèªã®ç¢ºçã¢ãã«ãç»å ŽããŸããã å€å žçãªããŒãžã§ã³-n - gramã®èšèªã¢ãã« -å€æããŒãã«ã®ããã«ãåèªã®å ±ååºçŸã«åºã¥ããŠããŸãããä»åã¯ç¹å®ã®æ¥é èŸïŒ nåã®åã®åèªïŒã®åŸã®åèªã«åºäŒã確çã«ã€ããŠã§ãã çæãããæã®ååèªã®å°€åºŠãé«ãã»ã©ïŒã€ãŸããåèªã®éžæã«ããèšèªã¢ãã«ããé©ããããã»ã©ïŒãèªç¶ã«èããããããæ£ãã翻蚳ã§ããå¯èœæ§ãé«ããªããŸãã ãã®ãããªææ³ã¯ãäžèŠå¶éã¯ãããã®ã®ãéåžžã«é«å質ã®ç¿»èš³ãå®çŸããããšãå¯èœã«ããŸãããç¹ã«ãèšèªã®ç¢ºççã¢ãã«ã¯åäžèšèªïŒäžŠåã§ã¯ãªãïŒã³ãŒãã¹ã§ã®ã¿åŠç¿ããããããéåžžã«å€§éã®ããŒã¿ã§ãã¬ãŒãã³ã°ã§ããŸãããããŠã圌女ã¯ããªããã©ã®ããã«è©±ãããšãã§ãããã«ã€ããŠããç¥ããããŸãããã©ã®ããã«ãããªãã§ãããã
ãã¥ãŒã©ã«ãããã¯ãŒã¯ã®åºçŸã§äœãå€ãã£ãã®ã
ãã¥ãŒã©ã«ãããã¯ãŒã¯ã¯æ©æ¢°ç¿»èš³ãžã®ã¢ãããŒããå€ããŸããã çŸåšã翻蚳ã¯ãæå šäœããã¯ãã«è¡šçŸïŒãã®æã®äžè¬çãªæå³ãèšèªã«äŸåããªã圢åŒã§å«ãïŒã«ããšã³ã³ãŒããããŠããããã®è¡šçŸãã¿ãŒã²ããèšèªã®åèªã«ããã³ãŒããããããšã«ãã£ãŠè¡ãããŸãã ãããã®å€æã¯ãå€ãã®å Žåããªããžã§ã¯ãã®ã·ãŒã±ã³ã¹ïŒãã®å Žåã¯åèªã®ã·ãŒã±ã³ã¹ïŒãåŠçããããã«ç¹å¥ã«èšèšããããªã«ã¬ã³ããã¥ãŒã©ã«ãããã¯ãŒã¯ã䜿çšããŠå®è¡ãããŸãã
3å±€ã¢ãã«ã®ãšã³ã³ãŒããŒ/ãã³ãŒããŒã®ã¹ããŒã ã ãšã³ã³ãŒããŒïŒèµ€è²ã®éšåïŒã¯æã®è¡šçŸãçæããŸããåã¹ãããã§ãæ°ããå ¥ååèªãšå ã«èªãã åèªã®è¡šçŸãçµã¿åãããŸãã éè²ã®éšåã¯ãææ¡å šäœã®ãã¬ãŒã³ããŒã·ã§ã³ã§ãã ãã³ãŒããŒïŒç·è²ã®éšåïŒã¯ãå ã®æãšä»¥åã«çæãããåèªã®è¡šçŸã«åºã¥ããŠãåºåèšèªã§åèªãçºè¡ããŸãã ACL-2016ã®ãã¥ãŒã©ã«ãããã¯ãŒã¯æ©æ¢°ç¿»èš³ãã¥ãŒããªã¢ã«ããæç²ããå³ã
åã¹ãããã§ããã®ãããªãã¥ãŒã©ã«ãããã¯ãŒã¯ã¯ãæ°ããå ¥ååèªïŒããæ£ç¢ºã«ã¯ããã®ãã¯ãã«è¡šçŸïŒãšä»¥åã®åèªã«é¢ããæ å ±ãçµã¿åãããŸãã ãã¥ãŒã©ã«ãããã¯ãŒã¯ã®ãã©ã¡ãŒã¿ãŒã¯ãåã¹ãããã§ãå¿ãããéãšãèšæ¶ãããéã決å®ãããããæå šäœã®è¡šç€ºã«ã¯ãããããæãéèŠãªæ å ±ãå«ãŸããŸãã ãšã³ã³ãŒããŒ-ãã³ãŒããŒã¢ãŒããã¯ãã£ãŒã¯æ¢ã«å€å žçãªãã®ã«ãªã£ãŠããŸããããšãã°ã[1]ã§èª¬æãèªãããšãã§ããŸãã
å®éããã®ã·ã¹ãã ã®æšæºããŒãžã§ã³ã¯æåŸ ã©ããã«æ©èœããªããããåªãã翻蚳å質ãåŸãã«ã¯è¿œå ã®ããªãã¯ãå¿ èŠã§ãã ããšãã°ãéåžžã®ã»ã«ãå«ããªã«ã¬ã³ããããã¯ãŒã¯ã¯ãåŸé ã®ççºãŸãã¯æžè¡°ã®åœ±é¿ãåããŸãïŒã€ãŸããåŸé ã¯ãŒããŸãã¯éåžžã«å€§ããªå€ã«åæããå€åããªããªãããããã¯ãŒã¯ã®åŠç¿ãäžå¯èœã«ãªããŸãïŒ-ç°ãªãæ§é ã®ãã¥ãŒãã³-LSTM [2]ããã³GRU [ãã®ããã«ææ¡ãããŸãã3]ãåã¹ãããã§ãã©ã®æ å ±ããå¿ãããããã©ã®æ å ±ãæž¡ããã決å®ããŸãã é·ãæãèªããšããã·ã¹ãã ã¯ããããã©ãããå§ãŸã£ãããå¿ããŸã-ãã®å Žåã[4]ã§è¡ãããããã«ãæãæåãšæåŸããèªãåæ¹åãããã¯ãŒã¯ã䜿çšããã®ã«åœ¹ç«ã¡ãŸãã ããã«ãçµ±èšã·ã¹ãã ãšã®é¡æšã«ãããå ã®æã®åã ã®åèªãšãã®ç¿»èš³ãšã®å¯Ÿå¿ãæ確ã«æãããšãæçšã§ããããšãå€æããŸãã-ãã®ããã«ãä»ã®åé¡ã§ãã§ã«äœ¿çšãããŠãã泚æã¡ã«ããºã ãé©çšãããŸããïŒæ©æ¢°ç¿»èš³ãžã®æ³šæã®é©çšã¯ãããšãã°ã [5]ã泚æã®ç°¡æœã§ç°¡åãªèª¬æããã®æçš¿ã«ãããŸã ïŒã ããã¯ããã³ãŒãïŒç¿»èš³ã®çæïŒæã«ãã·ã¹ãã ããã®ã¹ãããã§å ã®æã®ã©ã®åèªã翻蚳ãã¹ããã«ã€ããŠã®æ å ±ãåãåããšããäºå®ã«ãããŸãã
ãšã³ã³ãŒããŒãã³ãŒããŒã¢ãŒããã¯ãã£ãŒã®ã¢ãã³ã·ã§ã³ã¡ã«ããºã ã ãã³ãŒããŒã®çŸåšã®ç¶æ ïŒBïŒã¯ããšã³ã³ãŒããŒã®åç¶æ ïŒAïŒãšä¹ç®ãããŸã-ãã®ããã«ããŠãå ¥åã¯ãŒãã®ã©ããçŸæç¹ã§ãã³ãŒããŒã«æãé¢é£ããããå€å¥ããŸãïŒä¹ç®ã®ä»£ããã«ãå¥ã®æäœã䜿çšããŠé¡äŒŒæ§ãå€å¥ã§ããŸãïŒã 次ã«ããã®ä¹ç®ã®çµæã¯ãsoftmaxé¢æ°ã«ãã£ãŠç¢ºçååžã«å€æãããŸããããã¯ããã³ãŒãã®åå ¥åèªã®éã¿ãè¿ããŸãã éã¿ä»ããšã³ã³ãŒããŒç¶æ ã®çµã¿åããããã³ãŒããŒã«äŸçµŠãããŸãã ã¯ãªã¹ã»ãªã©ãŒã®æçš¿ããåãããã€ã©ã¹ãã
ããããã¹ãŠã®è¿œå ææ³ã䜿çšããŠããã¥ãŒã©ã«ãããã¯ãŒã¯ã§ã®æ©æ¢°ç¿»èš³ã¯çµ±èšã·ã¹ãã ã確å®ã«ç¡å¹ã«ããŸããããšãã°ã æ©æ¢°ç¿»èš³ã·ã¹ãã ã®æåŸã®ç«¶äºã§ããã¥ãŒã©ã«ãããã¯ãŒã¯ã¢ãã«ã¯ã»ãšãã©ãã¹ãŠã®èšèªãã¢ã§æåã«ãªããŸããã ãã ããéå»ã®çµ±èšã¢ãã«ã«ã¯ããã¥ãŒã©ã«ãããã¯ãŒã¯ã«ãŸã 転éã§ããªãæ©èœããããŸã-ããã¯ã倧éã®é䞊åããŒã¿ïŒã€ãŸããä»ã®èšèªãžã®ç¿»èš³ããªãããŒã¿ïŒã䜿çšããæ©èœã§ãã
é䞊åããŒã¿ã䜿çšããçç±
ãã¥ãŒã©ã«ãããã¯ãŒã¯ã·ã¹ãã ããããããªããŠãéåžžã«åªããŠããå Žåããªãé䞊åããŒã¿ã䜿çšããã®ã§ããããïŒ å®éã«ã¯ãé«å質ã«ã¯éåžžã«å€§éã®ããŒã¿ãå¿ èŠã§ãããåžžã«å©çšã§ãããšã¯éããŸããã ãã¥ãŒã©ã«ãããã¯ãŒã¯ã¯ãã¬ãŒãã³ã°ããŒã¿ã®éãèŠæ±ããŠããããšãç¥ãããŠããŸãã éåžžã«å°ããªããŒã¿ã»ããã§ã¯ãåŸæ¥ã®æ¹æ³ïŒãµããŒããã¯ã¿ãŒãã·ã³ãªã©ïŒããã¥ãŒã©ã«ãããã¯ãŒã¯ããã€ãã¹ããããšãç°¡åã«ç¢ºèªã§ããŸãã æ©æ¢°ç¿»èš³ã«ã¯ãæã人æ°ã®ããèšèªãã¢ïŒè±èªEuropeanãšãŒãããã®äž»èŠèšèªãè±èªäžåœèªãè±èªãã·ã¢èªïŒã®ååãªããŒã¿ãããããã®ãããªèšèªãã¢ã®ãã¥ãŒã©ã«ãããã¯ãŒã¯ã¢ãŒããã¯ãã£ã¯éåžžã«è¯ãçµæã瀺ããŠããŸãã ãããã䞊åããŒã¿ã®æäŸãæ°çŸäžæªæºã®å Žåããã¥ãŒã©ã«ãããã¯ãŒã¯ã¯åœ¹ã«ç«ã¡ãŸããã 䞊åããŒã¿ãè±å¯ãªãã®ãããªèšèªã®ãã¢ã¯ã»ãšãã©ãããŸããããéåžžã«å€ãã®èšèªãããã³ãã¥ãŒã¹ãããã°ããœãŒã·ã£ã«ãããã¯ãŒã¯ãæ¿åºæ©é¢ã®äœåãªã©ãå€æ°ã®èšèªã§åäžèšèªã®ããã¹ããå©çšã§ããŸã-æ°ããã³ã³ãã³ãã¯çµ¶ããçæãããŠããŸãã ãããã®ããã¹ãã¯ãã¹ãŠãçµ±èšã·ã¹ãã ã®æ¹åã«åœ¹ç«ã£ãã®ãšåæ§ã«ããã¥ãŒã©ã«ãããã¯ãŒã¯æ©æ¢°ç¿»èš³ã®å質ãæ¹åããããã«äœ¿çšã§ããŸãããæ®å¿µãªããããã®ãããªæè¡ã¯ãŸã éçºãããŠããŸããã
ããæ£ç¢ºã«ã¯ãåäžèšèªããã¹ãã§ãã¥ãŒã©ã«ãããã¯ãŒã¯ç¿»èš³ã·ã¹ãã ããã¬ãŒãã³ã°ããããã€ãã®äŸããããŸãã[6]ã§ã¯ããšã³ã³ãŒããŒãã³ãŒããŒã¢ãŒããã¯ãã£ãšç¢ºççèšèªã¢ãã«ã®çµã¿åããã説æããã[7]ã§ã¯ãåäžèšèªã³ãŒãã¹ã®æ¬ èœãã翻蚳ãã¢ãã«èªäœã«ãã£ãŠçæãããŸãã ãããã®æ¹æ³ã¯ãã¹ãŠç¿»èš³ã®å質ãåäžãããŸããããã¥ãŒã©ã«ãããã¯ãŒã¯æ©æ¢°ç¿»èš³ã·ã¹ãã ã§ã®åäžèšèªã³ãŒãã¹ã®äœ¿çšã¯ãŸã äžè¬çãªæ £è¡ã«ãªã£ãŠããŸããïŒãã¬ãŒãã³ã°ã§é䞊åããã¹ãã䜿çšããæ¹æ³ã¯ãŸã æ確ã§ã¯ãããŸãããããŸããŸãªèšèªã®ãã¢ãããŸããŸãªã¢ãŒããã¯ãã£ãªã©ã«å¯Ÿå¿ããŸãããããã¯ãããã«ãœã³DeepHack.Babelã§è§£æ±ºããããšããåé¡ã§ãã
é䞊åããŒã¿ãšDeepHack.Babel
å¶åŸ¡ãããå®éšã®å®æœãè©Šã¿ãŸããåå è ã«ã¯éåžžã«å°ããªäžŠåããŒã¿ã»ãããäžãããããã¥ãŒã©ã«ãããã¯ãŒã¯æ©æ¢°ç¿»èš³æ©ãèšç·ŽããåèšèªããŒã¿ã䜿çšããŠå質ãæ¹åããããšãææ¡ãããŸãã ãã¹ãŠã®åå è ã¯åãç«å Žã«ãããŸãïŒåãããŒã¿ãã¢ãã«ã®ãµã€ãºãšãã¬ãŒãã³ã°æéã«é¢ããåãå¶é-ãã®æ¹æ³ã«ãããåå è ã«ãã£ãŠå®è£ ãããæ¹æ³ã®ã©ããããå¹æçã§ããããããããéå ±éèšèªãã¢ã®ç¿»èš³ã®å質ãæ¹åããæ¹æ³ãç解ããããšã«è¿ã¥ããŸãã ããŸããŸãªè€éãã®ããŸããŸãªçšåºŠã®èšèªã®ããã€ãã®ãã¢ã§å®éšãè¡ããããŸããŸãªãœãªã¥ãŒã·ã§ã³ãã©ã®ããã«å€çšããããããã¹ãããŸãã
ããã«ãçµ±èšçãªç¿»èš³ã§ã¯äžå¯èœãšæããããããã«éå¿çãªã¿ã¹ã¯ãã€ãŸã䞊åããŒã¿ãªãã®ç¿»èš³ã«è¿ã¥ããŸãã å€ãã®é¢é£ããåé¡ã¯ãŸã 解決ãããŠããŸããããå¹³è¡ããã¹ãã§ç¿»èš³ãæããããã®æè¡ã¯ãã§ã«ç¥ãããŠãããããŸãæ©èœããŠããŸãã åçã®ã³ãŒãã¹ïŒå ±éã®ããŒããšåæ§ã®ã³ã³ãã³ããæã€ããã¹ãã®ãã¢ïŒãæ©æ¢°ç¿»èš³ã§ç©æ¥µçã«äœ¿çšãããŸã[8]-ããã«ããããŠã£ãããã£ã¢ãªã©ã®ãªãœãŒã¹ã䜿çšã§ããŸãïŒç°ãªãèšèªã®å¯Ÿå¿ããèšäºã¯åèªããšã«äžèŽããŸããããåããªããžã§ã¯ãã«ã€ããŠèª¬æããŸãïŒ ã ããããããã¹ããäºãã«å¯Ÿå¿ããŠãããã©ããã«ã€ããŠãŸã£ããæ å ±ããªãå Žåã¯ã©ãã§ããããïŒ ããšãã°ãç¹å®ã®å¹Žã®2ã€ã®ãã¥ãŒã¹æ¬æãç°ãªãèšèªã§åæããå Žåãåãã€ãã³ããè°è«ãããããšã確èªã§ããŸãïŒã€ãŸããå¥ã®æ¬æã®1ã€ã®æ¬æã®ã»ãšãã©ã®åèªã«å¯ŸããŠç¿»èš³ããããŸãïŒããæéãŸãã¯å°ãªããšãããã¹ãéã®å¯Ÿå¿ã確ç«ããŸãè¿œå æ å ±ããªããã°ãã§ããŸããã
ãã®ãããªããŒã¿ã䜿çšããããšã¯å¯èœã§ããïŒ ããã¯ç©ºæ³ç§åŠå°èª¬ã®ããã«æããŸãããå¯èœãªç§åŠæç®ã«ã¯ãã§ã«ããã€ãã®äŸããããŸããããšãã°ãæè¿ã®åºçç©[9]ã§ã¯ããªãŒããšã³ã³ãŒããŒã®ãã€ãºé€å»ã«åºã¥ããã·ã¹ãã ã説æãããŠããŸãã Hackathonã®åå è ã¯ããããã®æ¹æ³ãåçŸãã䞊è¡ããã¹ãã§ãã¬ãŒãã³ã°ãããã·ã¹ãã ããã€ãã¹ããããšãã§ããŸãã
䞊åããŒã¿ã®ãªãæ©æ¢°ç¿»èš³ã·ã¹ãã ã®åäœåçã èªåãšã³ã³ãŒããŒïŒå·ŠïŒïŒã¢ãã«ã¯ãæªãã ããŒãžã§ã³ããæã埩å ããæ¹æ³ãåŠç¿ããŠããŸãã xã¯æãCïŒxïŒã¯æªãã ããŒãžã§ã³ãxÌã¯åæ§æã§ãã 翻蚳è ïŒå³ïŒïŒã¢ãã«ã¯æãå¥ã®èšèªã«ç¿»èš³ããããšãåŠç¿ããŸãã ãã®å ¥åã§ã¯ãåã®å埩ããã®ã¢ãã«ã®ããŒãžã§ã³ã«ãã£ãŠçæããããæªãã å€æãçæãããŸãã ã¢ãã«ã®æåã®ããŒãžã§ã³ã¯ãèŸæžïŒèŸæžïŒã§ãããããã䞊åããŒã¿ã䜿çšããã«ãã¬ãŒãã³ã°ãããŸãã 2ã€ã®ã¢ãã«ã®çµã¿åããã«ããã䞊åããŒã¿ã§ãã¬ãŒãã³ã°ãããã·ã¹ãã ã«å¹æµãã翻蚳å質ãå®çŸããŸãã ãã®å³ã¯èšäº[9]ããåŒçšãããã®ã§ãã
åå æ¹æ³
ããã«ãœã³äºéžã®ç³ã蟌ã¿ã¯ã1æ8æ¥ãŸã§åãä»ããããŸãã äºéžã©ãŠã³ãã®ã¿ã¹ã¯ã¯ãè±èªãããã€ãèªãžã®æ©æ¢°ç¿»èš³ã·ã¹ãã ãæããããšã§ãã ããŒã¿ãšæ¹æ³ã«ãŸã å¶éã¯ãããŸãããåå è ã¯ãä»»æã®ã±ãŒã¹ãšäºåãã¬ãŒãã³ã°ãããã¢ãã«ã䜿çšãã奜ã¿ã«å¿ããŠã·ã¹ãã ã¢ãŒããã¯ãã£ãéžæã§ããŸãã ãã ããITãããã¯ã«é¢ããäžé£ã®ææ¡ã§ã·ã¹ãã ããã¹ããããããšã«æ³šæããŠãã ãããããã«ã¯ãé¢é£ãããœãŒã¹ããã®ããŒã¿ã®äœ¿çšãå«ãŸããŸãã ãŸããã¢ãŒããã¯ãã£ã«å¶éã¯ãããŸããããããã«ãœã³ã®äž»ãªã¿ã¹ã¯ã«ããããŸã察åŠããããã«ãåå è ã¯é©æ Œãªã¿ã¹ã¯ãå®äºãããšããã¥ãŒã©ã«ãããã¯ãŒã¯å€æã¢ãã«ã«ç²Ÿéãããã®ãšæ³å®ãããŸãã
ã·ã¹ãã ãæé«ã®ç¿»èš³å質ïŒBLEUã¡ããªãã¯[10]ã§æž¬å®ãããïŒã瀺ã50人ãããã«ãœã³ã«åå ã§ããŸãã éžæã«åæ Œããªãã£ã人ã¯æã£ãŠã¯ãããŸãã-圌ãã¯ãªã¹ããŒãšããŠããã«ãœã³ã«åå ã§ããŸãïŒæ¯æ¥ãæ©æ¢°ç¿»èš³ãæ©æ¢°åŠç¿ãã¯ãŒãããã»ãã·ã³ã°ã®å°é家ã«ããè¬çŸ©ãéãããŸãã
æžèª
- ãã¥ãŒã©ã«ãããã¯ãŒã¯ãçšããã·ãŒã±ã³ã¹åŠç¿ ã I. SutskeverãOãVinyalsãQVLeã
- LSTMïŒãµãŒãã¹ããŒã¹ãªããã»ã€ K.ã°ã¬ããRKSrivastavaãJ.KoutnÃkãBR SteunebrinkãJ.Schmidhuberã
- çµ±èšçæ©æ¢°ç¿»èš³ã®ããã®RNNãšã³ã³ãŒããŒ-ãã³ãŒããŒã䜿çšãããã¬ãŒãºè¡šçŸã®åŠç¿ ã K.ChoãBv MerrienboerãC.GulcehreãD.BahdanauãF.BougaresãH.SchwenkãY.Bengioã
- äœçœ®åãããšç¿»èš³ã®å ±ååŠç¿ã«ããç¥çµæ©æ¢°ç¿»èš³ ã D.ããŒãããŠãKããã§ãYããã³ãžãªã
- 泚æã«åºã¥ããã¥ãŒã©ã«æ©æ¢°ç¿»èš³ãžã®å¹æçãªã¢ãããŒã ã M.-T.ã«ãªã³ãHããã¡ã ãCDããã³ã°ã
- ç¥çµæ©æ¢°ç¿»èš³ã«ãããåäžèšèªã³ãŒãã¹ã®äœ¿çšã«ã€ã㊠ã C.ã°ã«ã±ã¬ãOããã£ã©ãããKãã·ã¥ãŒãKããã§ãŒãLããããŒãH.-Cããªã³ãFãããŒã¬ãŒã¬ã¹ãHãã·ã¥ãŠã§ã³ã¯ãYããã³ãžãªã
- åèšèªããŒã¿ã«ããç¥çµæ©æ¢°ç¿»èš³ã¢ãã«ã®æ¹å ã R.ãŒã³ãªãããBããããŠãAãããŒãã
- Earth Moverã®è·é¢æ£ååã䜿çšããé䞊åããŒã¿ããã®ãã€ãªã³ã¬ã«ã¬ãã·ã«ã®èªå° M.ZhangãYãLiuãHãLuanãYãLiuãMãSun.
- ã¢ããªã³ã¬ã«ã³ãŒãã¹ã®ã¿ã䜿çšããæåž«ãªãæ©æ¢°ç¿»èš³ ã G.ã©ã³ãã«ãLãããã€ã€ãŒãMãã©ã³ã¶ãŒãã
- BLEUïŒæ©æ¢°ç¿»èš³ã®èªåè©äŸ¡ã®ããã®æ¹æ³ ã K.ããããŒããSãã«ãŒã³ã¹ãTãã¯ãŒããW.-Jãæ±ã