{"id":30846,"date":"2023-08-07T10:00:27","date_gmt":"2023-08-07T01:00:27","guid":{"rendered":"https:\/\/gri.jp\/media\/?p=30846"},"modified":"2023-08-08T17:21:56","modified_gmt":"2023-08-08T08:21:56","slug":"%e3%80%907%e5%88%86%e3%81%a7%e3%82%8f%e3%81%8b%e3%82%8b%e3%80%91nlp%e3%81%a7%e6%b4%bb%e8%ba%8d%e3%81%99%e3%82%8btransformer%e3%81%a8attention%e3%81%ae%e5%bd%b9%e5%89%b2","status":"publish","type":"post","link":"https:\/\/gri.jp\/media\/entry\/30846","title":{"rendered":"\u30107\u5206\u3067\u308f\u304b\u308b\u3011NLP\u3067\u6d3b\u8e8d\u3059\u308bTransformer\u3068Attention\u306e\u5f79\u5272"},"content":{"rendered":"<p>\u3053\u306e\u8a18\u4e8b\u3067\u306f\u3001\u6587\u7ae0\u751f\u6210\u3092\u542b\u3080\u69d8\u3005\u306a\u81ea\u7136\u8a00\u8a9e\u51e6\u7406\uff08NLP\uff09\u30bf\u30b9\u30af\u306b\u304a\u3044\u3066\u91cd\u5927\u306a\u5f79\u5272\u3092\u6301\u3064Transformer\u306e\u30a2\u30fc\u30ad\u30c6\u30af\u30c1\u30e3\u30fc\u3092\u89e3\u8aac\u3057\u307e\u3059\u3002\u79c1\u81ea\u8eab\u304c\u57f7\u7b46\u3057\u307e\u3057\u305f\u66f8\u7c4d\u3001\uff12\u518a\u3068\u3082\u306b\u3001Transformer\u3068Attention\u3092\u5341\u5206\u306b\u660e\u77ad\u306b\u89e3\u8aac\u3067\u304d\u3066\u3044\u306a\u3044\u3053\u3068\u304c\u305a\u3063\u3068\u5f8c\u308d\u3081\u305f\u304f\u3001\u4eca\u56de\u306f\u305d\u3046\u9060\u304f\u306f\u306a\u3044\u7b2c\uff12\u7248\u306b\u5411\u3051\u3066\u3001\u3088\u308a\u308f\u304b\u308a\u3084\u3059\u3044\u8a18\u8ff0\u3092\u7df4\u3063\u3066\u3044\u307e\u3059\u3002<\/p>\n<div class=\"linkcard\"><table border=\"1\" cellspacing=\"0\" cellpadding=\"4\"><tbody><\/tr><tr><td><br><a class=\"lkc-link no_icon\" href=\"https:\/\/www.picaca.jp\/p\/bizrepo?src=cw\" target=\"_blank\" rel=\"external noopenner\">ChatGPT\u30d3\u30b8\u30cd\u30b9\u30ec\u30dd\u30fc\u30c8<\/a> - www.picaca.jp<\/td><\/tr><\/tbody><\/table><\/div>\n<h3><strong>Transformer\u306e\u767b\u5834\u306b\u3088\u308b\u8a00\u8a9e\u51e6\u7406\u7cbe\u5ea6\u306e\u5411\u4e0a<\/strong><\/h3>\n<p>\u5f93\u6765\u306eRNN\u3092\u7528\u3044\u305f\u8a00\u8a9e\u30e2\u30c7\u30eb\u306f\u4e0b\u8a18\u306e\u3088\u3046\u306a\u8ab2\u984c\u304c\u6b8b\u3055\u308c\u3066\u3044\u307e\u3057\u305f\u3002<\/p>\n<ul>\n<li>\u5165\u529b\u7cfb\u5217\u304c\u9577\u304f\u306a\u308b\u3068\u3001\u9060\u304f\u96e2\u308c\u305f\u5358\u8a9e\u9593\u306e\u95a2\u4fc2\u3084\u6587\u8108\u3092\u6b63\u3057\u304f\u628a\u63e1\u3057\u306a\u304f\u306a\u308b<\/li>\n<li>\u5165\u529b\u30c7\u30fc\u30bf\u3092\uff11\u6642\u9593\u30b9\u30c6\u30c3\u30d7\u3054\u3068\u306b\u51e6\u7406\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u3001\u4e26\u5217\u51e6\u7406\u304c\u3067\u304d\u306a\u3044<\/li>\n<\/ul>\n<p>2017\u5e74\u306bGoogle\u306e\u7814\u7a76\u30c1\u30fc\u30e0\u304c\u958b\u767a\u3057\u305f<span style=\"color: #ff0000;\"><strong>Transformer\uff08\u30c8\u30e9\u30f3\u30b9\u30d5\u30a9\u30fc\u30de\u30fc\uff09<\/strong><\/span>\u306e\u767b\u5834\u306b\u3088\u308a\u3001\u4e0a\u8a18\u306e\u554f\u984c\u304c\u6539\u5584\u3055\u308c\u3001\u9577\u3044\u6587\u7ae0\u306e\u89e3\u6790\u7cbe\u5ea6\u306e\u98db\u8e8d\u7684\u306a\u5411\u4e0a\u3092\u3082\u305f\u3089\u3057\u307e\u3057\u305f\u3002\u305d\u306e\u80cc\u666f\u306b\u3042\u308b\u306e\u306fTransformer\u306e\u5185\u90e8\u69cb\u9020\u306b\u6f5c\u3080<span style=\"color: #ff0000;\"><strong>Attention\uff08\u6ce8\u610f\u6a5f\u69cb\uff09<\/strong><\/span>\u3067\u3068\u3044\u3046\u4ed5\u7d44\u307f\u3067\u3059\u3002<\/p>\n<p>Attention\u306f\u3001<strong>\u5404\u6642\u523b\u306b\u304a\u3051\u308b\u60c5\u5831\u306e\u91cd\u8981\u5ea6\uff08\u91cd\u307f\uff09\u3092\u8a08\u7b97\u3057\u53cd\u6620\u3059\u308b\u3053\u3068\u3067\u3001\u91cd\u8981\u5ea6\u306e\u9ad8\u3044\u60c5\u5831\u306b\u300c\u6ce8\u610f\u300d\u3092\u5411\u3051\u3066\u5b66\u7fd2<\/strong>\u3059\u308b\u624b\u6cd5\u3067\u3059\u3002\u4eba\u9593\u304c\u5b66\u7fd2\u3059\u308b\u6642\u306b\u91cd\u8981\u306a\u5185\u5bb9\u3092\u512a\u5148\u3059\u308b\u3068\u3044\u3046\u611f\u899a\u306b\u8fd1\u3044\u3067\u3059\u3002\u3053\u308c\u306b\u3088\u308a\u3001\u6587\u304c\u9577\u304f\u3066\u3082\u3001\u3064\u307e\u308a\u5358\u8a9e\u540c\u58eb\u304c\u96e2\u308c\u3066\u3044\u3066\u3082\u3001\u5168\u3066\u306e\u5358\u8a9e\u306e\u95a2\u4fc2\u6027\u3092\u7db2\u7f85\u7684\u306b\u628a\u63e1\u3057\u3001\u305d\u308c\u305e\u308c\u306e\u5358\u8a9e\u304c\u679c\u305f\u3057\u3066\u3044\u308b\u5f79\u5272\u3092\u7406\u89e3\u3059\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002<\/p>\n<p>\uff08\u539f\u8ad6\u6587\uff09\u201cAttention is All You Need\u201d \uff08RNN\u3084LSTM\u306f\u3082\u306f\u3084\u6642\u4ee3\u9045\u308c\u3068\u3044\u3046\u610f\u5473\uff09 \u3000\u3000<a href=\"https:\/\/arxiv.org\/pdf\/1508.04025.pdf\" target=\"_blank\" rel=\"noopener\">https:\/\/arxiv.org\/pdf\/1508.04025.pdf<\/a><\/p>\n<p>Attention\u3092\u5185\u8535\u3059\u308b\u3053\u3068\u306b\u3088\u3063\u3066\u3001Transformer\u304c\u81ea\u7136\u8a00\u8a9e\u51e6\u7406\u306b\u304a\u3044\u3066\u512a\u308c\u305f\u6027\u80fd\u3092\u767a\u63ee\u3059\u308b\u3053\u3068\u304c\u3067\u304d\u3066\u3044\u307e\u3059\u3002\u305d\u306e\u5f8c\u3001\u5927\u898f\u6a21\u81ea\u7136\u8a00\u8a9e\u30e2\u30c7\u30eb\uff08LLM\uff09\u306e\u5927\u90e8\u5206\u306fTransformer\u3092\u4f7f\u7528\u3057\u3066\u958b\u767a\u3055\u308c\u3066\u304a\u308a\u3001\u6a5f\u68b0\u7ffb\u8a33\u3001\u6587\u7ae0\u5206\u985e\u3001\u6587\u7ae0\u751f\u6210\u306a\u3069\u591a\u69d8\u591a\u7a2e\u306a\u8a00\u8a9e\u30bf\u30b9\u30af\u306b\u5fdc\u7528\u3055\u308c\u3066\u3044\u307e\u3059\u3002\u4f8b\u3048\u3070\u3001<strong>\u73fe\u5728ChatGPT\u306a\u3069\u3067\u6ce8\u76ee\u306e\u300c\u6587\u7ae0\u751f\u6210\u300d\u3067\u306f\u3001Transformer\u306f\u5148\u884c\u3059\u308b\u6587\u7ae0\uff08\u3042\u308b\u3044\u306f\u30d7\u30ed\u30f3\u30d7\u30c8\uff09\u4e2d\u306e\u5358\u8a9e\u306e\u95a2\u4fc2\u6027\u3092\u7406\u89e3\u3057\u5e83\u3044\u6587\u8108\u3092\u8003\u616e\u3057\u306a\u304c\u3089\u3001\u6b21\u306b\u6765\u308b\u3079\u304d\u5358\u8a9e\u3092\u4e88\u6e2c\u3057\u9069\u5207\u306a\u6587\u7ae0\u3092\u751f\u6210\u3067\u304d\u308b\u3088\u3046\u306b\u306a\u308a\u307e\u3057\u305f\u3002<\/strong><\/p>\n<h3><strong>Transformer\u306b\u304a\u3051\u308bAttention\u306e\u5f79\u5272<\/strong><\/h3>\n<p>Attention\u306e\u5f79\u5272\u306b\u6ce8\u76ee\u3057\u306a\u304c\u3089\u3001Transformer\u306e\u30a2\u30fc\u30ad\u30c6\u30af\u30c1\u30e3\u3092\u4f53\u7cfb\u7684\u306b\u7406\u89e3\u3057\u3066\u3044\u304d\u307e\u3057\u3087\u3046\u3002<\/p>\n<p>\u4e0b\u306e\u56f31\u306b\u3042\u308b\u3088\u3046\u306a\u3001Transformer\u3092\u7528\u3044\u305f\u30cb\u30e5\u30fc\u30e9\u30eb\u6a5f\u68b0\u7ffb\u8a33\u30e2\u30c7\u30eb\u306e\u6a21\u5f0f\u56f3\u3092\u7528\u3044\u3066\u8aac\u660e\u3057\u307e\u3059\u3002<\/p>\n<div id=\"attachment_30847\" class=\"wp-caption alignnone\" style=\"width: 1002px\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-30847 size-full\" src=\"https:\/\/gri.jp\/media\/wp\/wp-content\/uploads\/2023\/07\/\u30b9\u30af\u30ea\u30fc\u30f3\u30b7\u30e7\u30c3\u30c8-2023-07-24-9.03.13.png\" alt=\"\" width=\"992\" height=\"662\" \/><span class=\"wp-caption-text\">\u56f31\uff1aSelf-Attention\u3068Source-Target Attention\u3092\u5185\u8535\u3057\u305fTransformer\u30e2\u30c7\u30eb\u306e\u69cb\u9020<\/span><\/div>\n<p>&nbsp;<\/p>\n<p>Transformer\u306e\u4e3b\u8981\u306a\u69cb\u6210\u8981\u7d20\u306f\u30a8\u30f3\u30b3\u30fc\u30c0\u3068\u30c7\u30b3\u30fc\u30c0\u3067\u3059\u3002\u30a8\u30f3\u30b3\u30fc\u30c0\u3067\u306f\u3001\u5165\u529b\u6587\uff08\u7ffb\u8a33\u524d\u306e\u6587\uff09\u3092\u51e6\u7406\u3057\u3001\u30c7\u30b3\u30fc\u30c0\u306f\u3001\u51fa\u529b\u6587\uff08\u7ffb\u8a33\u5f8c\u306e\u6587\uff09\u3092\u4e00\u5358\u8a9e\u305a\u3064\u9806\u756a\u306b\u751f\u6210\u3057\u307e\u3059\u3002\u4f8b\u3048\u3070\u3001\u201dHe is a teacher\u201d \u3068\u3044\u3046\u82f1\u6587\u3092\u548c\u8a33\u3059\u308b\u7ffb\u8a33\u30bf\u30b9\u30af\u306e\u5834\u5408\u3092\u8003\u3048\u307e\u3057\u3087\u3046\u3002\u30a8\u30f3\u30b3\u30fc\u30c0\u3078\u306e\u5165\u529b\u306f\u201dHe is a teacher\u201d\u3068\u3044\u3046Source\u6587\uff08\u7ffb\u8a33\u524d\u306e\u6587\uff09\u3001\u30c7\u30b3\u30fc\u30c0\u304b\u3089\u306e\u51fa\u529b\u306f\u300c\u5f7c\u306f\u5148\u751f\u3067\u3059\u300d\u3068\u3044\u3046Target\u6587\uff08\u7ffb\u8a33\u5f8c\u306e\u6587\uff09\u3067\u3059\u3002<\/p>\n<p>\u30a8\u30f3\u30b3\u30fc\u30c0\u30fc\u3068\u30c7\u30b3\u30fc\u30c0\u30fc\u306f\u305d\u308c\u305e\u308c\u3001\u7570\u306a\u308b\u76ee\u7684\u3067\u8907\u6570\u306e<span style=\"color: #ff0000;\"><strong>Self-Attention<\/strong><\/span>\u306e\u5c64\u3092\u6301\u3063\u3066\u3044\u307e\u3059\u3002\u305d\u3057\u3066\u3001\u30c7\u30b3\u30fc\u30c0\u306b\u306f<span style=\"color: #ff0000;\"><strong>Source-Target Attention<\/strong><\/span>\u304c\u3042\u308a\u307e\u3059\uff08\u203b\u3053\u308c\u3089\u306e\u7a2e\u985e\u306eAttention\u306b\u3064\u3044\u3066\u306f\u5225\u306e\u8a18\u4e8b\u3067\u8a73\u7d30\u306b\u89e3\u8aac\u3059\u308b\u4e88\u5b9a\u3067\u3059\uff09\u3002<\/p>\n<p>\u307e\u305a\u3001Self-Attention\u306e\u5f79\u5272\u3092\u8003\u3048\u307e\u3059\u3002<\/p>\n<ul>\n<li>\uff08\u56f31\u306e\u5de6\u5074\uff09\u30a8\u30f3\u30b3\u30fc\u30c0\u3067\u4f7f\u308f\u308c\u308bSelf-Attention\uff1a\u5165\u529b\u6587\u306e<strong>\u5404\u5358\u8a9e\u3068\u4ed6\u306e\u5358\u8a9e\u306e\u95a2\u9023\u5ea6\u3092\u8a08\u7b97<\/strong>\u3057\u3001\u5404\u6642\u523b\u306e\u5358\u8a9e\u306e\u96a0\u308c\u72b6\u614b\u306b\u5bfe\u3057\u3066\u3001<strong>\u6587\u8108\u306b\u5373\u3057\u305f\u8868\u73fe\uff08\u30a8\u30f3\u30b3\u30fc\u30c7\u30a3\u30f3\u30b0\uff09\u3092\u751f\u6210<\/strong>\u3057\u51fa\u529b\u3057\u307e\u3059\u3002<\/li>\n<li>\uff08\u56f31\u306e\u53f3\u5074\uff09\u30c7\u30b3\u30fc\u30c0\u3067\u4f7f\u308f\u308c\u308bSelf-Attention\uff1a\u30c7\u30b3\u30fc\u30c0\u30fc\u3078\u5165\u529b\u3055\u308c\u308b\u300c<strong>\u524d\u306e\u6642\u523b\u3067\u751f\u6210\u3055\u308c\u305f\u51fa\u529b\u5358\u8a9e\u300d\u3068\u306e\u95a2\u4fc2<\/strong>\u3092\u6349\u3048\u308b\u3053\u3068\u3067\u3001\u51fa\u529b\u7cfb\u5217\u306e\u751f\u6210\u306b\u304a\u3044\u3066<strong>\u9069\u5207\u306a\u6b21\u306e\u5358\u8a9e\u304c\u9078\u3070\u308c\u308b<\/strong>\u3053\u3068\u306b\u5bc4\u4e0e\u3057\u307e\u3059\u3002\u3053\u308c\u3092\u7279\u306b<span style=\"color: #ff0000;\"><strong>Masked Self-Attention<\/strong><\/span>\u3068\u547c\u3070\u308c\u307e\u3059\u3002\u901a\u5e38\u306eSelf-Attention\u3068\u540c\u69d8\u306e\u5f79\u5272\u3092\u679c\u305f\u3059\u3068\u3068\u3082\u306b\u3001\u307e\u3060\u751f\u6210\u3055\u308c\u3066\u3044\u306a\u3044\u300c\u672a\u6765\u300d\u306e\u30c8\u30fc\u30af\u30f3\u306b\u306f\u30a2\u30af\u30bb\u30b9\u3067\u304d\u306a\u3044\u3088\u3046\u306b\u30de\u30b9\u30ad\u30f3\u30b0\u3057\u307e\u3059\u3002\u3053\u308c\u306b\u3088\u308a\u3001\u81ea\u5df1\u56de\u5e30\u7684\u306a\u30e2\u30c7\u30eb\u3001\u3064\u307e\u308a\u3001<strong>\u5404\u30b9\u30c6\u30c3\u30d7\u3067\u306e\u51fa\u529b\u304c\u305d\u308c\u307e\u3067\u306e\u51fa\u529b\u306b\u306e\u307f\u4f9d\u5b58<\/strong>\u3059\u308b\u3068\u3044\u3046\u6027\u8cea\u3092\u5b9f\u73fe\u3057\u307e\u3059\u3002<\/li>\n<\/ul>\n<p>\u6b21\u306b\u3001Source-Target Attention\u306f Transformer\u306e\u30a8\u30f3\u30b3\u30fc\u30c0\u30fc\u3068\u30c7\u30b3\u30fc\u30c0\u30fc\u3092\u7d50\u3073\u3064\u3051\u308b\u5f79\u5272\u3092\u679c\u305f\u3057\u3066\u3044\u307e\u3059\u3002\u30c7\u30b3\u30fc\u30c0\u30fc\u306b\u304a\u3044\u3066\u3001\u300c<strong>\u30a8\u30f3\u30b3\u30fc\u30c0\u30fc\u304c\u51e6\u7406\u3057\u305f\u5404\u5358\u8a9e\u3092\u30c7\u30b3\u30fc\u30c0\u30fc\u304c\u3069\u306e\u7a0b\u5ea6\u91cd\u8996\u3059\u308b\u304b<\/strong>\u300d\u3092\u8a55\u4fa1\u3057\u6307\u793a\u3057\u307e\u3059\u3002\u4f8b\u3048\u3070\u3001\u56f31\u306e\u4f8b\u3067\u306f\u3001\u300c\u660e\u65e5\u300d\u3068\u306e\u95a2\u9023\u304c\u5f37\u3044\u5358\u8a9e\u300c\u795d\u65e5\u300d\u304c\u3088\u308a\u91cd\u8996\u3055\u308c\u307e\u3059\u3002<\/p>\n<p>\u4e0a\u8a18\u306e\u3088\u3046\u306b\u3001\uff12\u7a2e\u985e\u306eAttention\u304c\u305d\u308c\u305e\u308c\u304cTransformer\u30e2\u30c7\u30eb\u306e\u30d1\u30d5\u30a9\u30fc\u30de\u30f3\u30b9\u306b\u91cd\u8981\u306a\u5f79\u5272\u3092\u679c\u305f\u3057\u3001\u3053\u308c\u3089\u304c\u540c\u6642\u306b\u4f5c\u52d5\u3059\u308b\u3053\u3068\u306b\u3088\u3063\u3066\u3001\u3042\u308b\u6642\u523b\u306e\u5358\u8a9e\u3092\u751f\u6210\u3059\u308b\u969b\u306b\u3001\u524d\u306e\u6642\u523b\u306e\u51fa\u529b\u304a\u3088\u3073\u30a8\u30f3\u30b3\u30fc\u30c0\u306b\u5165\u529b\u3055\u308c\u305f\u7cfb\u5217\u306e\u4e2d\u304b\u3089\u5f71\u97ff\u529b\u306e\u9ad8\u3044\u5358\u8a9e\u306b\u6ce8\u610f\u3092\u5411\u3051\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002\u305d\u3057\u3066\u3001Transformer\u306f\u7570\u306a\u308b\u8a00\u8a9e\u9593\u3067\u306e\u5358\u8a9e\u306e\u5bfe\u5fdc\u95a2\u4fc2\u3092\u5b66\u7fd2\u3057\u3001\u5f93\u6765\u306b\u6bd4\u3079\u3066\u6587\u8108\u306b\u57fa\u3065\u3044\u305f\u6b63\u78ba\u306a\u7ffb\u8a33\u3092\u63d0\u4f9b\u3059\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002<\/p>\n<p>\uff08\u56f34.9.3\u306b\u5bfe\u3059\u308b\u88dc\u8db3\uff09<\/p>\n<p>\u53b3\u5bc6\u306b\u3044\u3046\u3068\u3001\u5165\u529b\u524d\u306b\u3001\u5358\u8a9e\u3092\u6570\u5024\u30d9\u30af\u30c8\u30eb\u306b\u5909\u63db\u3055\u308c\u3001\u30d9\u30af\u30c8\u30eb\u306e\u5185\u7a4d\uff08\u56f31\u306e\u4e2d\u306e\u5358\u8a9e\u9593\u3092\u7d50\u3076\u7dda\u3067\u4ee3\u8868\uff09\u3092\u8a08\u7b97\u3059\u308b\u3053\u3068\u3067\u5358\u8a9e\u9593\u306e\u985e\u4f3c\u6027\u304c\u6c42\u3081\u3089\u308c\u307e\u3059\u3002\u305d\u3057\u3066\u3001\u30c7\u30b3\u30fc\u30c0\u3067\u306f\u5404\u5358\u8a9e\u306e\u300c\u78ba\u7387\u5206\u5e03\u300d\u304c\u51fa\u529b\u3055\u308c\u307e\u3059\u3002\u30c7\u30b3\u30fc\u30c0\u304c\u5b9f\u969b\u306b\u751f\u6210\u3059\u308b\u5358\u8a9e\u7cfb\u5217\u306f\u3001\u3053\u306e\u5206\u5e03\u3092\u3082\u3068\u306b\u6c7a\u5b9a\u3055\u308c\u307e\u3059\u3002<\/p>\n<p>\u307e\u305f\u3001\u5b66\u7fd2\u306e\u6642\u3068\u4e88\u6e2c\u306e\u6642\u306f\u30c7\u30b3\u30fc\u30c0\u3078\u306e\u5165\u529b\u304c\u7570\u306a\u308a\u307e\u3059\u3002\u5b66\u7fd2\u306e\u6642\u306f\u3001\u300c\u5f7c\u306f\u5148\u751f\u3067\u3059\u300d\u3068\u3044\u3046\u6b63\u89e3\u6587\u304c\u30c7\u30b3\u30fc\u30c0\u306b\u4e0e\u3048\u3089\u308c\u307e\u3059\u3002\u4e00\u65b9\u3067\u3001\u4e88\u6e2c\u6642\u306f\u300c\u5f7c\u306f\u300d\u3068\u3044\u3046\u30c7\u30b3\u30fc\u30c0\u304c\u51fa\u529b\u3057\u305f\u9014\u4e2d\u307e\u3067\u306b\u7ffb\u8a33\u6587\u304c\u30c7\u30b3\u30fc\u30c0\u306b\u5165\u529b\u3055\u308c\u307e\u3059\u3002<\/p>\n<p>\u3010\u751f\u6210AI\u306b\u95a2\u3059\u308b\u8a18\u4e8b\u3092\u8aad\u307f\u305f\u3044\u65b9\u306f\u3053\u3061\u3089\u304b\u3089\u300eChatGPT\u30d3\u30b8\u30cd\u30b9\u30ec\u30dd\u30fc\u30c8\u300f\u306b\u7121\u6599\u767b\u9332\u3057\u3066\u304f\u3060\u3055\u3044\u3011<\/p>\n<div class=\"linkcard\"><table border=\"1\" cellspacing=\"0\" cellpadding=\"4\"><tbody><\/tr><tr><td><br><a class=\"lkc-link no_icon\" href=\"https:\/\/www.picaca.jp\/p\/bizrepo?src=cw\" target=\"_blank\" rel=\"external noopenner\">ChatGPT\u30d3\u30b8\u30cd\u30b9\u30ec\u30dd\u30fc\u30c8<\/a> - www.picaca.jp<\/td><\/tr><\/tbody><\/table><\/div>\n<p>&nbsp;<\/p>\n<p>\u57f7\u7b46\u62c5\u5f53\uff1a\u30e4\u30f3\u3000\u30b8\u30e3\u30af\u30ea\u30f3\uff08GRI \u30c7\u30fc\u30bf\u5206\u6790\u5b98\u3001\u8b1b\u5e2b\uff09<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u3053\u306e\u8a18\u4e8b\u3067\u306f\u3001\u6587\u7ae0\u751f\u6210\u3092\u542b\u3080\u69d8\u3005\u306a\u81ea\u7136\u8a00\u8a9e\u51e6\u7406\uff08NLP\uff09\u30bf\u30b9\u30af\u306b\u304a\u3044\u3066\u91cd\u5927\u306a\u5f79\u5272\u3092\u6301\u3064Transformer\u306e\u30a2\u30fc\u30ad\u30c6\u30af\u30c1\u30e3\u30fc\u3092\u89e3\u8aac\u3057\u307e\u3059\u3002\u79c1\u81ea\u8eab\u304c\u57f7\u7b46\u3057\u307e\u3057\u305f\u66f8\u7c4d\u3001\uff12\u518a\u3068\u3082\u306b\u3001Transformer\u3068Attention<\/p>\n","protected":false},"author":8,"featured_media":30936,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[149,150,83,4,125],"tags":[],"class_list":["post-30846","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-gkentei","category-dskentei","category-ai","category-datascience","category-deeplearning"],"acf":[],"meta_field":{"_edit_lock":["1695803276:6"],"_edit_last":["44"],"hidden_toppage":["0"],"_hidden_toppage":["field_61933136630d2"],"note_url":[""],"_note_url":["field_61243c8278b90"],"_thumbnail_id":["30936"],"_oembed_708dfa83557f00d2c9ad8eddd829ea3d":["{{unknown}}"],"_oembed_f599b5bae89e5eb5330bc266982a61c6":["{{unknown}}"],"_oembed_cad28bade9419eca440f9f41ac91a82b":["{{unknown}}"],"_oembed_d22b6aa14c719fd988c75cf9c9b5b947":["{{unknown}}"],"_oembed_ab1d0df7957227df8d336e85065524dd":["{{unknown}}"],"_pv_count":["a:24:{i:10;i:127;i:11;i:141;i:12;i:156;i:17;i:161;i:21;i:103;i:0;i:107;i:5;i:45;i:4;i:54;i:7;i:55;i:6;i:44;i:22;i:94;i:13;i:198;i:23;i:113;i:9;i:92;i:16;i:207;i:14;i:203;i:19;i:128;i:1;i:71;i:20;i:107;i:15;i:138;i:18;i:136;i:2;i:61;i:8;i:64;i:3;i:37;}"],"pv_count":["2641"],"_oembed_86f67867960cf3b56ed00c900afc8df0":["{{unknown}}"],"_oembed_8c32532e2474e4596895907ed5491efa":["{{unknown}}"],"_oembed_54af4c847d0c7906d67e580f50e70ddb":["{{unknown}}"]},"_links":{"self":[{"href":"https:\/\/gri.jp\/media\/wp-json\/wp\/v2\/posts\/30846","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/gri.jp\/media\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/gri.jp\/media\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/gri.jp\/media\/wp-json\/wp\/v2\/users\/8"}],"replies":[{"embeddable":true,"href":"https:\/\/gri.jp\/media\/wp-json\/wp\/v2\/comments?post=30846"}],"version-history":[{"count":8,"href":"https:\/\/gri.jp\/media\/wp-json\/wp\/v2\/posts\/30846\/revisions"}],"predecessor-version":[{"id":31163,"href":"https:\/\/gri.jp\/media\/wp-json\/wp\/v2\/posts\/30846\/revisions\/31163"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/gri.jp\/media\/wp-json\/wp\/v2\/media\/30936"}],"wp:attachment":[{"href":"https:\/\/gri.jp\/media\/wp-json\/wp\/v2\/media?parent=30846"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/gri.jp\/media\/wp-json\/wp\/v2\/categories?post=30846"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/gri.jp\/media\/wp-json\/wp\/v2\/tags?post=30846"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}