{"id":107605,"date":"2026-09-19T21:40:34","date_gmt":"2026-09-19T13:40:34","guid":{"rendered":"https:\/\/www.wsisp.com\/helps\/107605.html"},"modified":"2026-09-19T21:40:34","modified_gmt":"2026-09-19T13:40:34","slug":"iace-%e6%b7%b1%e5%ba%a6%e8%a7%a3%e6%9e%90%ef%bc%9a%e5%8f%8c%e8%87%82%e6%9c%ba%e5%99%a8%e4%ba%ba%e8%af%a5%e6%80%8e%e4%b9%88%e5%88%86%e5%b7%a5%ef%bc%9faist-%e7%94%a8-14-%e7%bb%84","status":"publish","type":"post","link":"https:\/\/www.wsisp.com\/helps\/107605.html","title":{"rendered":"IACE \u6df1\u5ea6\u89e3\u6790\uff1a\u53cc\u81c2\u673a\u5668\u4eba\u8be5\u600e\u4e48\u201c\u5206\u5de5\u201c\uff1fAIST \u7528 14 \u7ec4\u771f\u673a\u5b9e\u9a8c\u7ed9\u51fa\u67b6\u6784\u9009\u578b\u6307\u5357"},"content":{"rendered":"<p>\u8bba\u6587\u6807\u9898: Learning Bimanual Manipulation via Action Chunking and Inter-Arm Coordination with Transformers<br \/>\n\u4f5c\u8005: Tomohiro Motoda, Ryo Hanai, Ryoichi Nakajo, Masaki Murooka, Floris Erich, Yukiyasu Domae<br \/>\n\u673a\u6784: \u4ea7\u4e1a\u6280\u672f\u7efc\u5408\u7814\u7a76\u6240 (AIST), \u65e5\u672c<br \/>\n\u53d1\u8868: arXiv:2503.13916 (v1, 2025-03-18)<br \/>\n\u57fa\u5ea7: ACT (Action Chunking with Transformers)<br \/>\n\u5173\u952e\u8bcd: \u53cc\u81c2\u64cd\u4f5c\u3001\u6a21\u4eff\u5b66\u4e60\u3001\u52a8\u4f5c\u5206\u5757\u3001Transformer\u3001\u81c2\u95f4\u534f\u8c03\u3001\u884c\u4e3a\u514b\u9686<\/p>\n<hr \/>\n<p>\u4e00\u53e5\u8bdd\u603b\u7ed3&#xff1a;AIST \u5728 ACT \u57fa\u7840\u4e0a\u52a0\u4e86\u4e00\u4e2a\u81c2\u95f4\u534f\u8c03\u7f16\u7801\u5668&#xff08;IACE&#xff09;&#xff0c;\u5e76\u628a&#034;\u6bcf\u81c2\u72ec\u7acb\u7f16\u7801\u5668 &#043; \u5355\/\u5206\u88c2\u89e3\u7801\u5668&#034;\u7684\u67b6\u6784\u7ec4\u5408\u5728 8 \u4e2a\u771f\u673a\u53cc\u81c2\u4efb\u52a1\u4e0a\u505a\u4e86\u7cfb\u7edf\u6d88\u878d\u2014\u2014\u7ed3\u8bba\u6e05\u6670\u5f97\u50cf\u9009\u578b\u624b\u518c&#xff1a;\u5f02\u6b65\u4efb\u52a1&#xff08;\u4e24\u624b\u5404\u5e72\u5404\u7684&#xff09;\u7528\u5206\u88c2\u89e3\u7801\u5668&#xff0c;\u540c\u6b65\u4efb\u52a1&#xff08;\u4e24\u624b\u4e00\u8d77\u5e72&#xff09;\u7528\u5355\u89e3\u7801\u5668&#xff0c;\u800c IACE \u662f\u4e24\u6761\u8def\u7ebf\u7684\u5171\u540c\u5730\u57fa&#xff08;\u53bb\u6389\u540e\u540c\u6b65\u4efb\u52a1\u6210\u529f\u7387\u4ece 98% \u8dcc\u5230 57%&#xff09;\u3002<\/p>\n<hr \/>\n<h3>\u4e00\u3001\u4ecb\u7ecd<\/h3>\n<h4>1.1 \u53cc\u81c2\u7684&#034;1&#043;1&#034;\u96be\u9898<\/h4>\n<p>\u53cc\u81c2\u64cd\u4f5c\u662f\u673a\u5668\u4eba\u64cd\u4f5c\u9886\u57df\u7684\u786c\u9aa8\u5934&#xff0c;\u4e5f\u662f\u8fd9\u4e2a\u7cfb\u5217\u535a\u5ba2\u7684\u8001\u670b\u53cb\u4e86\u2014\u2014ALOHA\u3001BRS\u3001iDP3 \u91cc\u90fd\u7ed5\u4e0d\u5f00\u5b83\u3002\u4f46 AIST \u8fd9\u7bc7\u63d0\u51fa\u7684\u95ee\u9898\u66f4&#034;\u5143&#034;\u4e00\u5c42&#xff1a;\u53cc\u81c2\u7b56\u7565\u7f51\u7edc\u7684\u67b6\u6784\u672c\u8eab\u8be5\u600e\u4e48\u8bbe\u8ba1&#xff1f;<\/p>\n<p>\u76f4\u63a5\u7684\u505a\u6cd5\u662f\u628a\u53cc\u81c2\u81ea\u7531\u5ea6\u62fc\u8d77\u6765\u7aef\u5230\u7aef\u5b66&#xff08;ACT \u7684\u505a\u6cd5&#xff09;&#xff0c;\u4f46\u4f5c\u8005\u6307\u51fa\u8fd9\u9690\u542b\u4e24\u4e2a\u95ee\u9898&#xff1a;<\/p>\n<li>\u6570\u636e\u5f02\u6784\u6027&#xff1a;\u628a\u4e24\u4e2a 6-DoF \u5355\u81c2&#xff08;ViperX\u3001UR5&#xff09;\u6216 7-DoF \u81c2&#xff08;Franka&#xff09;\u62fc\u6210 12\/14-DoF \u53cc\u81c2&#xff0c;\u786c\u4ef6\u6784\u578b\u4e00\u53d8&#xff0c;\u6a21\u578b\u5c31\u5f97\u5fae\u8c03\u751a\u81f3\u91cd\u8bad\u2014\u2014\u62fc\u7ef4\u5ea6\u7684\u505a\u6cd5\u5bf9\u786c\u4ef6\u5dee\u5f02\u96f6\u9c81\u68d2\u6027&#xff1b;<\/li>\n<li>\u5355\u81c2\u80fd\u529b\u88ab\u7a00\u91ca&#xff1a;\u53cc\u81c2\u4efb\u52a1\u91cc\u5de6\u53f3\u624b\u89d2\u8272\u5f80\u5f80\u4e0d\u540c\u2014\u2014\u201c\u53f3\u624b\u6293\u8d77\u7269\u4f53\u3001\u5de6\u624b\u63a5\u4f4f\u201d&#xff08;hand-over&#xff09;\u672c\u8d28\u4e0a\u662f\u4e24\u4e2a\u5355\u81c2\u6280\u80fd\u7684\u63a5\u529b\u3002\u7aef\u5230\u7aef flatten \u5b66\u4e60\u8ba9\u7f51\u7edc\u5f88\u96be&#034;\u6df1\u5b66&#034;\u6bcf\u53ea\u624b\u7684\u72ec\u7acb\u6280\u80fd\u3002<\/li>\n<p>\u4f5c\u8005\u7684\u6838\u5fc3\u5047\u8bbe&#xff08;hypothesis&#xff09;\u5f88\u660e\u786e&#xff1a;\u6df1\u5ea6\u5355\u81c2\u5b66\u4e60\u662f\u5b66\u597d\u53cc\u81c2\u64cd\u4f5c\u7684\u524d\u63d0\u3002\u6240\u4ee5\u67b6\u6784\u4e0a\u5e94\u8be5\u7ed9\u6bcf\u53ea\u624b\u4e00\u6761\u72ec\u7acb\u7684\u4fe1\u606f\u901a\u8def&#xff08;\u72ec\u7acb\u7f16\u7801\u5668&#xff09;&#xff0c;\u518d\u663e\u5f0f\u5730\u5efa\u4e00\u6761&#034;\u534f\u8c03\u901a\u8def&#034;&#xff08;IACE&#xff09;\u3002<\/p>\n<h4>1.2 \u4e0e\u524d\u4f5c\u4eec\u7684\u4f4d\u7f6e\u5173\u7cfb<\/h4>\n<p>\u8fd9\u7bc7\u7684\u5b9a\u4f4d\u662f\u67b6\u6784\u7814\u7a76\u800c\u975e\u7b97\u6cd5\u521b\u65b0\u2014\u2014\u5b83\u7ad9\u5728 ACT \u7684\u80a9\u8180\u4e0a&#xff08;CVAE &#043; \u52a8\u4f5c\u5206\u5757 &#043; \u65f6\u5e8f\u96c6\u6210\u5168\u90e8\u4fdd\u7559&#xff09;&#xff0c;\u7814\u7a76\u7684\u95ee\u9898\u662f&#034;\u7f16\u7801\u5668\u548c\u89e3\u7801\u5668\u600e\u4e48\u6446&#034;\u3002\u76f8\u5173\u7684\u540c\u7c7b\u5de5\u4f5c&#xff1a;<\/p>\n<ul>\n<li>INTERACT&#xff08;Lee et al., CoRL 2024&#xff09;&#xff1a;\u5c42\u7ea7\u6ce8\u610f\u529b Transformer \u540c\u6b65\u53cc\u81c2\u8f68\u8ff9\u2014\u2014\u601d\u8def\u540c\u6e90&#xff0c;\u4f46\u90a3\u662f\u5b8c\u6574\u7684\u65b0\u65b9\u6cd5&#xff0c;\u672c\u6587\u662f ACT \u4e0a\u7684\u6700\u5c0f\u4fb5\u5165\u5f0f\u6539\u9020 &#043; \u7cfb\u7edf\u6d88\u878d&#xff1b;<\/li>\n<li>Shikada et al.&#xff08;IROS 2024&#xff09;&#xff1a;\u5c42\u7ea7\u6df1\u5ea6\u9884\u6d4b\u5b66\u4e60\u6a21\u578b\u505a\u53cc\u81c2\u540c\u6b65\u2014\u2014\u7528 RNN \u8def\u7ebf&#xff0c;\u672c\u6587\u8d70 Transformer&#xff1b;<\/li>\n<li>\u03c00\u3001RDT-1B&#xff1a;\u57fa\u7840\u6a21\u578b\u8def\u7ebf&#xff0c;\u5927\u6570\u636e\u5806\u6cdb\u5316\u2014\u2014\u672c\u6587\u53cd\u5176\u9053\u800c\u884c&#xff0c;\u7814\u7a76\u5c0f\u6570\u636e&#xff08;\u6bcf\u4efb\u52a1 50 \u6761\u6f14\u793a&#xff09;\u4e0b\u7684\u67b6\u6784\u6548\u7387\u3002<\/li>\n<\/ul>\n<h4>1.3 \u4efb\u52a1\u7684\u4e8c\u5206\u6cd5&#xff1a;\u5f02\u6b65 vs \u540c\u6b65<\/h4>\n<p>\u5b9e\u9a8c\u8bbe\u8ba1\u6cbf\u7528\u4e86 Krebs &amp; Asfour \u7684\u53cc\u81c2\u64cd\u4f5c\u5206\u7c7b\u6cd5&#xff08;bimanual taxonomy&#xff09;&#xff0c;\u628a\u4efb\u52a1\u5207\u6210\u4e24\u7c7b&#xff1a;<\/p>\n<ul>\n<li>\u5f02\u6b65\u4efb\u52a1&#xff08;Asynchronous&#xff09;&#xff1a;\u5de6\u53f3\u81c2\u52a8\u4f5c\u76f8\u4e92\u72ec\u7acb\u3001\u5148\u540e\u6267\u884c\u3002\u4f8b&#xff1a;\u6298\u6bdb\u5dfe&#xff08;\u5148\u62ff\u518d\u653e&#xff09;\u3001\u9524\u51fb&#xff08;\u5148\u6293\u9524\u518d\u6325&#xff09;\u3001\u4ea4\u63a5&#xff08;\u4e00\u53ea\u624b\u9012\u4e00\u53ea\u624b\u63a5&#xff09;\u2014\u20144 \u9879&#xff1b;<\/li>\n<li>\u540c\u6b65\u4efb\u52a1&#xff08;Synchronous&#xff09;&#xff1a;\u53cc\u81c2\u540c\u65f6\u3001\u534f\u8c03\u5730\u52a8\u3002\u4f8b&#xff1a;\u53cc\u4eba\u62ac\u6bdb\u5dfe&#xff08;\u5fc5\u987b\u540c\u65f6\u62ac\u5426\u5219\u6389&#xff09;\u3001\u5f00\u5de5\u5177\u7bb1&#xff08;\u4e00\u624b\u6309\u7bb1\u4f53\u4e00\u624b\u5f00\u76d6&#xff09;\u3001\u62ac\u677f&#xff08;\u4e24\u70b9\u540c\u65f6\u53d1\u529b\u5426\u5219\u677f\u7ffb&#xff09;\u2014\u20144 \u9879\u3002<\/li>\n<\/ul>\n<p>\u8fd9\u4e2a\u4e8c\u5206\u6cd5\u76f4\u63a5\u51b3\u5b9a\u4e86\u540e\u9762\u7684\u6838\u5fc3\u7ed3\u8bba&#xff1a;\u4e24\u7c7b\u4efb\u52a1\u7684\u6700\u4f18\u89e3\u7801\u5668\u67b6\u6784\u662f\u76f8\u53cd\u7684\u3002\u8fd9\u662f\u5168\u6587\u6700\u6709\u4ef7\u503c\u7684\u53d1\u73b0\u3002<\/p>\n<hr \/>\n<h3>\u4e8c\u3001\u539f\u7406<\/h3>\n<h4>2.1 \u57fa\u5ea7&#xff1a;ACT \u7684\u5feb\u901f\u56de\u987e<\/h4>\n<p>ACT&#xff08;Action Chunking with Transformers&#xff09;\u7684\u8981\u7d20\u5168\u90e8\u4fdd\u7559&#xff1a;<\/p>\n<ul>\n<li>\u89c2\u6d4b\u7f16\u7801&#xff1a;4 \u8def RGB \u76f8\u673a&#xff08;\u5de6\u53f3\u8155 &#043; \u4e0a\u65b9 &#043; \u4e0b\u65b9\u4fef\u89c6&#xff09;\u2192 ResNet18 \u2192 \u89c6\u89c9\u7279\u5f81 token&#xff1b;\u53cc\u81c2\u5173\u8282\u4f4d\u7f6e\u5e8f\u5217 \u2192 \u62fc\u8fdb\u8f93\u5165\u5e8f\u5217&#xff1b;<\/li>\n<li>CVAE&#xff1a;\u6761\u4ef6\u53d8\u5206\u81ea\u7f16\u7801\u5668\u5efa\u6a21\u4eba\u7c7b\u793a\u6559\u7684\u98ce\u683c\u53d8\u5316&#xff08;\u540c\u4e00\u4e2a\u4eba\u505a 50 \u6b21\u6298\u6bdb\u5dfe&#xff0c;\u6bcf\u6b21\u8f68\u8ff9\u7ec6\u8282\u90fd\u4e0d\u540c&#xff0c;CVAE \u7528\u9690\u53d8\u91cf z \u5438\u6536\u8fd9\u79cd\u591a\u6837\u6027&#xff09;&#xff1b;<\/li>\n<li>\u52a8\u4f5c\u5206\u5757&#xff08;action chunking&#xff09;&#xff1a;\u4e0d\u9010\u6b65\u9884\u6d4b&#xff0c;\u4e00\u6b21\u9884\u6d4b\u672a\u6765\u4e00\u6bb5\u52a8\u4f5c\u5e8f\u5217&#xff1b;<\/li>\n<li>\u65f6\u5e8f\u96c6\u6210&#xff08;temporal ensemble&#xff09;&#xff1a;\u63a8\u7406\u65f6\u5bf9\u8fc7\u53bb\u591a\u4e2a\u65f6\u95f4\u6b65\u7684\u9884\u6d4b\u6309\u6307\u6570\u6743\u91cd\u878d\u5408&#xff0c;\u5e73\u6ed1\u8f93\u51fa\u3002<\/li>\n<\/ul>\n<h4>2.2 \u67b6\u6784&#xff1a;\u4e09\u6bb5\u5f0f\u4fe1\u606f\u6d41<\/h4>\n<p>\u672c\u6587\u7684\u6539\u9020\u96c6\u4e2d\u5728\u7f16\u7801\u5668-\u89e3\u7801\u5668\u7684\u7ec4\u7ec7\u65b9\u5f0f\u4e0a&#xff0c;\u5f62\u6210\u4e09\u6bb5\u5f0f\u7ed3\u6784&#xff08;\u5bf9\u5e94\u8bba\u6587 Figure 1&#xff09;&#xff1a;<\/p>\n<p>\u8f93\u5165\u5e8f\u5217\u7684\u4e09\u4e2a segment&#xff08;\u5404\u5e26 CLS token &#043; \u4f4d\u7f6e\u7f16\u7801&#xff09;:<br \/>\n  \u2460 \u5de6\u81c2 segment: \u5de6\u81c2\u5173\u8282\u5e8f\u5217 &#043; \u5de6\u8155\u76f8\u673a &#043; \u5168\u5c40\u76f8\u673a\u7279\u5f81<br \/>\n  \u2461 \u53f3\u81c2 segment: \u53f3\u81c2\u5173\u8282\u5e8f\u5217 &#043; \u53f3\u8155\u76f8\u673a &#043; \u5168\u5c40\u76f8\u673a\u7279\u5f81<br \/>\n  \u2462 \u5168\u5c40 segment: \u53cc\u81c2\u5173\u8282 &#043; \u5168\u90e8\u76f8\u673a\u7279\u5f81<\/p>\n<p>\u7b2c\u4e00\u5c42&#xff1a;\u53cc\u81c2\u5c40\u90e8\u7f16\u7801\u5668\u3002 \u6bcf\u53ea\u624b\u81c2\u4e00\u4e2a\u72ec\u7acb\u7684 Transformer encoder&#xff0c;\u53ea\u5403\u81ea\u5df1\u7684\u5173\u8282 &#043; \u81ea\u5df1\u7684\u8155\u90e8\u76f8\u673a&#xff08;&#043; \u5168\u5c40\u89c6\u89c9\u7279\u5f81&#xff09;\u3002\u8fd9\u5c31\u662f&#034;\u6df1\u5b66\u5355\u81c2\u6280\u80fd&#034;\u7684\u67b6\u6784\u5316\u4f53\u73b0\u2014\u2014\u5de6\u81c2\u7f16\u7801\u5668\u4e0d\u9700\u8981\u7406\u89e3\u53f3\u81c2\u7684\u8155\u90e8\u89c6\u91ce&#xff0c;\u4e13\u6ce8\u628a\u81ea\u5df1\u7684\u8f68\u8ff9\u5b66\u624e\u5b9e\u3002<\/p>\n<p>\u7b2c\u4e8c\u5c42&#xff1a;IACE&#xff08;Inter-Arm Coordinated Transformer Encoder&#xff09;\u3002 \u5168\u5c40\u7684\u534f\u8c03\u7f16\u7801\u5668&#xff0c;\u540c\u65f6\u5403\u53cc\u81c2\u72b6\u6001 &#043; \u6355\u6349\u6574\u4e2a\u573a\u666f\u7684\u89c6\u89c9\u4fe1\u606f&#xff0c;\u8d1f\u8d23\u5efa\u6a21\u5f0f\u540c\u6b65\u548c\u65f6\u5e8f\u5bf9\u9f50\u2014\u2014\u201c\u5de6\u624b\u4ec0\u4e48\u65f6\u5019\u8be5\u52a8\u3001\u52a8\u591a\u5feb&#xff0c;\u53d6\u51b3\u4e8e\u53f3\u624b\u73b0\u5728\u5728\u54ea\u201d\u3002\u5b83\u662f\u72ec\u7acb\u4e8e\u4e24\u4e2a\u5c40\u90e8\u7f16\u7801\u5668\u7684\u4e00\u6761\u663e\u5f0f\u534f\u8c03\u901a\u8def&#xff0c;\u8f93\u51fa\u534f\u8c03 token \u4f9b\u89e3\u7801\u5668\u4f7f\u7528\u3002<\/p>\n<p>\u7b2c\u4e09\u5c42&#xff1a;\u89e3\u7801\u5668\u7684\u4e24\u79cd\u6446\u6cd5&#xff08;\u6d88\u878d\u6838\u5fc3&#xff09;\u3002<\/p>\n<ul>\n<li>\u5355\u89e3\u7801\u5668&#xff08;Single Decoder&#xff09;&#xff1a;\u628a\u5de6\u53f3\u81c2\u7f16\u7801\u5668\u8f93\u51fa &#043; IACE \u8f93\u51fa\u62fc\u63a5\u540e\u5582\u7ed9\u4e00\u4e2a\u5171\u4eab\u7684 Transformer decoder&#xff0c;\u4e00\u6b21\u6027\u8f93\u51fa\u53cc\u81c2\u52a8\u4f5c\u5757&#xff08;batch output&#xff09;\u3002\u4fe1\u606f\u5168\u5c40\u5171\u4eab&#xff0c;\u9002\u5408\u9700\u8981\u7d27\u5bc6\u8026\u5408\u7684\u4efb\u52a1&#xff1b;<\/li>\n<li>\u5206\u88c2\u89e3\u7801\u5668&#xff08;Split Decoders&#xff09;&#xff1a;\u4e24\u4e2a\u72ec\u7acb decoder&#xff0c;\u5404\u81ea\u53ea\u5403\u81ea\u5df1\u81c2\u7684\u7f16\u7801\u5668\u8f93\u51fa &#043; IACE \u8f93\u51fa&#xff0c;\u5206\u522b\u8f93\u51fa\u5de6\/\u53f3\u81c2\u52a8\u4f5c\u5757\u3002\u5404\u7ba1\u5404\u7684&#xff0c;IACE \u4f5c\u4e3a\u552f\u4e00\u7684\u534f\u8c03\u6865\u6881&#xff0c;\u9002\u5408\u4e24\u81c2\u4efb\u52a1\u89e3\u8026\u7684\u573a\u666f\u3002<\/li>\n<\/ul>\n<p>\u76f4\u89c9\u7c7b\u6bd4&#xff08;\u7f16\u7801\u89c6\u89d2&#xff09;&#xff1a;\u5355\u89e3\u7801\u5668\u50cf\u8054\u5408\u7f16\u7801\u2014\u2014\u628a\u5de6\u53f3\u4e24\u8def\u4fe1\u53f7\u5f53\u4e00\u4e2a\u5bf9\u8c61\u6574\u4f53\u538b\u7f29&#xff0c;\u5197\u4f59\u4fe1\u606f\u5171\u4eab&#xff0c;\u540c\u6b65\u6027\u597d\u4f46\u7075\u6d3b\u6027\u5dee&#xff1b;\u5206\u88c2\u89e3\u7801\u5668\u50cf\u72ec\u7acb\u7f16\u7801 &#043; \u4e00\u6761\u516c\u5171\u53c2\u8003\u6d41\u2014\u2014\u4e24\u8def\u5404\u81ea\u6700\u4f18&#xff0c;\u9760 IACE \u8fd9\u6761&#034;\u53c2\u8003\u6d41&#034;\u5bf9\u9f50\u65f6\u5e8f\u3002\u54ea\u4e2a\u597d\u53d6\u51b3\u4e8e\u6e90\u4fe1\u53f7\u7684\u8026\u5408\u5ea6\u2014\u2014\u8fd9\u6070\u597d\u5c31\u662f\u5f02\u6b65\/\u540c\u6b65\u4efb\u52a1\u7684\u5206\u91ce\u3002<\/p>\n<h4>2.3 \u8bad\u7ec3\u4e0e\u63a8\u7406\u7ec6\u8282<\/h4>\n<ul>\n<li>\u6570\u636e&#xff1a;ALOHA \u9065\u64cd\u4f5c\u7cfb\u7edf\u91c7\u96c6&#xff08;\u64cd\u4f5c\u5458\u6162\u901f\u64cd\u4f5c\u63d0\u7cbe\u5ea6&#xff09;&#xff0c;\u5173\u8282\u4f4d\u7f6e &#043; RGB \u56fe\u50cf&#xff0c;\u539f\u59cb 50 Hz&#xff1b;<\/li>\n<li>50 Hz \u2192 25 Hz \u964d\u91c7\u6837&#xff1a;\u4f5c\u8005\u53d1\u73b0\u539f\u59cb\u5e27\u7387\u4e0b\u5173\u8282\u503c\u7684\u5fae\u5c0f\u6296\u52a8\u5bfc\u81f4\u8bad\u7ec3\u8f93\u51fa\u4e0d\u7a33\u5b9a&#xff0c;\u964d\u91c7\u6837\u5230 25 Hz \u540e\u8bad\u7ec3\u7a33\u5b9a\u2014\u2014\u52a8\u4f5c\u5206\u5757\u6a21\u578b\u5bf9\u9ad8\u9891\u9065\u64cd\u4f5c\u566a\u58f0\u654f\u611f&#xff0c;\u8fd9\u662f\u4e2a\u5b9e\u7528\u7684\u7ecf\u9a8c\u503c&#xff1b;<\/li>\n<li>\u6bcf\u4efb\u52a1 50 \u6761\u6f14\u793a&#xff1b;AdamW&#xff0c;\u03bb&#061;1e-5&#xff0c;5000 epochs&#xff0c;batch 8&#xff0c;\u5355\u5361 RTX 4090&#xff08;24GB&#xff09;&#xff1b;<\/li>\n<li>\u63a8\u7406\u8017\u65f6\u7ea6 0.02 s&#xff0c;\u52a8\u4f5c\u5206\u5757 &#043; \u65f6\u5e8f\u96c6\u6210\u8f93\u51fa\u5e73\u6ed1\u8f68\u8ff9\u3002<\/li>\n<\/ul>\n<hr \/>\n<h3>\u4e09\u3001\u516c\u5f0f<\/h3>\n<p>\u8fd9\u7bc7\u8bba\u6587\u6b63\u6587\u6ca1\u6709\u516c\u5f0f&#xff08;6 \u9875\u77ed\u6587&#xff0c;\u67b6\u6784\u4ee5\u56fe\u4ee3\u6570&#xff09;&#xff0c;\u6838\u5fc3\u6570\u5b66\u90fd\u7ee7\u627f\u81ea ACT\u3002\u4e3a\u5b8c\u6574\u6027&#xff0c;\u628a\u88ab\u7ee7\u627f\u7684\u5173\u952e\u516c\u5f0f\u5217\u51fa&#xff0c;\u5e76\u6807\u6ce8 IACE \u6539\u52a8\u7684\u843d\u70b9\u3002<\/p>\n<h4>3.1 CVAE \u7684\u53d8\u5206\u4e0b\u754c<\/h4>\n<p>ACT \u7528 CVAE \u5efa\u6a21\u793a\u6559\u98ce\u683c\u591a\u6837\u6027\u3002\u53d8\u5206\u81ea\u7f16\u7801\u5668\u7684\u76ee\u6807&#xff08;ELBO&#xff09;&#xff1a;<\/p>\n<p><span class=\"katex--display\"><span class=\"katex-display\"><span class=\"katex\"><span class=\"katex-mathml\">LELBO&#061;Ez\u223cq\u03d5(z\u2223o,y)[log\u2061p\u03b8(y\u2223z,o)]\u2212DKL(q\u03d5(z\u2223o,y)\u2009\u2225\u2009p(z))\\\\mathcal{L}_{\\\\text{ELBO}} &#061; \\\\mathbb{E}_{z \\\\sim q_\\\\phi(z|o, y)} \\\\left[ \\\\log p_\\\\theta(y | z, o) \\\\right] &#8211; D_{\\\\text{KL}}\\\\left( q_\\\\phi(z | o, y) \\\\,\\\\|\\\\, p(z) \\\\right)<\/span><span class=\"katex-html\"><span class=\"base\"><span class=\"strut\" style=\"height: 0.8333em;vertical-align: -0.15em\"><\/span><span class=\"mord\"><span class=\"mord mathcal\">L<\/span><span class=\"msupsub\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.3283em\"><span class=\"\" style=\"top: -2.55em;margin-left: 0em;margin-right: 0.05em\"><span class=\"pstrut\" style=\"height: 2.7em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mtight\"><span class=\"mord text mtight\"><span class=\"mord mtight\">ELBO<\/span><\/span><\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.15em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><\/span><span class=\"mspace\" style=\"margin-right: 0.2778em\"><\/span><span class=\"mrel\">&#061;<\/span><span class=\"mspace\" style=\"margin-right: 0.2778em\"><\/span><\/span><span class=\"base\"><span class=\"strut\" style=\"height: 1.1333em;vertical-align: -0.3833em\"><\/span><span class=\"mord\"><span class=\"mord mathbb\">E<\/span><span class=\"msupsub\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.3448em\"><span class=\"\" style=\"top: -2.5198em;margin-left: 0em;margin-right: 0.05em\"><span class=\"pstrut\" style=\"height: 2.7em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mtight\"><span class=\"mord mathnormal mtight\" style=\"margin-right: 0.044em\">z<\/span><span class=\"mrel mtight\">\u223c<\/span><span class=\"mord mtight\"><span class=\"mord mathnormal mtight\" style=\"margin-right: 0.0359em\">q<\/span><span class=\"msupsub\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.3448em\"><span class=\"\" style=\"top: -2.3488em;margin-left: -0.0359em;margin-right: 0.0714em\"><span class=\"pstrut\" style=\"height: 2.5em\"><\/span><span class=\"sizing reset-size3 size1 mtight\"><span class=\"mord mathnormal mtight\">\u03d5<\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.2901em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><\/span><span class=\"mopen mtight\">(<\/span><span class=\"mord mathnormal mtight\" style=\"margin-right: 0.044em\">z<\/span><span class=\"mord mtight\">\u2223<\/span><span class=\"mord mathnormal mtight\">o<\/span><span class=\"mpunct mtight\">,<\/span><span class=\"mord mathnormal mtight\" style=\"margin-right: 0.0359em\">y<\/span><span class=\"mclose mtight\">)<\/span><\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.3833em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><\/span><span class=\"mspace\" style=\"margin-right: 0.1667em\"><\/span><span class=\"minner\"><span class=\"mopen delimcenter\" style=\"top: 0em\">[<\/span><span class=\"mop\">lo<span style=\"margin-right: 0.0139em\">g<\/span><\/span><span class=\"mspace\" style=\"margin-right: 0.1667em\"><\/span><span class=\"mord\"><span class=\"mord mathnormal\">p<\/span><span class=\"msupsub\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.3361em\"><span class=\"\" style=\"top: -2.55em;margin-left: 0em;margin-right: 0.05em\"><span class=\"pstrut\" style=\"height: 2.7em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mathnormal mtight\" style=\"margin-right: 0.0278em\">\u03b8<\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.15em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><\/span><span class=\"mopen\">(<\/span><span class=\"mord mathnormal\" style=\"margin-right: 0.0359em\">y<\/span><span class=\"mord\">\u2223<\/span><span class=\"mord mathnormal\" style=\"margin-right: 0.044em\">z<\/span><span class=\"mpunct\">,<\/span><span class=\"mspace\" style=\"margin-right: 0.1667em\"><\/span><span class=\"mord mathnormal\">o<\/span><span class=\"mclose\">)<\/span><span class=\"mclose delimcenter\" style=\"top: 0em\">]<\/span><\/span><span class=\"mspace\" style=\"margin-right: 0.2222em\"><\/span><span class=\"mbin\">\u2212<\/span><span class=\"mspace\" style=\"margin-right: 0.2222em\"><\/span><\/span><span class=\"base\"><span class=\"strut\" style=\"height: 1.0361em;vertical-align: -0.2861em\"><\/span><span class=\"mord\"><span class=\"mord mathnormal\" style=\"margin-right: 0.0278em\">D<\/span><span class=\"msupsub\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.3283em\"><span class=\"\" style=\"top: -2.55em;margin-left: -0.0278em;margin-right: 0.05em\"><span class=\"pstrut\" style=\"height: 2.7em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mtight\"><span class=\"mord text mtight\"><span class=\"mord mtight\">KL<\/span><\/span><\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.15em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><\/span><span class=\"mspace\" style=\"margin-right: 0.1667em\"><\/span><span class=\"minner\"><span class=\"mopen delimcenter\" style=\"top: 0em\">(<\/span><span class=\"mord\"><span class=\"mord mathnormal\" style=\"margin-right: 0.0359em\">q<\/span><span class=\"msupsub\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.3361em\"><span class=\"\" style=\"top: -2.55em;margin-left: -0.0359em;margin-right: 0.05em\"><span class=\"pstrut\" style=\"height: 2.7em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mathnormal mtight\">\u03d5<\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.2861em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><\/span><span class=\"mopen\">(<\/span><span class=\"mord mathnormal\" style=\"margin-right: 0.044em\">z<\/span><span class=\"mord\">\u2223<\/span><span class=\"mord mathnormal\">o<\/span><span class=\"mpunct\">,<\/span><span class=\"mspace\" style=\"margin-right: 0.1667em\"><\/span><span class=\"mord mathnormal\" style=\"margin-right: 0.0359em\">y<\/span><span class=\"mclose\">)<\/span><span class=\"mspace\" style=\"margin-right: 0.1667em\"><\/span><span class=\"mord\">\u2225<\/span><span class=\"mspace\" style=\"margin-right: 0.1667em\"><\/span><span class=\"mord mathnormal\">p<\/span><span class=\"mopen\">(<\/span><span class=\"mord mathnormal\" style=\"margin-right: 0.044em\">z<\/span><span class=\"mclose\">)<\/span><span class=\"mclose delimcenter\" style=\"top: 0em\">)<\/span><\/span><\/span><\/span><\/span><\/span><\/span><\/p>\n<ul>\n<li><span class=\"katex--inline\"><span class=\"katex\"><span class=\"katex-mathml\">yy<\/span><span class=\"katex-html\"><span class=\"base\"><span class=\"strut\" style=\"height: 0.625em;vertical-align: -0.1944em\"><\/span><span class=\"mord mathnormal\" style=\"margin-right: 0.0359em\">y<\/span><\/span><\/span><\/span><\/span>&#xff1a;\u76ee\u6807\u52a8\u4f5c\u5757&#xff08;\u672a\u6765\u591a\u6b65\u53cc\u81c2\u5173\u8282\u4f4d\u7f6e\u5e8f\u5217&#xff09;&#xff1b;<\/li>\n<li><span class=\"katex--inline\"><span class=\"katex\"><span class=\"katex-mathml\">oo<\/span><span class=\"katex-html\"><span class=\"base\"><span class=\"strut\" style=\"height: 0.4306em\"><\/span><span class=\"mord mathnormal\">o<\/span><\/span><\/span><\/span><\/span>&#xff1a;\u89c2\u6d4b&#xff08;\u56fe\u50cf\u7279\u5f81 &#043; \u5173\u8282\u4f4d\u7f6e&#xff09;&#xff1b;<\/li>\n<li><span class=\"katex--inline\"><span class=\"katex\"><span class=\"katex-mathml\">zz<\/span><span class=\"katex-html\"><span class=\"base\"><span class=\"strut\" style=\"height: 0.4306em\"><\/span><span class=\"mord mathnormal\" style=\"margin-right: 0.044em\">z<\/span><\/span><\/span><\/span><\/span>&#xff1a;\u98ce\u683c\u9690\u53d8\u91cf&#xff0c;\u7f16\u7801\u5668 <span class=\"katex--inline\"><span class=\"katex\"><span class=\"katex-mathml\">q\u03d5q_\\\\phi<\/span><span class=\"katex-html\"><span class=\"base\"><span class=\"strut\" style=\"height: 0.7167em;vertical-align: -0.2861em\"><\/span><span class=\"mord\"><span class=\"mord mathnormal\" style=\"margin-right: 0.0359em\">q<\/span><span class=\"msupsub\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.3361em\"><span class=\"\" style=\"top: -2.55em;margin-left: -0.0359em;margin-right: 0.05em\"><span class=\"pstrut\" style=\"height: 2.7em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mathnormal mtight\">\u03d5<\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.2861em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><\/span><\/span><\/span><\/span><\/span> \u4ee5 (\u89c2\u6d4b, \u76ee\u6807) \u4e3a\u6761\u4ef6\u2014\u2014\u6ce8\u610f z \u7f16\u7801\u5668\u770b\u5f97\u89c1\u771f\u503c\u52a8\u4f5c&#xff0c;\u6240\u4ee5\u5b66\u5230\u7684\u662f&#034;\u8fd9\u6761\u8f68\u8ff9\u7684\u98ce\u683c&#034;&#xff1b;\u91c7\u6837\u9636\u6bb5 <span class=\"katex--inline\"><span class=\"katex\"><span class=\"katex-mathml\">zz<\/span><span class=\"katex-html\"><span class=\"base\"><span class=\"strut\" style=\"height: 0.4306em\"><\/span><span class=\"mord mathnormal\" style=\"margin-right: 0.044em\">z<\/span><\/span><\/span><\/span><\/span> \u4ece\u5148\u9a8c <span class=\"katex--inline\"><span class=\"katex\"><span class=\"katex-mathml\">p(z)\u223cN(0,I)p(z) \\\\sim \\\\mathcal{N}(0,I)<\/span><span class=\"katex-html\"><span class=\"base\"><span class=\"strut\" style=\"height: 1em;vertical-align: -0.25em\"><\/span><span class=\"mord mathnormal\">p<\/span><span class=\"mopen\">(<\/span><span class=\"mord mathnormal\" style=\"margin-right: 0.044em\">z<\/span><span class=\"mclose\">)<\/span><span class=\"mspace\" style=\"margin-right: 0.2778em\"><\/span><span class=\"mrel\">\u223c<\/span><span class=\"mspace\" style=\"margin-right: 0.2778em\"><\/span><\/span><span class=\"base\"><span class=\"strut\" style=\"height: 1em;vertical-align: -0.25em\"><\/span><span class=\"mord mathcal\" style=\"margin-right: 0.1474em\">N<\/span><span class=\"mopen\">(<\/span><span class=\"mord\">0<\/span><span class=\"mpunct\">,<\/span><span class=\"mspace\" style=\"margin-right: 0.1667em\"><\/span><span class=\"mord mathnormal\" style=\"margin-right: 0.0785em\">I<\/span><span class=\"mclose\">)<\/span><\/span><\/span><\/span><\/span> \u62bd\u53d6&#xff1b;<\/li>\n<li>\u7b2c\u4e00\u9879\u662f\u91cd\u5efa\u9879&#xff0c;\u7b2c\u4e8c\u9879 KL \u7ea6\u675f\u628a\u98ce\u683c\u5206\u5e03\u62c9\u5411\u6807\u51c6\u6b63\u6001\u3002<\/li>\n<\/ul>\n<p>IACE \u4e0d\u6539\u8fd9\u4e00\u5c42\u2014\u2014\u98ce\u683c\u5efa\u6a21\u4e0e\u534f\u8c03\u5efa\u6a21\u89e3\u8026\u3002<\/p>\n<h4>3.2 \u8f93\u5165\u5e8f\u5217\u7ec4\u88c5&#xff08;IACE \u843d\u70b9&#xff09;<\/h4>\n<p>\u4e09\u6bb5\u5e8f\u5217\u7684\u5f62\u5f0f\u5316&#xff08;\u4ee5\u5355\u89e3\u7801\u5668\u4e3a\u4f8b&#xff09;&#xff1a;<\/p>\n<p><span class=\"katex--display\"><span class=\"katex-display\"><span class=\"katex\"><span class=\"katex-mathml\">input&#061;[CLSL,s1L,\u2026,skL]\u23df\u5de6\u81c2\u6bb5\u2295[CLSR,s1R,\u2026,skR]\u23df\u53f3\u81c2\u6bb5\u2295[CLSG,g1,\u2026,gm]\u23df\u5168\u5c40\u6bb5\u2295PE\\\\text{input} &#061; \\\\underbrace{[\\\\text{CLS}_L, s^L_1, \\\\dots, s^L_k]}_{\\\\text{\u5de6\u81c2\u6bb5}} \\\\oplus \\\\underbrace{[\\\\text{CLS}_R, s^R_1, \\\\dots, s^R_k]}_{\\\\text{\u53f3\u81c2\u6bb5}} \\\\oplus \\\\underbrace{[\\\\text{CLS}_G, g_1, \\\\dots, g_m]}_{\\\\text{\u5168\u5c40\u6bb5}} \\\\oplus \\\\text{PE}<\/span><span class=\"katex-html\"><span class=\"base\"><span class=\"strut\" style=\"height: 0.8623em;vertical-align: -0.1944em\"><\/span><span class=\"mord text\"><span class=\"mord\">input<\/span><\/span><span class=\"mspace\" style=\"margin-right: 0.2778em\"><\/span><span class=\"mrel\">&#061;<\/span><span class=\"mspace\" style=\"margin-right: 0.2778em\"><\/span><\/span><span class=\"base\"><span class=\"strut\" style=\"height: 2.4677em;vertical-align: -1.5763em\"><\/span><span class=\"mord munder\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.8913em\"><span class=\"\" style=\"top: -1.4237em\"><span class=\"pstrut\" style=\"height: 3em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mtight\"><span class=\"mord text mtight\"><span class=\"mord cjk_fallback mtight\">\u5de6\u81c2\u6bb5<\/span><\/span><\/span><\/span><\/span><span class=\"\" style=\"top: -3em\"><span class=\"pstrut\" style=\"height: 3em\"><\/span><span class=\"mord munder\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.8913em\"><span class=\"svg-align\" style=\"top: -2.102em\"><span class=\"pstrut\" style=\"height: 3em\"><\/span><span class=\"stretchy\" style=\"height: 0.548em;min-width: 1.6em\"><span class=\"brace-left\" style=\"height: 0.548em\"><\/span><span class=\"brace-center\" style=\"height: 0.548em\"><\/span><span class=\"brace-right\" style=\"height: 0.548em\"><\/span><\/span><\/span><span class=\"\" style=\"top: -3em\"><span class=\"pstrut\" style=\"height: 3em\"><\/span><span class=\"mord\"><span class=\"mopen\">[<\/span><span class=\"mord\"><span class=\"mord text\"><span class=\"mord\">CLS<\/span><\/span><span class=\"msupsub\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.3283em\"><span class=\"\" style=\"top: -2.55em;margin-right: 0.05em\"><span class=\"pstrut\" style=\"height: 2.7em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mathnormal mtight\">L<\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.15em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><\/span><span class=\"mpunct\">,<\/span><span class=\"mspace\" style=\"margin-right: 0.1667em\"><\/span><span class=\"mord\"><span class=\"mord mathnormal\">s<\/span><span class=\"msupsub\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.8913em\"><span class=\"\" style=\"top: -2.453em;margin-left: 0em;margin-right: 0.05em\"><span class=\"pstrut\" style=\"height: 2.7em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mtight\">1<\/span><\/span><\/span><span class=\"\" style=\"top: -3.113em;margin-right: 0.05em\"><span class=\"pstrut\" style=\"height: 2.7em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mathnormal mtight\">L<\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.247em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><\/span><span class=\"mpunct\">,<\/span><span class=\"mspace\" style=\"margin-right: 0.1667em\"><\/span><span class=\"minner\">\u2026<\/span><span class=\"mspace\" style=\"margin-right: 0.1667em\"><\/span><span class=\"mpunct\">,<\/span><span class=\"mspace\" style=\"margin-right: 0.1667em\"><\/span><span class=\"mord\"><span class=\"mord mathnormal\">s<\/span><span class=\"msupsub\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.8913em\"><span class=\"\" style=\"top: -2.453em;margin-left: 0em;margin-right: 0.05em\"><span class=\"pstrut\" style=\"height: 2.7em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mathnormal mtight\" style=\"margin-right: 0.0315em\">k<\/span><\/span><\/span><span class=\"\" style=\"top: -3.113em;margin-right: 0.05em\"><span class=\"pstrut\" style=\"height: 2.7em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mathnormal mtight\">L<\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.247em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><\/span><span class=\"mclose\">]<\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.898em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 1.5763em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><span class=\"mspace\" style=\"margin-right: 0.2222em\"><\/span><span class=\"mbin\">\u2295<\/span><span class=\"mspace\" style=\"margin-right: 0.2222em\"><\/span><\/span><span class=\"base\"><span class=\"strut\" style=\"height: 2.4677em;vertical-align: -1.5763em\"><\/span><span class=\"mord munder\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.8913em\"><span class=\"\" style=\"top: -1.4237em\"><span class=\"pstrut\" style=\"height: 3em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mtight\"><span class=\"mord text mtight\"><span class=\"mord cjk_fallback mtight\">\u53f3\u81c2\u6bb5<\/span><\/span><\/span><\/span><\/span><span class=\"\" style=\"top: -3em\"><span class=\"pstrut\" style=\"height: 3em\"><\/span><span class=\"mord munder\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.8913em\"><span class=\"svg-align\" style=\"top: -2.102em\"><span class=\"pstrut\" style=\"height: 3em\"><\/span><span class=\"stretchy\" style=\"height: 0.548em;min-width: 1.6em\"><span class=\"brace-left\" style=\"height: 0.548em\"><\/span><span class=\"brace-center\" style=\"height: 0.548em\"><\/span><span class=\"brace-right\" style=\"height: 0.548em\"><\/span><\/span><\/span><span class=\"\" style=\"top: -3em\"><span class=\"pstrut\" style=\"height: 3em\"><\/span><span class=\"mord\"><span class=\"mopen\">[<\/span><span class=\"mord\"><span class=\"mord text\"><span class=\"mord\">CLS<\/span><\/span><span class=\"msupsub\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.3283em\"><span class=\"\" style=\"top: -2.55em;margin-right: 0.05em\"><span class=\"pstrut\" style=\"height: 2.7em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mathnormal mtight\" style=\"margin-right: 0.0077em\">R<\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.15em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><\/span><span class=\"mpunct\">,<\/span><span class=\"mspace\" style=\"margin-right: 0.1667em\"><\/span><span class=\"mord\"><span class=\"mord mathnormal\">s<\/span><span class=\"msupsub\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.8913em\"><span class=\"\" style=\"top: -2.453em;margin-left: 0em;margin-right: 0.05em\"><span class=\"pstrut\" style=\"height: 2.7em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mtight\">1<\/span><\/span><\/span><span class=\"\" style=\"top: -3.113em;margin-right: 0.05em\"><span class=\"pstrut\" style=\"height: 2.7em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mathnormal mtight\" style=\"margin-right: 0.0077em\">R<\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.247em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><\/span><span class=\"mpunct\">,<\/span><span class=\"mspace\" style=\"margin-right: 0.1667em\"><\/span><span class=\"minner\">\u2026<\/span><span class=\"mspace\" style=\"margin-right: 0.1667em\"><\/span><span class=\"mpunct\">,<\/span><span class=\"mspace\" style=\"margin-right: 0.1667em\"><\/span><span class=\"mord\"><span class=\"mord mathnormal\">s<\/span><span class=\"msupsub\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.8913em\"><span class=\"\" style=\"top: -2.453em;margin-left: 0em;margin-right: 0.05em\"><span class=\"pstrut\" style=\"height: 2.7em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mathnormal mtight\" style=\"margin-right: 0.0315em\">k<\/span><\/span><\/span><span class=\"\" style=\"top: -3.113em;margin-right: 0.05em\"><span class=\"pstrut\" style=\"height: 2.7em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mathnormal mtight\" style=\"margin-right: 0.0077em\">R<\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.247em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><\/span><span class=\"mclose\">]<\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.898em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 1.5763em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><span class=\"mspace\" style=\"margin-right: 0.2222em\"><\/span><span class=\"mbin\">\u2295<\/span><span class=\"mspace\" style=\"margin-right: 0.2222em\"><\/span><\/span><span class=\"base\"><span class=\"strut\" style=\"height: 2.3263em;vertical-align: -1.5763em\"><\/span><span class=\"mord munder\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.75em\"><span class=\"\" style=\"top: -1.4237em\"><span class=\"pstrut\" style=\"height: 3em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mtight\"><span class=\"mord text mtight\"><span class=\"mord cjk_fallback mtight\">\u5168\u5c40\u6bb5<\/span><\/span><\/span><\/span><\/span><span class=\"\" style=\"top: -3em\"><span class=\"pstrut\" style=\"height: 3em\"><\/span><span class=\"mord munder\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.75em\"><span class=\"svg-align\" style=\"top: -2.102em\"><span class=\"pstrut\" style=\"height: 3em\"><\/span><span class=\"stretchy\" style=\"height: 0.548em;min-width: 1.6em\"><span class=\"brace-left\" style=\"height: 0.548em\"><\/span><span class=\"brace-center\" style=\"height: 0.548em\"><\/span><span class=\"brace-right\" style=\"height: 0.548em\"><\/span><\/span><\/span><span class=\"\" style=\"top: -3em\"><span class=\"pstrut\" style=\"height: 3em\"><\/span><span class=\"mord\"><span class=\"mopen\">[<\/span><span class=\"mord\"><span class=\"mord text\"><span class=\"mord\">CLS<\/span><\/span><span class=\"msupsub\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.3283em\"><span class=\"\" style=\"top: -2.55em;margin-right: 0.05em\"><span class=\"pstrut\" style=\"height: 2.7em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mathnormal mtight\">G<\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.15em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><\/span><span class=\"mpunct\">,<\/span><span class=\"mspace\" style=\"margin-right: 0.1667em\"><\/span><span class=\"mord\"><span class=\"mord mathnormal\" style=\"margin-right: 0.0359em\">g<\/span><span class=\"msupsub\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.3011em\"><span class=\"\" style=\"top: -2.55em;margin-left: -0.0359em;margin-right: 0.05em\"><span class=\"pstrut\" style=\"height: 2.7em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mtight\">1<\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.15em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><\/span><span class=\"mpunct\">,<\/span><span class=\"mspace\" style=\"margin-right: 0.1667em\"><\/span><span class=\"minner\">\u2026<\/span><span class=\"mspace\" style=\"margin-right: 0.1667em\"><\/span><span class=\"mpunct\">,<\/span><span class=\"mspace\" style=\"margin-right: 0.1667em\"><\/span><span class=\"mord\"><span class=\"mord mathnormal\" style=\"margin-right: 0.0359em\">g<\/span><span class=\"msupsub\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.1514em\"><span class=\"\" style=\"top: -2.55em;margin-left: -0.0359em;margin-right: 0.05em\"><span class=\"pstrut\" style=\"height: 2.7em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mathnormal mtight\">m<\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.15em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><\/span><span class=\"mclose\">]<\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.898em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 1.5763em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><span class=\"mspace\" style=\"margin-right: 0.2222em\"><\/span><span class=\"mbin\">\u2295<\/span><span class=\"mspace\" style=\"margin-right: 0.2222em\"><\/span><\/span><span class=\"base\"><span class=\"strut\" style=\"height: 0.6833em\"><\/span><span class=\"mord text\"><span class=\"mord\">PE<\/span><\/span><\/span><\/span><\/span><\/span><\/span><\/p>\n<ul>\n<li><span class=\"katex--inline\"><span class=\"katex\"><span class=\"katex-mathml\">siL,siRs^L_i, s^R_i<\/span><span class=\"katex-html\"><span class=\"base\"><span class=\"strut\" style=\"height: 1.1em;vertical-align: -0.2587em\"><\/span><span class=\"mord\"><span class=\"mord mathnormal\">s<\/span><span class=\"msupsub\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.8413em\"><span class=\"\" style=\"top: -2.4413em;margin-left: 0em;margin-right: 0.05em\"><span class=\"pstrut\" style=\"height: 2.7em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mathnormal mtight\">i<\/span><\/span><\/span><span class=\"\" style=\"top: -3.063em;margin-right: 0.05em\"><span class=\"pstrut\" style=\"height: 2.7em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mathnormal mtight\">L<\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.2587em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><\/span><span class=\"mpunct\">,<\/span><span class=\"mspace\" style=\"margin-right: 0.1667em\"><\/span><span class=\"mord\"><span class=\"mord mathnormal\">s<\/span><span class=\"msupsub\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.8413em\"><span class=\"\" style=\"top: -2.4413em;margin-left: 0em;margin-right: 0.05em\"><span class=\"pstrut\" style=\"height: 2.7em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mathnormal mtight\">i<\/span><\/span><\/span><span class=\"\" style=\"top: -3.063em;margin-right: 0.05em\"><span class=\"pstrut\" style=\"height: 2.7em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mathnormal mtight\" style=\"margin-right: 0.0077em\">R<\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.2587em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><\/span><\/span><\/span><\/span><\/span>&#xff1a;\u5de6\/\u53f3\u81c2\u7684\u5173\u8282\u503c\u4e0e\u5bf9\u5e94\u8155\u90e8\u76f8\u673a ResNet18 \u7279\u5f81 token&#xff1b;<\/li>\n<li><span class=\"katex--inline\"><span class=\"katex\"><span class=\"katex-mathml\">gjg_j<\/span><span class=\"katex-html\"><span class=\"base\"><span class=\"strut\" style=\"height: 0.7167em;vertical-align: -0.2861em\"><\/span><span class=\"mord\"><span class=\"mord mathnormal\" style=\"margin-right: 0.0359em\">g<\/span><span class=\"msupsub\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.3117em\"><span class=\"\" style=\"top: -2.55em;margin-left: -0.0359em;margin-right: 0.05em\"><span class=\"pstrut\" style=\"height: 2.7em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mathnormal mtight\" style=\"margin-right: 0.0572em\">j<\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.2861em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><\/span><\/span><\/span><\/span><\/span>&#xff1a;\u53cc\u81c2\u5173\u8282 &#043; \u5168\u90e8\u76f8\u673a\u7279\u5f81&#xff1b;<\/li>\n<li>PE \u4e3a\u4f4d\u7f6e\u7f16\u7801&#xff1b;\u6bcf\u6bb5\u5f00\u5934\u7684 CLS token \u6c47\u805a\u672c\u6bb5\u4fe1\u606f&#xff08;\u8bba\u6587\u5f15\u7528 BERT \u7684 CLS \u673a\u5236&#xff09;\u3002<\/li>\n<\/ul>\n<p>IACE \u7684\u6539\u52a8&#xff1a;\u5728\u5c40\u90e8\u7f16\u7801\u5668\u4e4b\u540e\u63d2\u5165\u4e00\u4e2a\u5168\u5c40\u534f\u8c03\u7f16\u7801\u5668&#xff0c;\u5176\u81ea\u6ce8\u610f\u529b\u4f5c\u7528\u4e8e\u62fc\u63a5\u540e\u7684\u53cc\u81c2 &#043; \u5168\u5c40 token&#xff1a;<\/p>\n<p><span class=\"katex--display\"><span class=\"katex-display\"><span class=\"katex\"><span class=\"katex-mathml\">Hcoord&#061;TransformerEncIACE([EL;ER;EG])H_{\\\\text{coord}} &#061; \\\\text{TransformerEnc}_{\\\\text{IACE}}\\\\left( [E_L; E_R; E_G] \\\\right)<\/span><span class=\"katex-html\"><span class=\"base\"><span class=\"strut\" style=\"height: 0.8333em;vertical-align: -0.15em\"><\/span><span class=\"mord\"><span class=\"mord mathnormal\" style=\"margin-right: 0.0813em\">H<\/span><span class=\"msupsub\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.3361em\"><span class=\"\" style=\"top: -2.55em;margin-left: -0.0813em;margin-right: 0.05em\"><span class=\"pstrut\" style=\"height: 2.7em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mtight\"><span class=\"mord text mtight\"><span class=\"mord mtight\">coord<\/span><\/span><\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.15em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><\/span><span class=\"mspace\" style=\"margin-right: 0.2778em\"><\/span><span class=\"mrel\">&#061;<\/span><span class=\"mspace\" style=\"margin-right: 0.2778em\"><\/span><\/span><span class=\"base\"><span class=\"strut\" style=\"height: 1em;vertical-align: -0.25em\"><\/span><span class=\"mord\"><span class=\"mord text\"><span class=\"mord\">TransformerEnc<\/span><\/span><span class=\"msupsub\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.3283em\"><span class=\"\" style=\"top: -2.55em;margin-right: 0.05em\"><span class=\"pstrut\" style=\"height: 2.7em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mtight\"><span class=\"mord text mtight\"><span class=\"mord mtight\">IACE<\/span><\/span><\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.15em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><\/span><span class=\"mspace\" style=\"margin-right: 0.1667em\"><\/span><span class=\"minner\"><span class=\"mopen delimcenter\" style=\"top: 0em\">(<\/span><span class=\"mopen\">[<\/span><span class=\"mord\"><span class=\"mord mathnormal\" style=\"margin-right: 0.0576em\">E<\/span><span class=\"msupsub\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.3283em\"><span class=\"\" style=\"top: -2.55em;margin-left: -0.0576em;margin-right: 0.05em\"><span class=\"pstrut\" style=\"height: 2.7em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mathnormal mtight\">L<\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.15em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><\/span><span class=\"mpunct\">;<\/span><span class=\"mspace\" style=\"margin-right: 0.1667em\"><\/span><span class=\"mord\"><span class=\"mord mathnormal\" style=\"margin-right: 0.0576em\">E<\/span><span class=\"msupsub\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.3283em\"><span class=\"\" style=\"top: -2.55em;margin-left: -0.0576em;margin-right: 0.05em\"><span class=\"pstrut\" style=\"height: 2.7em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mathnormal mtight\" style=\"margin-right: 0.0077em\">R<\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.15em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><\/span><span class=\"mpunct\">;<\/span><span class=\"mspace\" style=\"margin-right: 0.1667em\"><\/span><span class=\"mord\"><span class=\"mord mathnormal\" style=\"margin-right: 0.0576em\">E<\/span><span class=\"msupsub\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.3283em\"><span class=\"\" style=\"top: -2.55em;margin-left: -0.0576em;margin-right: 0.05em\"><span class=\"pstrut\" style=\"height: 2.7em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mathnormal mtight\">G<\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.15em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><\/span><span class=\"mclose\">]<\/span><span class=\"mclose delimcenter\" style=\"top: 0em\">)<\/span><\/span><\/span><\/span><\/span><\/span><\/span><\/p>\n<p>\u5176\u4e2d <span class=\"katex--inline\"><span class=\"katex\"><span class=\"katex-mathml\">EL,ERE_L, E_R<\/span><span class=\"katex-html\"><span class=\"base\"><span class=\"strut\" style=\"height: 0.8778em;vertical-align: -0.1944em\"><\/span><span class=\"mord\"><span class=\"mord mathnormal\" style=\"margin-right: 0.0576em\">E<\/span><span class=\"msupsub\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.3283em\"><span class=\"\" style=\"top: -2.55em;margin-left: -0.0576em;margin-right: 0.05em\"><span class=\"pstrut\" style=\"height: 2.7em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mathnormal mtight\">L<\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.15em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><\/span><span class=\"mpunct\">,<\/span><span class=\"mspace\" style=\"margin-right: 0.1667em\"><\/span><span class=\"mord\"><span class=\"mord mathnormal\" style=\"margin-right: 0.0576em\">E<\/span><span class=\"msupsub\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.3283em\"><span class=\"\" style=\"top: -2.55em;margin-left: -0.0576em;margin-right: 0.05em\"><span class=\"pstrut\" style=\"height: 2.7em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mathnormal mtight\" style=\"margin-right: 0.0077em\">R<\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.15em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><\/span><\/span><\/span><\/span><\/span> \u4e3a\u5de6\u53f3\u5c40\u90e8\u7f16\u7801\u5668\u8f93\u51fa&#xff0c;<span class=\"katex--inline\"><span class=\"katex\"><span class=\"katex-mathml\">EGE_G<\/span><span class=\"katex-html\"><span class=\"base\"><span class=\"strut\" style=\"height: 0.8333em;vertical-align: -0.15em\"><\/span><span class=\"mord\"><span class=\"mord mathnormal\" style=\"margin-right: 0.0576em\">E<\/span><span class=\"msupsub\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.3283em\"><span class=\"\" style=\"top: -2.55em;margin-left: -0.0576em;margin-right: 0.05em\"><span class=\"pstrut\" style=\"height: 2.7em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mathnormal mtight\">G<\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.15em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><\/span><\/span><\/span><\/span><\/span> \u4e3a\u5168\u5c40\u6bb5\u7f16\u7801\u3002\u6b63\u662f\u8fd9\u4e00\u6b65\u8ba9&#034;\u53f3\u624b\u72b6\u6001&#034;\u6210\u4e3a&#034;\u5de6\u624b\u51b3\u7b56&#034;\u7684\u663e\u5f0f\u4e0a\u4e0b\u6587\u3002<\/p>\n<h4>3.3 \u52a8\u4f5c\u5206\u5757\u4e0e\u65f6\u5e8f\u96c6\u6210<\/h4>\n<p>\u89e3\u7801\u5668&#xff08;query \u4f4d\u7f6e\u5d4c\u5165\u4e3a\u8f93\u5165&#xff09;\u8f93\u51fa\u672a\u6765 <span class=\"katex--inline\"><span class=\"katex\"><span class=\"katex-mathml\">kk<\/span><span class=\"katex-html\"><span class=\"base\"><span class=\"strut\" style=\"height: 0.6944em\"><\/span><span class=\"mord mathnormal\" style=\"margin-right: 0.0315em\">k<\/span><\/span><\/span><\/span><\/span> \u6b65\u52a8\u4f5c\u5757&#xff1a;<\/p>\n<p><span class=\"katex--display\"><span class=\"katex-display\"><span class=\"katex\"><span class=\"katex-mathml\">at:t&#043;k&#061;TransformerDec(query&#061;Paction,\u00a0key\/value&#061;[Hcoord;EL;ER])a_{t:t&#043;k} &#061; \\\\text{TransformerDec}(\\\\text{query}&#061;P_{\\\\text{action}},\\\\ \\\\text{key\/value}&#061;[H_{\\\\text{coord}}; E_L; E_R])<\/span><span class=\"katex-html\"><span class=\"base\"><span class=\"strut\" style=\"height: 0.6389em;vertical-align: -0.2083em\"><\/span><span class=\"mord\"><span class=\"mord mathnormal\">a<\/span><span class=\"msupsub\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.3361em\"><span class=\"\" style=\"top: -2.55em;margin-left: 0em;margin-right: 0.05em\"><span class=\"pstrut\" style=\"height: 2.7em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mtight\"><span class=\"mord mathnormal mtight\">t<\/span><span class=\"mrel mtight\">:<\/span><span class=\"mord mathnormal mtight\">t<\/span><span class=\"mbin mtight\">&#043;<\/span><span class=\"mord mathnormal mtight\" style=\"margin-right: 0.0315em\">k<\/span><\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.2083em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><\/span><span class=\"mspace\" style=\"margin-right: 0.2778em\"><\/span><span class=\"mrel\">&#061;<\/span><span class=\"mspace\" style=\"margin-right: 0.2778em\"><\/span><\/span><span class=\"base\"><span class=\"strut\" style=\"height: 1em;vertical-align: -0.25em\"><\/span><span class=\"mord text\"><span class=\"mord\">TransformerDec<\/span><\/span><span class=\"mopen\">(<\/span><span class=\"mord text\"><span class=\"mord\">query<\/span><\/span><span class=\"mspace\" style=\"margin-right: 0.2778em\"><\/span><span class=\"mrel\">&#061;<\/span><span class=\"mspace\" style=\"margin-right: 0.2778em\"><\/span><\/span><span class=\"base\"><span class=\"strut\" style=\"height: 1em;vertical-align: -0.25em\"><\/span><span class=\"mord\"><span class=\"mord mathnormal\" style=\"margin-right: 0.1389em\">P<\/span><span class=\"msupsub\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.3175em\"><span class=\"\" style=\"top: -2.55em;margin-left: -0.1389em;margin-right: 0.05em\"><span class=\"pstrut\" style=\"height: 2.7em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mtight\"><span class=\"mord text mtight\"><span class=\"mord mtight\">action<\/span><\/span><\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.15em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><\/span><span class=\"mpunct\">,<\/span><span class=\"mspace\">\u00a0<\/span><span class=\"mspace\" style=\"margin-right: 0.1667em\"><\/span><span class=\"mord text\"><span class=\"mord\">key\/value<\/span><\/span><span class=\"mspace\" style=\"margin-right: 0.2778em\"><\/span><span class=\"mrel\">&#061;<\/span><span class=\"mspace\" style=\"margin-right: 0.2778em\"><\/span><\/span><span class=\"base\"><span class=\"strut\" style=\"height: 1em;vertical-align: -0.25em\"><\/span><span class=\"mopen\">[<\/span><span class=\"mord\"><span class=\"mord mathnormal\" style=\"margin-right: 0.0813em\">H<\/span><span class=\"msupsub\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.3361em\"><span class=\"\" style=\"top: -2.55em;margin-left: -0.0813em;margin-right: 0.05em\"><span class=\"pstrut\" style=\"height: 2.7em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mtight\"><span class=\"mord text mtight\"><span class=\"mord mtight\">coord<\/span><\/span><\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.15em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><\/span><span class=\"mpunct\">;<\/span><span class=\"mspace\" style=\"margin-right: 0.1667em\"><\/span><span class=\"mord\"><span class=\"mord mathnormal\" style=\"margin-right: 0.0576em\">E<\/span><span class=\"msupsub\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.3283em\"><span class=\"\" style=\"top: -2.55em;margin-left: -0.0576em;margin-right: 0.05em\"><span class=\"pstrut\" style=\"height: 2.7em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mathnormal mtight\">L<\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.15em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><\/span><span class=\"mpunct\">;<\/span><span class=\"mspace\" style=\"margin-right: 0.1667em\"><\/span><span class=\"mord\"><span class=\"mord mathnormal\" style=\"margin-right: 0.0576em\">E<\/span><span class=\"msupsub\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.3283em\"><span class=\"\" style=\"top: -2.55em;margin-left: -0.0576em;margin-right: 0.05em\"><span class=\"pstrut\" style=\"height: 2.7em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mathnormal mtight\" style=\"margin-right: 0.0077em\">R<\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.15em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><\/span><span class=\"mclose\">])<\/span><\/span><\/span><\/span><\/span><\/span><\/p>\n<p>\u5355\u89e3\u7801\u5668\u4e00\u6b21\u51fa\u53cc\u81c2\u8054\u5408\u5757&#xff08;<span class=\"katex--inline\"><span class=\"katex\"><span class=\"katex-mathml\">2\u00d7ndof2 \\\\times n_{\\\\text{dof}}<\/span><span class=\"katex-html\"><span class=\"base\"><span class=\"strut\" style=\"height: 0.7278em;vertical-align: -0.0833em\"><\/span><span class=\"mord\">2<\/span><span class=\"mspace\" style=\"margin-right: 0.2222em\"><\/span><span class=\"mbin\">\u00d7<\/span><span class=\"mspace\" style=\"margin-right: 0.2222em\"><\/span><\/span><span class=\"base\"><span class=\"strut\" style=\"height: 0.5806em;vertical-align: -0.15em\"><\/span><span class=\"mord\"><span class=\"mord mathnormal\">n<\/span><span class=\"msupsub\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.3361em\"><span class=\"\" style=\"top: -2.55em;margin-left: 0em;margin-right: 0.05em\"><span class=\"pstrut\" style=\"height: 2.7em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mtight\"><span class=\"mord text mtight\"><span class=\"mord mtight\">dof<\/span><\/span><\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.15em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><\/span><\/span><\/span><\/span><\/span> \u7ef4&#xff09;&#xff1b;\u5206\u88c2\u89e3\u7801\u5668\u51fa\u4e24\u4e2a\u72ec\u7acb\u5757\u3002\u63a8\u7406\u65f6\u5bf9\u65f6\u95f4\u4e0a\u91cd\u53e0\u7684\u9884\u6d4b\u505a\u6307\u6570\u52a0\u6743\u878d\u5408&#xff1a;<\/p>\n<p><span class=\"katex--display\"><span class=\"katex-display\"><span class=\"katex\"><span class=\"katex-mathml\">a^t&#061;\u2211iwi\u2009at(t\u2212i)\u2211iwi,wi&#061;exp\u2061(\u2212\u03bbi)\\\\hat{a}_t &#061; \\\\frac{\\\\sum_{i} w_i \\\\, a_t^{(t-i)}}{\\\\sum_i w_i}, \\\\quad w_i &#061; \\\\exp(-\\\\lambda i)<\/span><span class=\"katex-html\"><span class=\"base\"><span class=\"strut\" style=\"height: 0.8444em;vertical-align: -0.15em\"><\/span><span class=\"mord\"><span class=\"mord accent\"><span class=\"vlist-t\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.6944em\"><span class=\"\" style=\"top: -3em\"><span class=\"pstrut\" style=\"height: 3em\"><\/span><span class=\"mord mathnormal\">a<\/span><\/span><span class=\"\" style=\"top: -3em\"><span class=\"pstrut\" style=\"height: 3em\"><\/span><span class=\"accent-body\" style=\"left: -0.25em\"><span class=\"mord\">^<\/span><\/span><\/span><\/span><\/span><\/span><\/span><span class=\"msupsub\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.2806em\"><span class=\"\" style=\"top: -2.55em;margin-left: 0em;margin-right: 0.05em\"><span class=\"pstrut\" style=\"height: 2.7em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mathnormal mtight\">t<\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.15em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><\/span><span class=\"mspace\" style=\"margin-right: 0.2778em\"><\/span><span class=\"mrel\">&#061;<\/span><span class=\"mspace\" style=\"margin-right: 0.2778em\"><\/span><\/span><span class=\"base\"><span class=\"strut\" style=\"height: 2.7202em;vertical-align: -0.9857em\"><\/span><span class=\"mord\"><span class=\"mopen nulldelimiter\"><\/span><span class=\"mfrac\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 1.7345em\"><span class=\"\" style=\"top: -2.3588em\"><span class=\"pstrut\" style=\"height: 3.0448em\"><\/span><span class=\"mord\"><span class=\"mop\"><span class=\"mop op-symbol small-op\" style=\"position: relative;top: 0em\">\u2211<\/span><span class=\"msupsub\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.162em\"><span class=\"\" style=\"top: -2.4003em;margin-left: 0em;margin-right: 0.05em\"><span class=\"pstrut\" style=\"height: 2.7em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mathnormal mtight\">i<\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.2997em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><\/span><span class=\"mspace\" style=\"margin-right: 0.1667em\"><\/span><span class=\"mord\"><span class=\"mord mathnormal\" style=\"margin-right: 0.0269em\">w<\/span><span class=\"msupsub\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.3117em\"><span class=\"\" style=\"top: -2.55em;margin-left: -0.0269em;margin-right: 0.05em\"><span class=\"pstrut\" style=\"height: 2.7em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mathnormal mtight\">i<\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.15em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><\/span><\/span><\/span><span class=\"\" style=\"top: -3.2748em\"><span class=\"pstrut\" style=\"height: 3.0448em\"><\/span><span class=\"frac-line\" style=\"border-bottom-width: 0.04em\"><\/span><\/span><span class=\"\" style=\"top: -3.7345em\"><span class=\"pstrut\" style=\"height: 3.0448em\"><\/span><span class=\"mord\"><span class=\"mop\"><span class=\"mop op-symbol small-op\" style=\"position: relative;top: 0em\">\u2211<\/span><span class=\"msupsub\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.162em\"><span class=\"\" style=\"top: -2.4003em;margin-left: 0em;margin-right: 0.05em\"><span class=\"pstrut\" style=\"height: 2.7em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mtight\"><span class=\"mord mathnormal mtight\">i<\/span><\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.2997em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><\/span><span class=\"mspace\" style=\"margin-right: 0.1667em\"><\/span><span class=\"mord\"><span class=\"mord mathnormal\" style=\"margin-right: 0.0269em\">w<\/span><span class=\"msupsub\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.3117em\"><span class=\"\" style=\"top: -2.55em;margin-left: -0.0269em;margin-right: 0.05em\"><span class=\"pstrut\" style=\"height: 2.7em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mathnormal mtight\">i<\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.15em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><\/span><span class=\"mspace\" style=\"margin-right: 0.1667em\"><\/span><span class=\"mord\"><span class=\"mord mathnormal\">a<\/span><span class=\"msupsub\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 1.0448em\"><span class=\"\" style=\"top: -2.4542em;margin-left: 0em;margin-right: 0.05em\"><span class=\"pstrut\" style=\"height: 2.7em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mathnormal mtight\">t<\/span><\/span><\/span><span class=\"\" style=\"top: -3.2198em;margin-right: 0.05em\"><span class=\"pstrut\" style=\"height: 2.7em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mtight\"><span class=\"mopen mtight\">(<\/span><span class=\"mord mathnormal mtight\">t<\/span><span class=\"mbin mtight\">\u2212<\/span><span class=\"mord mathnormal mtight\">i<\/span><span class=\"mclose mtight\">)<\/span><\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.2458em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.9857em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><span class=\"mclose nulldelimiter\"><\/span><\/span><span class=\"mpunct\">,<\/span><span class=\"mspace\" style=\"margin-right: 1em\"><\/span><span class=\"mspace\" style=\"margin-right: 0.1667em\"><\/span><span class=\"mord\"><span class=\"mord mathnormal\" style=\"margin-right: 0.0269em\">w<\/span><span class=\"msupsub\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.3117em\"><span class=\"\" style=\"top: -2.55em;margin-left: -0.0269em;margin-right: 0.05em\"><span class=\"pstrut\" style=\"height: 2.7em\"><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mathnormal mtight\">i<\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height: 0.15em\"><span class=\"\"><\/span><\/span><\/span><\/span><\/span><\/span><span class=\"mspace\" style=\"margin-right: 0.2778em\"><\/span><span class=\"mrel\">&#061;<\/span><span class=\"mspace\" style=\"margin-right: 0.2778em\"><\/span><\/span><span class=\"base\"><span class=\"strut\" style=\"height: 1em;vertical-align: -0.25em\"><\/span><span class=\"mop\">exp<\/span><span class=\"mopen\">(<\/span><span class=\"mord\">\u2212<\/span><span class=\"mord mathnormal\">\u03bbi<\/span><span class=\"mclose\">)<\/span><\/span><\/span><\/span><\/span><\/span><\/p>\n<p>\u8f83\u65b0\u7684\u9884\u6d4b\u6743\u91cd\u66f4\u9ad8&#xff0c;\u65e7\u9884\u6d4b\u9010\u6e10\u5931\u6548\u2014\u2014\u8fd9\u5c42\u96c6\u6210\u62b9\u5e73\u4e86\u5206\u5757\u5207\u6362\u65f6\u7684\u8fb9\u754c\u6296\u52a8\u3002<\/p>\n<hr \/>\n<h3>\u56db\u3001\u56fe\u793a<\/h3>\n<h4>4.1 \u4e94\u79cd\u88ab\u6d4b\u67b6\u6784&#xff08;\u5bf9\u5e94\u8bba\u6587 Figure 1 &amp; Figure 5&#xff09;<\/h4>\n<p> (a) Ours \u5355\u89e3\u7801\u5668                (b) Ours \u5206\u88c2\u89e3\u7801\u5668<br \/>\n \u250c\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2510           \u250c\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2510<br \/>\n \u2502 \u5de6\u81c2Enc\u2510          \u2502           \u2502 \u5de6\u81c2Enc \u2500\u2510        \u2502<br \/>\n \u2502 \u53f3\u81c2Enc\u253c\u2500\u25b6 IACE \u2500\u2500\u253c\u2500\u25b6 \u5355Dec   \u2502 \u53f3\u81c2Enc \u2500\u253c\u2500\u25b6IACE   \u2502<br \/>\n \u2502 \u5168\u5c40Enc\u2518          \u2502  (\u62fc\u8f93\u5165)  \u2502 \u5168\u5c40Enc \u2500\u2518  \u2502      \u2502<br \/>\n \u2502                  \u2502           \u2502      \u250c\u2500\u2500\u2500\u2500\u2500\u2534\u2500\u2500\u2500\u2500\u2510   \u2502<br \/>\n \u2502 \u8f93\u51fa: \u53cc\u81c2\u8054\u5408\u52a8\u4f5c\u5757 \u2502           \u2502 \u5de6Dec\u25c0\u2500\u2524          \u2502   \u2502<br \/>\n \u2514\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2518           \u2502 \u53f3Dec\u25c0\u2500\u2518 (\u5404\u81ea&#043;IACE)   \u2502<br \/>\n                                \u2502 \u8f93\u51fa: \u5de6\u53f3\u72ec\u7acb\u52a8\u4f5c\u5757     \u2502<br \/>\n                                \u2514\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2518<\/p>\n<p> (c)(d) \u53bb\u6389 IACE \u7684\u5bf9\u5e94\u6d88\u878d\u7248        (e) ACT \u57fa\u7ebf (\u65e0\u5206\u81c2Enc, \u65e0IACE)<\/p>\n<h4>4.2 \u4efb\u52a1\u4e8c\u5206\u6cd5\u4e0e\u67b6\u6784\u9009\u578b\u7ed3\u8bba<\/h4>\n<p>        \u5f02\u6b65\u4efb\u52a1 (\u4e24\u624b\u5404\u5e72\u5404\u7684)           \u540c\u6b65\u4efb\u52a1 (\u4e24\u624b\u5fc5\u987b\u914d\u5408)<br \/>\n  \u250c\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2510     \u250c\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2510<br \/>\n  \u2502 Fold Towel \u6298\u6bdb\u5dfe        \u2502     \u2502 Lift &amp; Place Towel \u62ac\u653e\u6bdb\u5dfe\u2502<br \/>\n  \u2502 Hand-over CAN \u9012\u7f50\u5b50     \u2502     \u2502 Lift Board \u62ac\u677f          \u2502<br \/>\n  \u2502 Hit with Hammer \u6325\u9524     \u2502     \u2502 Open Toolbox \u5f00\u5de5\u5177\u7bb1     \u2502<br \/>\n  \u2502 Hand-over Silver Bag \u9012\u5305 \u2502     \u2502 Open Lid \u5f00\u76d6           \u2502<br \/>\n  \u2514\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2518     \u2514\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2518<br \/>\n        \u5e73\u5747 89.3% \u2705 \u5206\u88c2\u89e3\u7801\u5668           \u5e73\u5747 98.4% \u2705 \u5355\u89e3\u7801\u5668<br \/>\n        (\u5355\u89e3\u7801\u5668 85.8%)                (\u5206\u88c2\u89e3\u7801\u5668 90.4%)<br \/>\n                    \u2514\u2500\u2500\u2500\u2500\u2500\u2500 \u5171\u540c\u5730\u57fa: IACE \u2500\u2500\u2500\u2500\u2500\u2500\u2518<br \/>\n              \u53bb\u6389 IACE: \u5f02\u6b65 89\u219275\/60, \u540c\u6b65 98\u219257 (\u707e\u96be\u6027\u584c\u65b9)<\/p>\n<h4>4.3 \u5b9e\u9a8c\u914d\u7f6e\u901f\u67e5\u8868<\/h4>\n<table>\n<tr>\u9879\u76ee\u914d\u7f6e<\/tr>\n<tbody>\n<tr>\n<td>\u673a\u5668\u4eba<\/td>\n<td>2 \u00d7 ViperX 300S&#xff08;ALOHA \u6539\u88c5&#xff1a;\u8c03\u76f8\u673a\u9ad8\u5ea6\u3001\u52a0\u9632\u62a4\u5e03&#xff09;<\/td>\n<\/tr>\n<tr>\n<td>\u76f8\u673a<\/td>\n<td>4 \u8def RGB&#xff1a;\u5de6\/\u53f3\u8155 &#043; \u4e0a\u65b9\u4fef\u89c6 &#043; \u4e0b\u65b9\u6c34\u5e73\u89c6<\/td>\n<\/tr>\n<tr>\n<td>\u9065\u64cd\u4f5c<\/td>\n<td>ALOHA \u4e3b\u4ece\u81c2&#xff0c;50 Hz \u91c7\u96c6 \u2192 25 Hz \u8bad\u7ec3<\/td>\n<\/tr>\n<tr>\n<td>\u6570\u636e\u91cf<\/td>\n<td>\u6bcf\u4efb\u52a1 50 \u6761\u6f14\u793a \u00d7 8 \u4efb\u52a1<\/td>\n<\/tr>\n<tr>\n<td>\u4f18\u5316<\/td>\n<td>AdamW&#xff0c;\u03bb&#061;1e-5&#xff0c;5000 epochs&#xff0c;batch 8<\/td>\n<\/tr>\n<tr>\n<td>\u786c\u4ef6<\/td>\n<td>Core i9 \/ 128GB RAM \/ RTX 4090 24GB<\/td>\n<\/tr>\n<tr>\n<td>\u63a8\u7406\u5ef6\u8fdf<\/td>\n<td>~0.02 s<\/td>\n<\/tr>\n<tr>\n<td>\u8bc4\u6d4b<\/td>\n<td>\u6bcf\u4efb\u52a1 25 episodes<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<hr \/>\n<h3>\u4e94\u3001\u8e29\u5751\u70b9<\/h3>\n<h4>\u8303\u5f0f\u7ea7<\/h4>\n<p>\u5751 1&#xff1a;flatten \u53cc\u81c2\u81ea\u7531\u5ea6 \u2260 \u5b66\u4f1a\u53cc\u81c2\u3002<br \/>\n\u8fd9\u662f\u5168\u6587\u7684\u4e2d\u5fc3\u8bba\u70b9&#xff1a;\u628a 21 \u7ef4\u52a8\u4f5c\u5411\u91cf&#xff08;\u6216\u4efb\u610f\u53cc\u81c2\u62fc\u63a5&#xff09;\u76f4\u63a5\u7aef\u5230\u7aef\u5b66&#xff0c;\u7f51\u7edc\u6ca1\u6709\u7ed3\u6784\u6027\u52a8\u529b\u53bb\u5206\u522b\u638c\u63e1\u6bcf\u53ea\u624b\u7684\u6280\u80fd&#xff0c;\u4e5f\u6ca1\u6709\u663e\u5f0f\u901a\u9053\u53bb\u5efa\u6a21\u5de6\u53f3\u4e92\u4f9d\u8d56\u3002\u6d88\u878d\u6570\u636e\u652f\u6491\u5f97\u5f88\u786c&#xff1a;\u53bb\u6389 IACE \u540e&#xff0c;\u540c\u6b65\u4efb\u52a1\u5e73\u5747\u6210\u529f\u7387\u4ece 98.4%\/90.4% \u6389\u5230 56.8%\/57.6%\u2014\u2014\u6389\u6389 40 \u4e2a\u767e\u5206\u70b9&#xff0c;\u63a5\u8fd1\u968f\u673a\u5931\u8d25\u3002\u534f\u8c03\u4e0d\u662f&#034;\u5e0c\u671b\u80fd\u5b66\u5230&#034;&#xff0c;\u800c\u662f\u8981\u7ed9\u4e00\u6761\u4e13\u95e8\u7684\u901a\u8def\u3002<\/p>\n<p>\u5751 2&#xff1a;\u89e3\u7801\u5668\u67b6\u6784\u6ca1\u6709\u4e07\u80fd\u7b54\u6848\u2014\u2014\u4efb\u52a1\u8026\u5408\u5ea6\u51b3\u5b9a\u4e00\u5207\u3002<br \/>\n\u5206\u88c2\u89e3\u7801\u5668\u5728\u5f02\u6b65\u4efb\u52a1\u8d62&#xff08;89.3% vs 85.8%&#xff09;&#xff0c;\u5355\u89e3\u7801\u5668\u5728\u540c\u6b65\u4efb\u52a1\u8d62&#xff08;98.4% vs 90.4%&#xff09;\u3002\u539f\u56e0\u76f4\u767d&#xff1a;\u5f02\u6b65\u4efb\u52a1\u91cc\u4e24\u81c2\u76ee\u6807\u76f8\u4e92\u72ec\u7acb&#xff0c;\u5206\u88c2\u89e3\u7801\u907f\u514d\u4e86&#034;\u53e6\u4e00\u53ea\u624b\u7684\u566a\u58f0\u68af\u5ea6&#034;\u6c61\u67d3\u672c\u81c2\u52a8\u4f5c&#xff1b;\u540c\u6b65\u4efb\u52a1\u91cc\u4e24\u81c2\u52a8\u4f5c\u672c\u8d28\u662f\u4e00\u4e2a\u6574\u4f53&#xff08;\u62ac\u6bdb\u5dfe\u65f6\u5de6\u53f3\u5fc5\u987b\u955c\u50cf\u5bf9\u79f0&#xff09;&#xff0c;\u5206\u88c2\u89e3\u7801\u5207\u65ad\u4e86\u4f4e\u5c42\u4fe1\u606f\u5171\u4eab&#xff0c;\u5168\u9760 IACE \u5355\u70b9\u534f\u8c03&#xff0c;\u53cd\u800c\u5403\u4e8f\u3002\u505a\u67b6\u6784\u9009\u578b\u524d\u5148\u95ee\u81ea\u5df1\u7684\u4efb\u52a1\u5c5e\u4e8e\u54ea\u4e00\u7c7b\u3002<\/p>\n<p>\u5751 3&#xff1a;\u9065\u64cd\u4f5c\u6570\u636e\u7684\u9ad8\u9891\u566a\u58f0\u4f1a\u6253\u7206\u52a8\u4f5c\u5206\u5757\u8bad\u7ec3\u3002<br \/>\n50 Hz \u9065\u64cd\u4f5c\u6570\u636e\u91cc&#xff0c;\u4eba\u624b\u7684\u5fae\u5c0f\u6296\u52a8\u8ba9\u76f8\u90bb\u5e27\u5173\u8282\u503c\u9ad8\u9891\u632f\u8361&#xff0c;ACT \u5f0f\u5206\u5757\u9884\u6d4b\u5728\u8fd9\u79cd\u6570\u636e\u4e0a\u8f93\u51fa\u4e0d\u7a33\u5b9a\u3002\u964d\u91c7\u6837\u5230 25 Hz \u8bad\u7ec3\u540e\u7a33\u5b9a\u3002\u8fd9\u4e2a\u5751\u548c\u91c7\u6837\u7387-\u63a7\u5236\u5e26\u5bbd\u7684\u5173\u7cfb\u503c\u5f97\u7ec6\u54c1&#xff1a;\u5206\u5757\u6a21\u578b\u9884\u6d4b\u7684\u662f&#034;\u5e73\u6ed1\u610f\u56fe&#034;&#xff0c;\u91c7\u6837\u7387\u9ad8\u4e8e\u610f\u56fe\u5e26\u5bbd\u65f6&#xff0c;\u6570\u636e\u91cc\u5168\u662f\u566a\u58f0\u800c\u6ca1\u6709\u610f\u56fe\u3002<\/p>\n<p>\u5751 4&#xff1a;\u5c0f\u6570\u636e\u4e0b\u7684 Diffusion Policy \u4e0d\u516c\u5e73\u3002<br \/>\n\u4f5c\u8005\u660e\u786e\u8bf4\u4e0d\u8ddf Diffusion Policy \u6bd4&#xff1a;\u6309 INTERACT \u7684\u7ed3\u8bba&#xff0c;DP \u5728 50 \u6761\u6f14\u793a\u91cf\u7ea7\u4e0b\u6839\u672c\u5b66\u4e0d\u52a8\u3002\u8fd9\u4e0d\u662f DP \u4e0d\u884c&#xff0c;\u662f\u6570\u636e\u9884\u7b97\u51b3\u5b9a\u7b97\u6cd5\u9009\u578b\u2014\u201450 \u6761\u6f14\u793a\u30015000 epochs\u3001\u5355\u5361 24GB \u662f\u8fd9\u7bc7\u7684\u9884\u7b97\u7ea6\u675f&#xff0c;ACT \u7cfb\u67b6\u6784\u6b63\u662f\u4e3a\u8fd9\u4e2a\u9884\u7b97\u751f\u7684\u3002<\/p>\n<p>\u5751 5&#xff1a;\u57fa\u7ebf\u9009\u62e9\u7684\u6b63\u5f53\u6027\u8981\u63d0\u524d\u5e03\u9632\u3002<br \/>\n\u4f5c\u8005\u5f15\u7528 Lee et al. \u7684\u7ed3\u8bba\u4e3a&#034;\u53ea\u548c ACT \u6bd4&#034;\u8fa9\u62a4&#xff08;DP \u9700\u8981\u66f4\u591a\u6570\u636e\u3001ACT \u5df2\u5728\u53cc\u81c2\u4efb\u52a1\u4e0a\u80dc\u8fc7\u591a\u4e2a\u7b56\u7565&#xff09;\u3002\u8fd9\u5728\u5ba1\u7a3f\u610f\u4e49\u4e0a\u662f\u5408\u7406\u7684&#xff0c;\u4f46\u8bfb\u8005\u5e94\u610f\u8bc6\u5230&#xff1a;\u672c\u6587\u7684\u6bd4\u8f83\u5bf9\u8c61\u662f&#034;\u67b6\u6784\u53d8\u4f53&#034;&#xff0c;\u4e0d\u662f&#034;SOTA \u65b9\u6cd5&#034;\u2014\u2014\u5b83\u56de\u7b54&#034;\u600e\u4e48\u6446\u7f16\u7801\u5668\u89e3\u7801\u5668&#034;&#xff0c;\u4e0d\u56de\u7b54&#034;\u54ea\u79cd\u7b97\u6cd5\u6700\u5f3a&#034;\u3002<\/p>\n<h4>\u5de5\u7a0b\u7ea7<\/h4>\n<p>\u5751 6&#xff1a;\u6bcf\u6bb5\u5f00\u5934\u7684 CLS token \u662f\u5ec9\u4ef7\u4f46\u5173\u952e\u7684\u8bbe\u8ba1\u3002<br \/>\n\u591a\u6bb5\u8f93\u5165\u5e8f\u5217\u91cc&#xff0c;\u6ca1\u6709 CLS \u6c47\u805a\u7684\u8bdd&#xff0c;\u6bb5\u7ea7\u6458\u8981\u4fe1\u606f\u53ea\u80fd\u9760\u6ce8\u610f\u529b\u81ea\u53d1\u5f62\u6210&#xff0c;\u8bad\u7ec3\u4e0d\u7a33\u5b9a\u3002\u8fd9\u662f\u4ece BERT \u501f\u6765\u7684\u8001\u6280\u672f&#xff0c;\u5728\u673a\u5668\u4eba\u7b56\u7565\u91cc\u540c\u6837\u597d\u4f7f\u3002<\/p>\n<p>\u5751 7&#xff1a;\u771f\u5b9e\u573a\u666f\u7684\u7269\u7406\u9632\u62a4\u3002<br \/>\n\u5b9e\u9a8c\u53f0\u4e0a\u52a0\u4e86\u9632\u62a4\u5e03&#xff08;protective tarp&#xff09;&#xff0c;\u76f8\u673a\u9ad8\u5ea6\u91cd\u65b0\u8c03\u6574\u2014\u2014\u53cc\u81c2\u6325\u9524\u3001\u62ac\u677f\u8fd9\u7c7b\u4efb\u52a1&#xff0c;\u7b56\u7565\u5931\u8d25\u4e00\u6b21\u5c31\u662f\u7269\u7406\u78b0\u649e\u3002\u771f\u673a\u5b9e\u9a8c\u7684\u5de5\u7a0b\u9884\u7b97\u91cc&#xff0c;\u9632\u62a4\u6c38\u8fdc\u8be5\u6392\u5728\u7cbe\u5ea6\u524d\u9762\u3002<\/p>\n<p>\u5751 8&#xff1a;\u4f5c\u8005\u81ea\u5df1\u627f\u8ba4\u63d0\u5347\u5e45\u5ea6\u4efb\u52a1\u76f8\u5173\u3002<br \/>\n\u7ed3\u8bba\u91cc\u660e\u786e\u5199&#xff1a;\u201cdepending on the type of tasks, the improvement in success rate by the proposed method may not be significant\u201d\u3002\u770b\u6570\u636e\u786e\u5b9e\u5982\u6b64&#xff1a;Open Toolbox\u3001Open Lid \u4e0a\u5404\u67b6\u6784\u51e0\u4e4e\u90fd 100%&#xff0c;IACE \u7684\u4ef7\u503c\u96c6\u4e2d\u5728\u9700\u8981\u7cbe\u7ec6\u534f\u8c03\u7684\u4efb\u52a1&#xff08;\u62ac\u653e\u6bdb\u5dfe\u3001\u6298\u6bdb\u5dfe\u3001\u6325\u9524&#xff09;\u4e0a\u3002\u7b80\u5355\u540c\u6b65\u4efb\u52a1\u4e0a\u5806\u67b6\u6784\u662f\u6d6a\u8d39\u3002<\/p>\n<hr \/>\n<h3>\u516d\u3001\u6e90\u7801\u62c6\u89e3<\/h3>\n<p>\u8bba\u6587\u672a\u9644\u5b98\u65b9\u4ee3\u7801&#xff08;\u4ee5\u8bba\u6587\u6b63\u6587 &#043; \u67b6\u6784\u56fe\u4e3a\u51c6\u91cd\u5efa\u4f2a\u4ee3\u7801&#xff1b;\u57fa\u5ea7\u5b9e\u73b0\u53ef\u76f4\u63a5\u590d\u7528 ACT \u5f00\u6e90\u4ed3\u5e93&#xff09;\u3002<\/p>\n<h4>6.1 \u6574\u4f53\u524d\u5411&#xff08;\u5bf9\u5e94\u8bba\u6587 Figure 1a\/1b&#xff09;<\/h4>\n<p><span class=\"token comment\"># \u4f2a\u4ee3\u7801&#xff1a;\u57fa\u4e8e ACT \u7684 IACE \u67b6\u6784\u3002\u5bf9\u5e94\u8bba\u6587 Fig.1<\/span><br \/>\n<span class=\"token keyword\">class<\/span> <span class=\"token class-name\">IACE_ACT<\/span><span class=\"token punctuation\">(<\/span>nn<span class=\"token punctuation\">.<\/span>Module<span class=\"token punctuation\">)<\/span><span class=\"token punctuation\">:<\/span><br \/>\n    <span class=\"token keyword\">def<\/span> <span class=\"token function\">__init__<\/span><span class=\"token punctuation\">(<\/span>self<span class=\"token punctuation\">,<\/span> single_decoder<span class=\"token operator\">&#061;<\/span><span class=\"token boolean\">True<\/span><span class=\"token punctuation\">)<\/span><span class=\"token punctuation\">:<\/span><br \/>\n        self<span class=\"token punctuation\">.<\/span>img_backbone <span class=\"token operator\">&#061;<\/span> ResNet18<span class=\"token punctuation\">(<\/span><span class=\"token punctuation\">)<\/span>          <span class=\"token comment\"># 4 \u8def\u76f8\u673a\u5171\u4eab\u4e3b\u5e72<\/span><br \/>\n        self<span class=\"token punctuation\">.<\/span>enc_left  <span class=\"token operator\">&#061;<\/span> TransformerEncoder<span class=\"token punctuation\">(<\/span><span class=\"token punctuation\">)<\/span>   <span class=\"token comment\"># \u5de6\u81c2\u5c40\u90e8\u7f16\u7801\u5668<\/span><br \/>\n        self<span class=\"token punctuation\">.<\/span>enc_right <span class=\"token operator\">&#061;<\/span> TransformerEncoder<span class=\"token punctuation\">(<\/span><span class=\"token punctuation\">)<\/span>   <span class=\"token comment\"># \u53f3\u81c2\u5c40\u90e8\u7f16\u7801\u5668<\/span><br \/>\n        self<span class=\"token punctuation\">.<\/span>enc_global<span class=\"token operator\">&#061;<\/span> TransformerEncoder<span class=\"token punctuation\">(<\/span><span class=\"token punctuation\">)<\/span>   <span class=\"token comment\"># \u5168\u5c40\u6bb5\u7f16\u7801\u5668<\/span><br \/>\n        self<span class=\"token punctuation\">.<\/span>iace      <span class=\"token operator\">&#061;<\/span> TransformerEncoder<span class=\"token punctuation\">(<\/span><span class=\"token punctuation\">)<\/span>   <span class=\"token comment\"># \u2605 \u81c2\u95f4\u534f\u8c03\u7f16\u7801\u5668 (\u6838\u5fc3)<\/span><br \/>\n        <span class=\"token keyword\">if<\/span> single_decoder<span class=\"token punctuation\">:<\/span><br \/>\n            self<span class=\"token punctuation\">.<\/span>decoder <span class=\"token operator\">&#061;<\/span> TransformerDecoder<span class=\"token punctuation\">(<\/span><span class=\"token punctuation\">)<\/span> <span class=\"token comment\"># \u5355\u89e3\u7801\u5668: \u62fc\u63a5\u8f93\u5165<\/span><br \/>\n        <span class=\"token keyword\">else<\/span><span class=\"token punctuation\">:<\/span><br \/>\n            self<span class=\"token punctuation\">.<\/span>dec_left  <span class=\"token operator\">&#061;<\/span> TransformerDecoder<span class=\"token punctuation\">(<\/span><span class=\"token punctuation\">)<\/span>   <span class=\"token comment\"># \u5206\u88c2\u89e3\u7801\u5668<\/span><br \/>\n            self<span class=\"token punctuation\">.<\/span>dec_right <span class=\"token operator\">&#061;<\/span> TransformerDecoder<span class=\"token punctuation\">(<\/span><span class=\"token punctuation\">)<\/span><br \/>\n        self<span class=\"token punctuation\">.<\/span>cvae_enc <span class=\"token operator\">&#061;<\/span> CVAEEncoder<span class=\"token punctuation\">(<\/span><span class=\"token punctuation\">)<\/span>           <span class=\"token comment\"># \u98ce\u683c\u9690\u53d8\u91cf z<\/span><br \/>\n        self<span class=\"token punctuation\">.<\/span>chunk_size <span class=\"token operator\">&#061;<\/span> k                     <span class=\"token comment\"># \u4e00\u6b21\u9884\u6d4b k \u6b65<\/span><\/p>\n<p>    <span class=\"token keyword\">def<\/span> <span class=\"token function\">build_sequence<\/span><span class=\"token punctuation\">(<\/span>self<span class=\"token punctuation\">,<\/span> joints_L<span class=\"token punctuation\">,<\/span> joints_R<span class=\"token punctuation\">,<\/span> cams<span class=\"token punctuation\">)<\/span><span class=\"token punctuation\">:<\/span><br \/>\n        <span class=\"token comment\"># \u6bcf\u4e2a segment: CLS token &#043; \u9010\u5e27 token &#043; \u4f4d\u7f6e\u7f16\u7801<\/span><br \/>\n        seg_L <span class=\"token operator\">&#061;<\/span> with_cls<span class=\"token punctuation\">(<\/span>self<span class=\"token punctuation\">.<\/span>enc_left<span class=\"token punctuation\">(<\/span>  tokens<span class=\"token punctuation\">(<\/span>joints_L<span class=\"token punctuation\">,<\/span> feats<span class=\"token punctuation\">(<\/span>cams<span class=\"token punctuation\">.<\/span>wrist_L<span class=\"token punctuation\">)<\/span><span class=\"token punctuation\">)<\/span><span class=\"token punctuation\">)<\/span><span class=\"token punctuation\">)<\/span><br \/>\n        seg_R <span class=\"token operator\">&#061;<\/span> with_cls<span class=\"token punctuation\">(<\/span>self<span class=\"token punctuation\">.<\/span>enc_right<span class=\"token punctuation\">(<\/span> tokens<span class=\"token punctuation\">(<\/span>joints_R<span class=\"token punctuation\">,<\/span> feats<span class=\"token punctuation\">(<\/span>cams<span class=\"token punctuation\">.<\/span>wrist_R<span class=\"token punctuation\">)<\/span><span class=\"token punctuation\">)<\/span><span class=\"token punctuation\">)<\/span><span class=\"token punctuation\">)<\/span><br \/>\n        seg_G <span class=\"token operator\">&#061;<\/span> with_cls<span class=\"token punctuation\">(<\/span>self<span class=\"token punctuation\">.<\/span>enc_global<span class=\"token punctuation\">(<\/span>tokens<span class=\"token punctuation\">(<\/span>cat<span class=\"token punctuation\">(<\/span>joints_L<span class=\"token punctuation\">,<\/span> joints_R<span class=\"token punctuation\">)<\/span><span class=\"token punctuation\">,<\/span><br \/>\n                                                  feats<span class=\"token punctuation\">(<\/span>cams<span class=\"token punctuation\">.<\/span>upper<span class=\"token punctuation\">,<\/span> cams<span class=\"token punctuation\">.<\/span>lower<span class=\"token punctuation\">)<\/span><span class=\"token punctuation\">)<\/span><span class=\"token punctuation\">)<\/span><span class=\"token punctuation\">)<\/span><br \/>\n        <span class=\"token keyword\">return<\/span> seg_L<span class=\"token punctuation\">,<\/span> seg_R<span class=\"token punctuation\">,<\/span> seg_G<\/p>\n<p>    <span class=\"token keyword\">def<\/span> <span class=\"token function\">forward<\/span><span class=\"token punctuation\">(<\/span>self<span class=\"token punctuation\">,<\/span> obs<span class=\"token punctuation\">,<\/span> z<span class=\"token operator\">&#061;<\/span><span class=\"token boolean\">None<\/span><span class=\"token punctuation\">)<\/span><span class=\"token punctuation\">:<\/span><br \/>\n        seg_L<span class=\"token punctuation\">,<\/span> seg_R<span class=\"token punctuation\">,<\/span> seg_G <span class=\"token operator\">&#061;<\/span> self<span class=\"token punctuation\">.<\/span>build_sequence<span class=\"token punctuation\">(<\/span><span class=\"token operator\">**<\/span>obs<span class=\"token punctuation\">)<\/span><br \/>\n        <span class=\"token comment\"># \u2605 IACE: \u53cc\u81c2&#043;\u5168\u5c40 token \u62fc\u63a5\u540e\u8fc7\u534f\u8c03\u7f16\u7801\u5668 \u2192 \u540c\u6b65\u4e0e\u65f6\u5e8f\u5bf9\u9f50<\/span><br \/>\n        H_coord <span class=\"token operator\">&#061;<\/span> self<span class=\"token punctuation\">.<\/span>iace<span class=\"token punctuation\">(<\/span>cat<span class=\"token punctuation\">(<\/span>seg_L<span class=\"token punctuation\">,<\/span> seg_R<span class=\"token punctuation\">,<\/span> seg_G<span class=\"token punctuation\">)<\/span><span class=\"token punctuation\">)<\/span><br \/>\n        <span class=\"token keyword\">if<\/span> self<span class=\"token punctuation\">.<\/span>single_decoder<span class=\"token punctuation\">:<\/span><br \/>\n            memory <span class=\"token operator\">&#061;<\/span> cat<span class=\"token punctuation\">(<\/span>seg_L<span class=\"token punctuation\">,<\/span> seg_R<span class=\"token punctuation\">,<\/span> H_coord<span class=\"token punctuation\">)<\/span>          <span class=\"token comment\"># \u5168\u90e8\u62fc\u7ed9\u5355\u89e3\u7801\u5668<\/span><br \/>\n            <span class=\"token keyword\">return<\/span> self<span class=\"token punctuation\">.<\/span>decoder<span class=\"token punctuation\">(<\/span>action_queries<span class=\"token punctuation\">,<\/span> memory<span class=\"token punctuation\">)<\/span>  <span class=\"token comment\"># (k, 2*ndof) \u8054\u5408\u5757<\/span><br \/>\n        <span class=\"token keyword\">else<\/span><span class=\"token punctuation\">:<\/span><br \/>\n            a_L <span class=\"token operator\">&#061;<\/span> self<span class=\"token punctuation\">.<\/span>dec_left <span class=\"token punctuation\">(<\/span>action_queries_L<span class=\"token punctuation\">,<\/span> cat<span class=\"token punctuation\">(<\/span>seg_L<span class=\"token punctuation\">,<\/span> H_coord<span class=\"token punctuation\">)<\/span><span class=\"token punctuation\">)<\/span><br \/>\n            a_R <span class=\"token operator\">&#061;<\/span> self<span class=\"token punctuation\">.<\/span>dec_right<span class=\"token punctuation\">(<\/span>action_queries_R<span class=\"token punctuation\">,<\/span> cat<span class=\"token punctuation\">(<\/span>seg_R<span class=\"token punctuation\">,<\/span> H_coord<span class=\"token punctuation\">)<\/span><span class=\"token punctuation\">)<\/span><br \/>\n            <span class=\"token keyword\">return<\/span> a_L<span class=\"token punctuation\">,<\/span> a_R                              <span class=\"token comment\"># \u5404\u81ea\u72ec\u7acb\u5757<\/span><\/p>\n<h4>6.2 \u8bad\u7ec3\u5faa\u73af&#xff08;\u5bf9\u5e94\u8bba\u6587 Section III-B&#xff09;<\/h4>\n<p><span class=\"token comment\"># \u4f2a\u4ee3\u7801&#xff1a;\u8bad\u7ec3\u3002\u5bf9\u5e94\u8bba\u6587 III-B \u5b9e\u73b0\u7ec6\u8282<\/span><br \/>\n<span class=\"token comment\"># \u6570\u636e: ALOHA \u9065\u64cd\u4f5c 50Hz \u91c7\u96c6 \u2192 \u964d\u91c7\u6837 25Hz (\u57513: \u9ad8\u9891\u6296\u52a8\u5bfc\u81f4\u8bad\u7ec3\u4e0d\u7a33)<\/span><br \/>\n<span class=\"token keyword\">for<\/span> epoch <span class=\"token keyword\">in<\/span> <span class=\"token builtin\">range<\/span><span class=\"token punctuation\">(<\/span><span class=\"token number\">5000<\/span><span class=\"token punctuation\">)<\/span><span class=\"token punctuation\">:<\/span><br \/>\n    joints_L<span class=\"token punctuation\">,<\/span> joints_R<span class=\"token punctuation\">,<\/span> images<span class=\"token punctuation\">,<\/span> targets <span class=\"token operator\">&#061;<\/span> sample_batch<span class=\"token punctuation\">(<\/span>batch<span class=\"token operator\">&#061;<\/span><span class=\"token number\">8<\/span><span class=\"token punctuation\">)<\/span>  <span class=\"token comment\"># 25Hz<\/span><br \/>\n    z <span class=\"token operator\">&#061;<\/span> self<span class=\"token punctuation\">.<\/span>cvae_enc<span class=\"token punctuation\">(<\/span>images<span class=\"token punctuation\">,<\/span> targets<span class=\"token punctuation\">)<\/span>      <span class=\"token comment\"># z \u7f16\u7801\u5668\u770b\u5f97\u89c1\u76ee\u6807 \u2192 \u5438\u6536\u98ce\u683c\u53d8\u5316<\/span><br \/>\n    z <span class=\"token operator\">&#061;<\/span> reparameterize<span class=\"token punctuation\">(<\/span>z<span class=\"token punctuation\">)<\/span>                   <span class=\"token comment\"># z ~ N(mu, sigma), KL \u7ea6\u675f<\/span><br \/>\n    pred <span class=\"token operator\">&#061;<\/span> model<span class=\"token punctuation\">(<\/span>obs<span class=\"token punctuation\">,<\/span> z<span class=\"token punctuation\">)<\/span><br \/>\n    loss <span class=\"token operator\">&#061;<\/span> l1_loss<span class=\"token punctuation\">(<\/span>pred<span class=\"token punctuation\">,<\/span> targets<span class=\"token punctuation\">)<\/span> <span class=\"token operator\">&#043;<\/span> <span class=\"token number\">1e-5<\/span> <span class=\"token operator\">*<\/span> kl_loss     <span class=\"token comment\"># ACT \u635f\u5931: L1 &#043; KL<\/span><br \/>\n    adamw_step<span class=\"token punctuation\">(<\/span>lr<span class=\"token operator\">&#061;<\/span><span class=\"token punctuation\">.<\/span><span class=\"token punctuation\">.<\/span><span class=\"token punctuation\">.<\/span><span class=\"token punctuation\">,<\/span> weight_decay<span class=\"token operator\">&#061;<\/span><span class=\"token number\">1e-5<\/span><span class=\"token punctuation\">)<\/span><\/p>\n<h4>6.3 \u63a8\u7406&#xff1a;\u5206\u5757 &#043; \u65f6\u5e8f\u96c6\u6210&#xff08;\u5bf9\u5e94\u8bba\u6587 Section III-B \u672b&#xff09;<\/h4>\n<p><span class=\"token comment\"># \u4f2a\u4ee3\u7801&#xff1a;\u63a8\u7406\u3002\u5bf9\u5e94\u8bba\u6587 &#034;temporal ensemble&#034; &#043; &#034;action chunking&#034;<\/span><br \/>\naction_queue <span class=\"token operator\">&#061;<\/span> TemporalEnsembleBuffer<span class=\"token punctuation\">(<\/span>exp_weight<span class=\"token operator\">&#061;<\/span>exp<span class=\"token punctuation\">(<\/span><span class=\"token operator\">&#8211;<\/span><span class=\"token keyword\">lambda<\/span><span class=\"token operator\">*<\/span>i<span class=\"token punctuation\">)<\/span><span class=\"token punctuation\">)<\/span><\/p>\n<p><span class=\"token decorator annotation punctuation\">&#064;torch<span class=\"token punctuation\">.<\/span>no_grad<\/span><span class=\"token punctuation\">(<\/span><span class=\"token punctuation\">)<\/span><br \/>\n<span class=\"token keyword\">def<\/span> <span class=\"token function\">control_loop<\/span><span class=\"token punctuation\">(<\/span>t<span class=\"token punctuation\">)<\/span><span class=\"token punctuation\">:<\/span>                        <span class=\"token comment\"># ~0.02s \u6bcf\u6b21\u63a8\u7406<\/span><br \/>\n    z <span class=\"token operator\">&#061;<\/span> prior_sample<span class=\"token punctuation\">(<\/span><span class=\"token punctuation\">)<\/span>                      <span class=\"token comment\"># \u91c7\u6837\u9636\u6bb5: z \u4ece N(0,I) \u62bd<\/span><br \/>\n    chunk <span class=\"token operator\">&#061;<\/span> model<span class=\"token punctuation\">(<\/span>obs<span class=\"token punctuation\">,<\/span> z<span class=\"token punctuation\">)<\/span>                   <span class=\"token comment\"># \u4e00\u6b21\u9884\u6d4b\u672a\u6765 k \u6b65<\/span><br \/>\n    action_queue<span class=\"token punctuation\">.<\/span>push<span class=\"token punctuation\">(<\/span>chunk<span class=\"token punctuation\">,<\/span> t<span class=\"token punctuation\">)<\/span>             <span class=\"token comment\"># \u4e0e\u5386\u53f2\u9884\u6d4b\u6309\u6307\u6570\u6743\u91cd\u878d\u5408<\/span><br \/>\n    <span class=\"token keyword\">return<\/span> action_queue<span class=\"token punctuation\">.<\/span>weighted_action<span class=\"token punctuation\">(<\/span>t<span class=\"token punctuation\">)<\/span>  <span class=\"token comment\"># \u5e73\u6ed1\u8f93\u51fa\u5f53\u524d\u6b65\u52a8\u4f5c<\/span><\/p>\n<h4>6.4 \u5173\u952e\u8d85\u53c2\u6570\u4e0e\u8bbe\u8ba1\u51b3\u7b56\u8868<\/h4>\n<table>\n<tr>\u9879\u76ee\u503c\/\u51b3\u7b56\u6765\u6e90\u4e0e\u7406\u7531<\/tr>\n<tbody>\n<tr>\n<td>\u8bad\u7ec3\u9891\u7387<\/td>\n<td>50 Hz \u91c7\u96c6 \u2192 25 Hz \u8bad\u7ec3<\/td>\n<td>\u9ad8\u9891\u5173\u8282\u6296\u52a8\u5bfc\u81f4\u8f93\u51fa\u4e0d\u7a33\u5b9a&#xff08;\u57513&#xff09;<\/td>\n<\/tr>\n<tr>\n<td>\u6f14\u793a\u91cf<\/td>\n<td>\u6bcf\u4efb\u52a1 50 \u6761<\/td>\n<td>ACT \u539f\u914d\u7f6e<\/td>\n<\/tr>\n<tr>\n<td>\u4f18\u5316<\/td>\n<td>AdamW, \u03bb&#061;1e-5, 5000 epochs, batch 8<\/td>\n<td>\u8bba\u6587 III-B<\/td>\n<\/tr>\n<tr>\n<td>\u98ce\u683c\u5efa\u6a21<\/td>\n<td>CVAE &#043; \u9690\u53d8\u91cf z<\/td>\n<td>\u7ee7\u627f ACT<\/td>\n<\/tr>\n<tr>\n<td>\u8f93\u51fa<\/td>\n<td>\u52a8\u4f5c\u5206\u5757&#xff08;k \u6b65\u5e8f\u5217&#xff09;&#043; \u65f6\u5e8f\u96c6\u6210<\/td>\n<td>\u7ee7\u627f ACT<\/td>\n<\/tr>\n<tr>\n<td>\u89c6\u89c9\u4e3b\u5e72<\/td>\n<td>ResNet18&#xff08;4 \u8def\u76f8\u673a&#xff09;<\/td>\n<td>\u7ee7\u627f ACT<\/td>\n<\/tr>\n<tr>\n<td>\u534f\u8c03\u673a\u5236<\/td>\n<td>IACE&#xff08;\u72ec\u7acb\u534f\u8c03\u7f16\u7801\u5668&#xff09;<\/td>\n<td>\u672c\u6587\u8d21\u732e<\/td>\n<\/tr>\n<tr>\n<td>\u89e3\u7801\u5668<\/td>\n<td>\u5f02\u6b65\u2192\u5206\u88c2 \/ \u540c\u6b65\u2192\u5355<\/td>\n<td>\u672c\u6587\u5b9e\u9a8c\u7ed3\u8bba<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<hr \/>\n<h3>\u4e03\u3001\u6548\u679c\u5bf9\u6bd4<\/h3>\n<h4>7.1 \u516b\u4e2a\u771f\u673a\u4efb\u52a1 \u00d7 25 episodes&#xff08;Table I&#xff09;<\/h4>\n<p>\u6ce8&#xff1a;\u5f02\u6b65\u4efb\u52a1\u7684\u539f\u59cb\u8868\u683c\u5728 PDF \u63d0\u53d6\u4e2d\u5217\u5e8f\u6709\u9519\u4f4d&#xff0c;\u4e0b\u8868\u7684\u884c\u5747\u503c\u7ecf\u9010\u884c\u6c42\u548c\u6838\u7b97&#xff08;\u4e0e\u8bba\u6587&#034;\u5e73\u5747\u6bd4 ACT \u9ad8 8-9%&#034;\u7684\u58f0\u660e\u4ea4\u53c9\u9a8c\u8bc1\u4e00\u81f4&#xff09;&#xff0c;\u4e2a\u522b\u5355\u5143\u683c\u5f52\u5c5e\u4ee5\u6b63\u6587\u660e\u786e\u53d9\u8ff0\u7684\u6570\u5b57\u4e3a\u51c6\u3002<\/p>\n<p>\u5f02\u6b65\u4efb\u52a1&#xff08;4 \u9879&#xff0c;9 \u4e2a\u5b50\u6307\u6807&#xff09;\u5e73\u5747\u6210\u529f\u7387&#xff1a;<\/p>\n<table>\n<tr>\u65b9\u6cd5\u5e73\u5747\u6210\u529f\u7387<\/tr>\n<tbody>\n<tr>\n<td>ACT<\/td>\n<td>82.2%<\/td>\n<\/tr>\n<tr>\n<td>Ours&#xff08;\u5355\u89e3\u7801\u5668&#xff09;<\/td>\n<td>85.8%<\/td>\n<\/tr>\n<tr>\n<td>Ours&#xff08;\u5206\u88c2\u89e3\u7801\u5668&#xff09;<\/td>\n<td>89.3%<\/td>\n<\/tr>\n<tr>\n<td>Ours&#xff08;\u5355\u89e3\u7801\u5668&#xff09;w\/o IACE<\/td>\n<td>60.4%<\/td>\n<\/tr>\n<tr>\n<td>Ours&#xff08;\u5206\u88c2\u89e3\u7801\u5668&#xff09;w\/o IACE<\/td>\n<td>74.7%<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>\u540c\u6b65\u4efb\u52a1&#xff08;4 \u9879&#xff0c;5 \u4e2a\u5b50\u6307\u6807&#xff09;\u5e73\u5747\u6210\u529f\u7387&#xff1a;<\/p>\n<table>\n<tr>\u65b9\u6cd5\u5e73\u5747\u6210\u529f\u7387<\/tr>\n<tbody>\n<tr>\n<td>ACT<\/td>\n<td>80.8%<\/td>\n<\/tr>\n<tr>\n<td>Ours&#xff08;\u5355\u89e3\u7801\u5668&#xff09;<\/td>\n<td>98.4%<\/td>\n<\/tr>\n<tr>\n<td>Ours&#xff08;\u5206\u88c2\u89e3\u7801\u5668&#xff09;<\/td>\n<td>90.4%<\/td>\n<\/tr>\n<tr>\n<td>Ours&#xff08;\u5355\u89e3\u7801\u5668&#xff09;w\/o IACE<\/td>\n<td>56.8%<\/td>\n<\/tr>\n<tr>\n<td>Ours&#xff08;\u5206\u88c2\u89e3\u7801\u5668&#xff09;w\/o IACE<\/td>\n<td>57.6%<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>\u5168\u90e8 14 \u4e2a\u5b50\u6307\u6807\u603b\u5e73\u5747&#xff1a; ACT 81.7% \u2192 Ours \u5355\u89e3\u7801\u5668 90.3% \/ \u5206\u88c2\u89e3\u7801\u5668 89.7%\u2014\u2014\u7ea6 &#043;8.6 \u4e2a\u767e\u5206\u70b9&#xff0c;\u4e0e\u8bba\u6587\u6458\u8981&#034;8-9% higher success rate than ACT&#034;\u5b8c\u5168\u543b\u5408\u3002<\/p>\n<p>\u6b63\u6587\u70b9\u540d\u7684\u9ad8\u4eae\u5bf9\u6bd4&#xff1a;<\/p>\n<ul>\n<li>\u6298\u6bdb\u5dfe&#xff1a;\u5206\u88c2\u89e3\u7801\u5668\u6361\u653e\u5168 96%&#xff0c;ACT \u6361 92% \/ \u653e 88%&#xff1b;<\/li>\n<li>\u9012\u94f6\u5305&#xff1a;ACT \u548c\u5206\u88c2\u89e3\u7801\u5668\u53cc\u53cc 100%&#xff08;\u6293\u53d6 &#043; \u4ea4\u63a5&#xff09;&#xff1b;<\/li>\n<li>\u62ac\u653e\u6bdb\u5dfe&#xff08;\u540c\u6b65&#xff09;&#xff1a;ACT \u7684&#034;\u653e&#034;\u5b50\u6307\u6807\u4ec5 4%&#xff0c;Ours \u5355\u89e3\u7801\u5668 96%\u2014\u2014\u540c\u6b65\u534f\u8c03\u5dee\u8ddd\u6700\u523a\u773c\u7684\u4e00\u4e2a\u6570\u5b57\u3002<\/li>\n<\/ul>\n<h4>7.2 IACE \u6d88\u878d&#xff1a;\u5750\u6807\u6700\u91cd\u8981\u7684\u53d1\u73b0<\/h4>\n<table>\n<tr>\u67b6\u6784\u5f02\u6b65\u5747\u503c\u540c\u6b65\u5747\u503c\u603b\u5747\u503c<\/tr>\n<tbody>\n<tr>\n<td>Ours&#xff08;\u5206\u88c2&#xff09;&#043; IACE<\/td>\n<td>89.3%<\/td>\n<td>90.4%<\/td>\n<td>89.7%<\/td>\n<\/tr>\n<tr>\n<td>Ours&#xff08;\u5206\u88c2&#xff09;w\/o IACE<\/td>\n<td>74.7%&#xff08;\u219314.6&#xff09;<\/td>\n<td>57.6%&#xff08;\u219332.8&#xff09;<\/td>\n<td>74.7%<\/td>\n<\/tr>\n<tr>\n<td>Ours&#xff08;\u5355&#xff09;&#043; IACE<\/td>\n<td>85.8%<\/td>\n<td>98.4%<\/td>\n<td>90.3%<\/td>\n<\/tr>\n<tr>\n<td>Ours&#xff08;\u5355&#xff09;w\/o IACE<\/td>\n<td>60.4%&#xff08;\u219325.4&#xff09;<\/td>\n<td>56.8%&#xff08;\u219341.6&#xff09;<\/td>\n<td>60.4%<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>\u4e24\u4e2a\u8bfb\u6cd5&#xff1a;<\/p>\n<li>\u540c\u6b65\u4efb\u52a1\u5bf9 IACE \u7684\u4f9d\u8d56\u662f\u6bc1\u706d\u6027\u7684\u2014\u2014\u53bb\u6389\u540e\u65e0\u8bba\u54ea\u79cd\u89e3\u7801\u5668\u90fd\u6389\u5230 57% \u9644\u8fd1&#xff0c;\u56e0\u4e3a&#034;\u540c\u65f6\u62ac\/\u540c\u65f6\u5f00&#034;\u8fd9\u7c7b\u4efb\u52a1\u6ca1\u6709\u534f\u8c03\u901a\u8def\u5c31\u7269\u7406\u4e0a\u4e0d\u53ef\u80fd\u5b8c\u6210&#xff08;\u62ac\u6bdb\u5dfe\u4e00\u53ea\u624b\u665a 0.5 \u79d2&#xff0c;\u6bdb\u5dfe\u5c31\u6389&#xff09;&#xff1b;<\/li>\n<li>\u5355\u89e3\u7801\u5668\u6bd4\u5206\u88c2\u89e3\u7801\u5668\u66f4\u4f9d\u8d56 IACE&#xff08;-41.6 vs -32.8&#xff09;\u2014\u2014\u5355\u89e3\u7801\u5668\u628a\u534f\u8c03\u5b8c\u5168\u4ea4\u7ed9 IACE \u5355\u70b9\u8d1f\u8d23&#xff0c;\u5206\u88c2\u89e3\u7801\u5668\u81f3\u5c11\u8fd8\u6709\u5404\u81c2\u72ec\u7acb\u89e3\u7801\u7684\u515c\u5e95\u3002\u53cd\u8fc7\u6765\u8bf4&#xff0c;IACE &#043; \u5355\u89e3\u7801\u5668\u662f\u540c\u6b65\u4efb\u52a1\u7684\u6700\u4f18\u7ec4\u5408&#xff08;98.4%&#xff09;\u3002<\/li>\n<h4>7.3 \u4e00\u53e5\u8bdd\u603b\u7ed3\u5bf9\u6bd4\u8868<\/h4>\n<p>                \u5f02\u6b65\u4efb\u52a1          \u540c\u6b65\u4efb\u52a1          \u603b\u5747\u503c<br \/>\n  ACT \u57fa\u7ebf         82.2%            80.8%           81.7%<br \/>\n  Ours(\u5355)        85.8%            98.4% \u2605         90.3%<br \/>\n  Ours(\u5206\u88c2)      89.3% \u2605          90.4%           89.7%<br \/>\n  \u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500<br \/>\n  \u53bb\u6389 IACE:      60~75% (\u5f02\u6b65)     57% (\u540c\u6b65)       \u2190 \u67b6\u6784\u6838\u5fc3\u662f IACE, \u4e0d\u662f\u89e3\u7801\u5668\u6446\u6cd5<\/p>\n<hr \/>\n<h3>\u516b\u3001\u603b\u7ed3<\/h3>\n<h4>8.1 \u6838\u5fc3\u601d\u60f3\u4e00\u53e5\u8bdd<\/h4>\n<p>\u53cc\u81c2\u7b56\u7565\u7684\u67b6\u6784\u4e0d\u8be5\u662f&#034;\u7ef4\u5ea6\u62fc\u63a5&#034;\u7684\u9ed1\u7bb1&#xff0c;\u800c\u5e94\u8be5\u662f&#034;\u6bcf\u81c2\u4e00\u6761\u6df1\u5b66\u901a\u8def &#043; \u4e00\u6761\u663e\u5f0f\u534f\u8c03\u901a\u8def&#xff08;IACE&#xff09;&#034;\u7684\u5206\u5c42\u8bbe\u8ba1\u2014\u2014\u4e14\u89e3\u7801\u5668\u6309\u4efb\u52a1\u8026\u5408\u5ea6\u9009\u578b&#xff1a;\u5f02\u6b65\u7528\u5206\u88c2&#xff0c;\u540c\u6b65\u7528\u5355\u3002<\/p>\n<h4>8.2 \u8fb9\u754c<\/h4>\n<p>\u8bba\u6587\u77ed\u5c0f&#xff0c;\u8fb9\u754c\u4e5f\u660e\u6446\u7740&#xff1a;<\/p>\n<ul>\n<li>\u57fa\u7ebf\u53ea\u6709 ACT \u4e00\u4e2a&#xff0c;\u6ca1\u6709\u9a8c\u8bc1 IACE \u601d\u60f3\u80fd\u5426\u8fc1\u79fb\u5230 Diffusion Policy\u3001SARNN \u7b49\u5176\u4ed6\u7b97\u6cd5&#xff08;\u4f5c\u8005\u81ea\u5df1\u5728\u7ed3\u8bba\u91cc\u627f\u8ba4\u8fd9\u662f\u5f85\u529e&#xff09;&#xff1b;<\/li>\n<li>\u4efb\u52a1\u5168\u90e8\u662f\u684c\u9762\u53cc\u81c2&#xff0c;\u6ca1\u6709\u79fb\u52a8\u3001\u6ca1\u6709\u5168\u8eab\u534f\u8c03&#xff08;\u5bf9\u6bd4 BRS \u7684 21-DoF \u5168\u8eab\u4efb\u52a1&#xff09;&#xff0c;\u534f\u8c03\u95ee\u9898\u88ab\u7b80\u5316\u5728&#034;\u4e24\u53ea\u624b&#034;\u7684\u5c3a\u5ea6&#xff1b;<\/li>\n<li>\u6bcf task 50 \u6761\u6f14\u793a\u3001\u56fa\u5b9a 8 \u4e2a\u4efb\u52a1\u2014\u2014\u67b6\u6784\u7ed3\u8bba\u7684\u5916\u63a8\u8303\u56f4&#xff08;\u66f4\u591a\u4efb\u52a1\u3001\u66f4\u591a\u6570\u636e\u91cf\u3001\u5176\u4ed6\u673a\u5668\u4eba\u5e73\u53f0&#xff09;\u672a\u7ecf\u68c0\u9a8c&#xff1b;<\/li>\n<li>\u63d0\u5347\u5e45\u5ea6\u5728\u90e8\u5206\u7b80\u5355\u4efb\u52a1\u4e0a\u4e0d\u663e\u8457&#xff08;\u4f5c\u8005\u81ea\u5df1\u627f\u8ba4&#xff09;&#xff0c;IACE \u7684\u4ef7\u503c\u96c6\u4e2d\u5728\u534f\u8c03\u654f\u611f\u578b\u4efb\u52a1\u3002<\/li>\n<\/ul>\n<h4>8.3 \u4e0e\u7cfb\u5217\u524d\u4e09\u7bc7\u7684\u8fde\u7ebf<\/h4>\n<p>\u56db\u7bc7\u8fde\u8bfb&#xff0c;&#034;\u534f\u8c03&#034;\u8fd9\u4e2a\u4e3b\u9898\u51fa\u73b0\u4e86\u4e09\u79cd\u622a\u7136\u4e0d\u540c\u7684\u5efa\u6a21\u8303\u5f0f&#xff0c;\u975e\u5e38\u503c\u5f97\u5bf9\u7167&#xff1a;<\/p>\n<table>\n<tr>\u7ef4\u5ea6iDP3BRS (WB-VIMA)LINGO\u672c\u6587 (IACE)<\/tr>\n<tbody>\n<tr>\n<td>\u534f\u8c03\u5bf9\u8c61<\/td>\n<td>\u5168\u8eab 25-DoF<\/td>\n<td>\u5e95\u76d8-\u8eaf\u5e72-\u53cc\u81c2<\/td>\n<td>\u591a\u9636\u6bb5\u52a8\u4f5c<\/td>\n<td>\u5de6\u53f3\u81c2<\/td>\n<\/tr>\n<tr>\n<td>\u534f\u8c03\u673a\u5236<\/td>\n<td>\u9690\u5f0f&#xff08;\u7aef\u5230\u7aef\u6269\u6563&#xff09;<\/td>\n<td>\u81ea\u56de\u5f52\u6761\u4ef6\u94fe&#xff08;\u4e0a\u6e38\u2192\u4e0b\u6e38&#xff09;<\/td>\n<td>\u8c03\u5ea6\u5668\u5207\u6362\u9636\u6bb5<\/td>\n<td>\u5bf9\u79f0\u63d2\u5165\u7f16\u7801\u5668<\/td>\n<\/tr>\n<tr>\n<td>\u534f\u8c03\u7ed3\u6784<\/td>\n<td>\u65e0\u663e\u5f0f\u7ed3\u6784<\/td>\n<td>\u6709\u5411\u5c42\u7ea7&#xff08;\u8fd0\u52a8\u5b66\u5e8f&#xff09;<\/td>\n<td>\u65f6\u95f4\u5e8f<\/td>\n<td>\u5bf9\u79f0\u53cc\u5411&#xff08;\u5de6\u53f3\u5bf9\u7b49&#xff09;<\/td>\n<\/tr>\n<tr>\n<td>\u4efb\u52a1\u6027\u8d28<\/td>\n<td>\u64cd\u4f5c<\/td>\n<td>\u5168\u8eab\u64cd\u4f5c<\/td>\n<td>\u884c\u8d70&#043;\u4ea4\u4e92<\/td>\n<td>\u53cc\u81c2\u64cd\u4f5c<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>IACE \u7684\u534f\u8c03\u662f\u5bf9\u79f0\u7684&#xff08;\u5de6\u53f3\u81c2\u5e73\u7b49\u4e92\u67e5&#xff09;&#xff0c;BRS \u7684\u534f\u8c03\u662f\u6709\u5411\u7684&#xff08;\u5e95\u76d8\u2192\u8eaf\u5e72\u2192\u81c2&#xff0c;\u6309\u8fd0\u52a8\u5b66\u56e0\u679c\u5e8f&#xff09;&#xff0c;\u8fd9\u4e2a\u5dee\u5f02\u672c\u8eab\u5c31\u662f\u8bbe\u8ba1\u6d1e\u5bdf&#xff1a;\u5f53\u534f\u8c03\u53cc\u65b9\u6ca1\u6709\u5929\u7136\u7684\u56e0\u679c\u5c42\u7ea7\u65f6&#xff08;\u53cc\u81c2\u5bf9\u7b49&#xff09;&#xff0c;\u5bf9\u79f0\u63d2\u5165\u5f0f\u534f\u8c03\u66f4\u5408\u9002&#xff1b;\u5f53\u5b58\u5728\u660e\u786e\u7684\u56e0\u679c\u94fe\u65f6&#xff08;\u5e95\u76d8\u8bef\u5dee\u653e\u5927\u672b\u7aef\u8bef\u5dee&#xff09;&#xff0c;\u81ea\u56de\u5f52\u6761\u4ef6\u94fe\u66f4\u5408\u9002\u3002<\/p>\n<h4>8.4 \u5ef6\u4f38<\/h4>\n<p>\u7528\u7f16\u7801\u7684\u7c7b\u6bd4\u6536\u5c3e&#xff1a;\u8fd9\u7bc7\u8bba\u6587\u672c\u8d28\u4e0a\u662f\u7ed9&#034;\u591a\u901a\u9053\u4fe1\u53f7\u8054\u5408\u5efa\u6a21&#034;\u505a\u4e86\u4e00\u6b21\u7f16\u7801\u7ed3\u6784\u6d88\u878d\u2014\u2014\u5206\u88c2\u89e3\u7801\u5668 &#061; \u5404\u901a\u9053\u72ec\u7acb\u7f16\u7801 &#043; \u516c\u5171\u53c2\u8003\u6d41&#xff08;IACE&#xff09;&#xff0c;\u5355\u89e3\u7801\u5668 &#061; \u8054\u5408\u7f16\u7801&#xff0c;\u800c&#034;\u5f02\u6b65 vs \u540c\u6b65\u4efb\u52a1&#034;\u5c31\u662f\u901a\u9053\u95f4\u76f8\u5173\u6027\u7684\u9ad8\u4e0e\u4f4e\u3002\u4fe1\u53f7\u5904\u7406\u91cc\u65e9\u6709\u7ed3\u8bba&#xff1a;\u901a\u9053\u76f8\u5173\u6027\u4f4e\u65f6\u72ec\u7acb\u7f16\u7801\u66f4\u4f18&#xff08;\u53bb\u9664\u5197\u4f59\u5f00\u9500&#xff09;&#xff0c;\u76f8\u5173\u6027\u9ad8\u65f6\u8054\u5408\u7f16\u7801\u66f4\u4f18&#xff08;\u5229\u7528\u76f8\u5173\u6027&#xff09;\u2014\u2014\u673a\u5668\u4eba\u67b6\u6784\u8bbe\u8ba1\u6b63\u5728\u91cd\u65b0\u53d1\u73b0\u8fd9\u4e9b\u7ecf\u5178\u6743\u8861&#xff0c;\u800c IACE \u7684\u89d2\u8272\u6070\u597d\u662f\u90a3\u6761&#034;\u516c\u5171\u53c2\u8003\u6d41&#034;&#xff1a;\u4e0d\u7ba1\u4f60\u600e\u4e48\u7f16\u7801\u5404\u901a\u9053&#xff0c;\u65f6\u5e8f\u5bf9\u9f50\u7684\u4fe1\u606f\u603b\u5f97\u6709\u4e00\u6761\u4e13\u95e8\u7684\u901a\u8def\u6765\u4f20\u3002<\/p>\n<hr \/>\n<p>\u535a\u5ba2\u57fa\u4e8e arXiv:2503.13916v1 (2025-03-18) \u64b0\u5199\u3002\u6ce8&#xff1a;\u8bba\u6587 Table I \u7684\u5f02\u6b65\u4efb\u52a1\u90e8\u5206\u5728 PDF \u6587\u672c\u63d0\u53d6\u4e2d\u5217\u5e8f\u5b58\u5728\u9519\u4f4d&#xff0c;\u535a\u5ba2\u4e2d\u5404\u884c\u5747\u503c\u7ecf\u9010\u884c\u6c42\u548c\u6838\u7b97\u5e76\u4e0e\u8bba\u6587\u6458\u8981\u58f0\u660e&#xff08;&#043;8-9%&#xff09;\u4ea4\u53c9\u9a8c\u8bc1&#xff1b;\u6b63\u6587\u660e\u786e\u53d9\u8ff0\u7684\u5177\u4f53\u6570\u5b57&#xff08;\u6298\u6bdb\u5dfe 96% vs 92\/88%\u3001\u94f6\u5305 100%\u3001\u62ac\u653e\u6bdb\u5dfe ACT \u653e\u7f6e 4%&#xff09;\u5747\u76f4\u63a5\u5f15\u81ea\u539f\u6587\u3002<\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u8bba\u6587\u6807\u9898: Learning Bimanual Manipulation via Action Chunking and Inter-Arm Coordination with Transformers<br \/>\n\u4f5c\u8005: Tomohiro Motoda, Ryo Hanai, Ryoichi Nakajo, Masaki Murooka, Floris Erich, Yukiyasu Domae<br \/>\n\u673a\u6784: \u4ea7\u4e1a\u6280\u672f\u7efc\u5408\u7814\u7a76\u6240 (AIST), \u65e5\u672c<br \/>\n\u53d1\u8868: arXiv:2503.13916<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[12236,12233,12235,12234,841],"topic":[],"class_list":["post-107605","post","type-post","status-publish","format-standard","hentry","category-server","tag-12236","tag-12233","tag-12235","tag-12234","tag-transformer"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v20.3 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>IACE \u6df1\u5ea6\u89e3\u6790\uff1a\u53cc\u81c2\u673a\u5668\u4eba\u8be5\u600e\u4e48\u201c\u5206\u5de5\u201c\uff1fAIST \u7528 14 \u7ec4\u771f\u673a\u5b9e\u9a8c\u7ed9\u51fa\u67b6\u6784\u9009\u578b\u6307\u5357 - \u7f51\u7855\u4e92\u8054\u5e2e\u52a9\u4e2d\u5fc3<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.wsisp.com\/helps\/107605.html\" \/>\n<meta property=\"og:locale\" content=\"zh_CN\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"IACE \u6df1\u5ea6\u89e3\u6790\uff1a\u53cc\u81c2\u673a\u5668\u4eba\u8be5\u600e\u4e48\u201c\u5206\u5de5\u201c\uff1fAIST \u7528 14 \u7ec4\u771f\u673a\u5b9e\u9a8c\u7ed9\u51fa\u67b6\u6784\u9009\u578b\u6307\u5357 - \u7f51\u7855\u4e92\u8054\u5e2e\u52a9\u4e2d\u5fc3\" \/>\n<meta property=\"og:description\" content=\"\u8bba\u6587\u6807\u9898: Learning Bimanual Manipulation via Action Chunking and Inter-Arm Coordination with Transformers \u4f5c\u8005: Tomohiro Motoda, Ryo Hanai, Ryoichi Nakajo, Masaki Murooka, Floris Erich, Yukiyasu Domae \u673a\u6784: \u4ea7\u4e1a\u6280\u672f\u7efc\u5408\u7814\u7a76\u6240 (AIST), \u65e5\u672c \u53d1\u8868: arXiv:2503.13916\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.wsisp.com\/helps\/107605.html\" \/>\n<meta property=\"og:site_name\" content=\"\u7f51\u7855\u4e92\u8054\u5e2e\u52a9\u4e2d\u5fc3\" \/>\n<meta property=\"article:published_time\" content=\"2026-09-19T13:40:34+00:00\" \/>\n<meta name=\"author\" content=\"admin\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"\u4f5c\u8005\" \/>\n\t<meta name=\"twitter:data1\" content=\"admin\" \/>\n\t<meta name=\"twitter:label2\" content=\"\u9884\u8ba1\u9605\u8bfb\u65f6\u95f4\" \/>\n\t<meta name=\"twitter:data2\" content=\"8 \u5206\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.wsisp.com\/helps\/107605.html\",\"url\":\"https:\/\/www.wsisp.com\/helps\/107605.html\",\"name\":\"IACE \u6df1\u5ea6\u89e3\u6790\uff1a\u53cc\u81c2\u673a\u5668\u4eba\u8be5\u600e\u4e48\u201c\u5206\u5de5\u201c\uff1fAIST \u7528 14 \u7ec4\u771f\u673a\u5b9e\u9a8c\u7ed9\u51fa\u67b6\u6784\u9009\u578b\u6307\u5357 - \u7f51\u7855\u4e92\u8054\u5e2e\u52a9\u4e2d\u5fc3\",\"isPartOf\":{\"@id\":\"https:\/\/www.wsisp.com\/helps\/#website\"},\"datePublished\":\"2026-09-19T13:40:34+00:00\",\"dateModified\":\"2026-09-19T13:40:34+00:00\",\"author\":{\"@id\":\"https:\/\/www.wsisp.com\/helps\/#\/schema\/person\/358e386c577a3ab51c4493330a20ad41\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.wsisp.com\/helps\/107605.html#breadcrumb\"},\"inLanguage\":\"zh-Hans\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.wsisp.com\/helps\/107605.html\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.wsisp.com\/helps\/107605.html#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"\u9996\u9875\",\"item\":\"https:\/\/www.wsisp.com\/helps\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"IACE \u6df1\u5ea6\u89e3\u6790\uff1a\u53cc\u81c2\u673a\u5668\u4eba\u8be5\u600e\u4e48\u201c\u5206\u5de5\u201c\uff1fAIST \u7528 14 \u7ec4\u771f\u673a\u5b9e\u9a8c\u7ed9\u51fa\u67b6\u6784\u9009\u578b\u6307\u5357\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.wsisp.com\/helps\/#website\",\"url\":\"https:\/\/www.wsisp.com\/helps\/\",\"name\":\"\u7f51\u7855\u4e92\u8054\u5e2e\u52a9\u4e2d\u5fc3\",\"description\":\"\u9999\u6e2f\u670d\u52a1\u5668_\u9999\u6e2f\u4e91\u670d\u52a1\u5668\u8d44\u8baf_\u670d\u52a1\u5668\u5e2e\u52a9\u6587\u6863_\u670d\u52a1\u5668\u6559\u7a0b\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.wsisp.com\/helps\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"zh-Hans\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.wsisp.com\/helps\/#\/schema\/person\/358e386c577a3ab51c4493330a20ad41\",\"name\":\"admin\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"zh-Hans\",\"@id\":\"https:\/\/www.wsisp.com\/helps\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/gravatar.wp-china-yes.net\/avatar\/?s=96&d=mystery\",\"contentUrl\":\"https:\/\/gravatar.wp-china-yes.net\/avatar\/?s=96&d=mystery\",\"caption\":\"admin\"},\"sameAs\":[\"http:\/\/wp.wsisp.com\"],\"url\":\"https:\/\/www.wsisp.com\/helps\/author\/admin\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"IACE \u6df1\u5ea6\u89e3\u6790\uff1a\u53cc\u81c2\u673a\u5668\u4eba\u8be5\u600e\u4e48\u201c\u5206\u5de5\u201c\uff1fAIST \u7528 14 \u7ec4\u771f\u673a\u5b9e\u9a8c\u7ed9\u51fa\u67b6\u6784\u9009\u578b\u6307\u5357 - \u7f51\u7855\u4e92\u8054\u5e2e\u52a9\u4e2d\u5fc3","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.wsisp.com\/helps\/107605.html","og_locale":"zh_CN","og_type":"article","og_title":"IACE \u6df1\u5ea6\u89e3\u6790\uff1a\u53cc\u81c2\u673a\u5668\u4eba\u8be5\u600e\u4e48\u201c\u5206\u5de5\u201c\uff1fAIST \u7528 14 \u7ec4\u771f\u673a\u5b9e\u9a8c\u7ed9\u51fa\u67b6\u6784\u9009\u578b\u6307\u5357 - \u7f51\u7855\u4e92\u8054\u5e2e\u52a9\u4e2d\u5fc3","og_description":"\u8bba\u6587\u6807\u9898: Learning Bimanual Manipulation via Action Chunking and Inter-Arm Coordination with Transformers \u4f5c\u8005: Tomohiro Motoda, Ryo Hanai, Ryoichi Nakajo, Masaki Murooka, Floris Erich, Yukiyasu Domae \u673a\u6784: \u4ea7\u4e1a\u6280\u672f\u7efc\u5408\u7814\u7a76\u6240 (AIST), \u65e5\u672c \u53d1\u8868: arXiv:2503.13916","og_url":"https:\/\/www.wsisp.com\/helps\/107605.html","og_site_name":"\u7f51\u7855\u4e92\u8054\u5e2e\u52a9\u4e2d\u5fc3","article_published_time":"2026-09-19T13:40:34+00:00","author":"admin","twitter_card":"summary_large_image","twitter_misc":{"\u4f5c\u8005":"admin","\u9884\u8ba1\u9605\u8bfb\u65f6\u95f4":"8 \u5206"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.wsisp.com\/helps\/107605.html","url":"https:\/\/www.wsisp.com\/helps\/107605.html","name":"IACE \u6df1\u5ea6\u89e3\u6790\uff1a\u53cc\u81c2\u673a\u5668\u4eba\u8be5\u600e\u4e48\u201c\u5206\u5de5\u201c\uff1fAIST \u7528 14 \u7ec4\u771f\u673a\u5b9e\u9a8c\u7ed9\u51fa\u67b6\u6784\u9009\u578b\u6307\u5357 - \u7f51\u7855\u4e92\u8054\u5e2e\u52a9\u4e2d\u5fc3","isPartOf":{"@id":"https:\/\/www.wsisp.com\/helps\/#website"},"datePublished":"2026-09-19T13:40:34+00:00","dateModified":"2026-09-19T13:40:34+00:00","author":{"@id":"https:\/\/www.wsisp.com\/helps\/#\/schema\/person\/358e386c577a3ab51c4493330a20ad41"},"breadcrumb":{"@id":"https:\/\/www.wsisp.com\/helps\/107605.html#breadcrumb"},"inLanguage":"zh-Hans","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.wsisp.com\/helps\/107605.html"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.wsisp.com\/helps\/107605.html#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"\u9996\u9875","item":"https:\/\/www.wsisp.com\/helps"},{"@type":"ListItem","position":2,"name":"IACE \u6df1\u5ea6\u89e3\u6790\uff1a\u53cc\u81c2\u673a\u5668\u4eba\u8be5\u600e\u4e48\u201c\u5206\u5de5\u201c\uff1fAIST \u7528 14 \u7ec4\u771f\u673a\u5b9e\u9a8c\u7ed9\u51fa\u67b6\u6784\u9009\u578b\u6307\u5357"}]},{"@type":"WebSite","@id":"https:\/\/www.wsisp.com\/helps\/#website","url":"https:\/\/www.wsisp.com\/helps\/","name":"\u7f51\u7855\u4e92\u8054\u5e2e\u52a9\u4e2d\u5fc3","description":"\u9999\u6e2f\u670d\u52a1\u5668_\u9999\u6e2f\u4e91\u670d\u52a1\u5668\u8d44\u8baf_\u670d\u52a1\u5668\u5e2e\u52a9\u6587\u6863_\u670d\u52a1\u5668\u6559\u7a0b","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.wsisp.com\/helps\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"zh-Hans"},{"@type":"Person","@id":"https:\/\/www.wsisp.com\/helps\/#\/schema\/person\/358e386c577a3ab51c4493330a20ad41","name":"admin","image":{"@type":"ImageObject","inLanguage":"zh-Hans","@id":"https:\/\/www.wsisp.com\/helps\/#\/schema\/person\/image\/","url":"https:\/\/gravatar.wp-china-yes.net\/avatar\/?s=96&d=mystery","contentUrl":"https:\/\/gravatar.wp-china-yes.net\/avatar\/?s=96&d=mystery","caption":"admin"},"sameAs":["http:\/\/wp.wsisp.com"],"url":"https:\/\/www.wsisp.com\/helps\/author\/admin"}]}},"_links":{"self":[{"href":"https:\/\/www.wsisp.com\/helps\/wp-json\/wp\/v2\/posts\/107605","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.wsisp.com\/helps\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.wsisp.com\/helps\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.wsisp.com\/helps\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.wsisp.com\/helps\/wp-json\/wp\/v2\/comments?post=107605"}],"version-history":[{"count":0,"href":"https:\/\/www.wsisp.com\/helps\/wp-json\/wp\/v2\/posts\/107605\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.wsisp.com\/helps\/wp-json\/wp\/v2\/media?parent=107605"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.wsisp.com\/helps\/wp-json\/wp\/v2\/categories?post=107605"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.wsisp.com\/helps\/wp-json\/wp\/v2\/tags?post=107605"},{"taxonomy":"topic","embeddable":true,"href":"https:\/\/www.wsisp.com\/helps\/wp-json\/wp\/v2\/topic?post=107605"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}