{"id":95993,"date":"2026-08-27T09:00:28","date_gmt":"2026-08-27T01:00:28","guid":{"rendered":"https:\/\/www.wsisp.com\/helps\/95993.html"},"modified":"2026-08-27T09:00:28","modified_gmt":"2026-08-27T01:00:28","slug":"%e3%80%90%e5%a4%9a%e8%bd%ae%e5%af%b9%e8%af%9d%e8%ae%ba%e6%96%87%e5%af%bc%e8%af%bb%ef%bc%88%e5%85%ab%ef%bc%89%e3%80%91%e5%a4%9a%e8%bd%ae%e5%af%b9%e8%af%9d%e6%ad%a3%e5%9c%a8%e4%bb%8e%e4%b8%8a","status":"publish","type":"post","link":"https:\/\/www.wsisp.com\/helps\/95993.html","title":{"rendered":"\u3010\u591a\u8f6e\u5bf9\u8bdd\u8bba\u6587\u5bfc\u8bfb\uff08\u516b\uff09\u3011\u591a\u8f6e\u5bf9\u8bdd\u6b63\u5728\u4ece\u201c\u4e0a\u4e0b\u6587\u8bb0\u5fc6\u201d\u8d70\u5411\u201c\u6301\u7eed\u4ea4\u4e92\u667a\u80fd\u201d"},"content":{"rendered":"<h2><\/h2>\n<p>\u8bba\u6587\u65b9\u5411&#xff1a;Multi-Turn Dialogue \/ Agent \/ Memory \/ RL \/ Human Simulator \/ Evaluation \u9605\u8bfb\u8bba\u6587&#xff1a;6\u7bc7 \u6838\u5fc3\u5206\u6790\u6846\u67b6&#xff1a;\u89e3\u51b3\u7684\u95ee\u9898 \u2192 \u89e3\u51b3\u65b9\u6cd5 \u2192 \u4e0e\u5176\u5b83\u65b9\u6cd5\u7684\u533a\u522b \u2192 \u5b9e\u9a8c\u9a8c\u8bc1\u8def\u7ebf<\/p>\n<hr \/>\n<h3>0. \u4e3a\u4ec0\u4e48\u8981\u628a\u8fd9 6 \u7bc7\u8bba\u6587\u653e\u5728\u4e00\u8d77\u770b&#xff1f;<\/h3>\n<p>\u8fc7\u53bb\u7684\u5927\u8bed\u8a00\u6a21\u578b\u591a\u8f6e\u5bf9\u8bdd\u7814\u7a76&#xff0c;\u4e00\u4e2a\u975e\u5e38\u5178\u578b\u7684\u601d\u8def\u662f&#xff1a;<\/p>\n<p>User<br \/>\n \u2193<br \/>\nConversation History<br \/>\n \u2193<br \/>\nLLM<br \/>\n \u2193<br \/>\nResponse<\/p>\n<p>\u6a21\u578b\u4e3b\u8981\u4f9d\u8d56\u4e0d\u65ad\u589e\u52a0\u7684 Conversation History \u6765\u5b8c\u6210\u4e0a\u4e0b\u6587\u7406\u89e3\u3002<\/p>\n<p>\u4f46\u5f53\u5bf9\u8bdd\u771f\u6b63\u53d8\u6210\u957f\u7a0b\u3001\u591a\u4efb\u52a1\u3001\u591a\u4e3b\u9898\u3001\u5e26\u5de5\u5177\u751a\u81f3\u9700\u8981\u6301\u7eed\u51b3\u7b56\u65f6&#xff0c;\u4ec5\u4ec5\u201c\u628a\u5386\u53f2\u5bf9\u8bdd\u585e\u8fdb Context\u201d\u4f1a\u51fa\u73b0\u5927\u91cf\u95ee\u9898&#xff1a;<\/p>\n<p>\u77ed\u5bf9\u8bdd<br \/>\n \u2193<br \/>\n\u7406\u89e3\u4e0a\u4e0b\u6587<br \/>\n \u2193<br \/>\n\u56de\u7b54\u95ee\u9898<\/p>\n<p>\u9010\u6e10\u53d8\u6210&#xff1a;<\/p>\n<p>\u957f\u5bf9\u8bdd<br \/>\n \u2193<br \/>\n\u5386\u53f2\u4fe1\u606f\u8d8a\u6765\u8d8a\u591a<br \/>\n \u2193<br \/>\n\u91cd\u8981\u4fe1\u606f\u88ab\u7a00\u91ca<br \/>\n \u2193<br \/>\n\u6307\u4ee4\u53d1\u751f\u6f02\u79fb<br \/>\n \u2193<br \/>\nPersona\u53d1\u751f\u6f02\u79fb<br \/>\n \u2193<br \/>\n\u5de5\u5177\u8c03\u7528\u7ecf\u9a8c\u65e0\u6cd5\u590d\u7528<br \/>\n \u2193<br \/>\nRL\u5956\u52b1\u65e0\u6cd5\u5b9a\u4f4d\u5230\u5177\u4f53Turn<br \/>\n \u2193<br \/>\n\u4f20\u7edfBenchmark\u65e0\u6cd5\u6a21\u62df\u771f\u5b9e\u7528\u6237<\/p>\n<p>\u56e0\u6b64&#xff0c;2025&#xff5e;2026 \u5e74\u7684\u4e00\u6279\u5de5\u4f5c\u5f00\u59cb\u4ece\u4e0d\u540c\u89d2\u5ea6\u89e3\u51b3\u8fd9\u4e2a\u95ee\u9898\u3002<\/p>\n<p>\u672c\u6587\u9009\u62e9\u7684 6 \u7bc7\u8bba\u6587\u5206\u522b\u4ee3\u8868\u4e86\u8fd9\u4e00\u8d8b\u52bf\u7684\u4e0d\u540c\u65b9\u5411&#xff1a;<\/p>\n<table>\n<tr>\u8bba\u6587\u6838\u5fc3\u95ee\u9898\u6838\u5fc3\u601d\u60f3<\/tr>\n<tbody>\n<tr>\n<td>H-EPM<\/td>\n<td>\u591a\u8f6eTool-use\u5982\u4f55\u5229\u7528\u5386\u53f2\u7ecf\u9a8c<\/td>\n<td>Episodic &#043; Procedural Memory<\/td>\n<\/tr>\n<tr>\n<td>Rhea<\/td>\n<td>\u957f\u5bf9\u8bdd\u4e0a\u4e0b\u6587\u4e0d\u65ad\u8870\u51cf<\/td>\n<td>Instructional &#043; Episodic Memory<\/td>\n<\/tr>\n<tr>\n<td>GTPO<\/td>\n<td>\u591a\u8f6eRL\u5956\u52b1\u8fc7\u4e8e\u7c97\u7c92\u5ea6<\/td>\n<td>Turn-level RL<\/td>\n<\/tr>\n<tr>\n<td>Persona RL<\/td>\n<td>\u4eba\u7c7b\u6a21\u62df\u5668Persona\u6f02\u79fb<\/td>\n<td>Consistency Reward &#043; Multi-turn RL<\/td>\n<\/tr>\n<tr>\n<td>EvolIF<\/td>\n<td>\u591a\u8f6eInstruction Following\u96be\u4ee5\u8bc4\u6d4b<\/td>\n<td>Evolving Benchmark<\/td>\n<\/tr>\n<tr>\n<td>FunReason-MT<\/td>\n<td>\u591a\u8f6eTool-use\u6570\u636e\u96be\u4ee5\u6784\u9020<\/td>\n<td>Environment-API Graph &#043; Query Synthesis<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>\u8fd9\u516d\u7bc7\u8bba\u6587\u5176\u5b9e\u5206\u522b\u56de\u7b54\u4e86\u516d\u4e2a\u95ee\u9898&#xff1a;<\/p>\n<p>\u6570\u636e\u4ece\u54ea\u91cc\u6765&#xff1f;<\/p>\n<p>\u5982\u4f55\u8bad\u7ec3&#xff1f;<\/p>\n<p>\u5982\u4f55\u8bb0\u5fc6&#xff1f;<\/p>\n<p>\u5982\u4f55\u6301\u7eed\u51b3\u7b56&#xff1f;<\/p>\n<p>\u5982\u4f55\u6a21\u62df\u7528\u6237&#xff1f;<\/p>\n<p>\u5982\u4f55\u8bc4\u4ef7&#xff1f;<\/p>\n<p>\u8fd9\u4e5f\u662f\u7406\u89e3\u5f53\u524d Multi-Turn Agent \u7814\u7a76\u975e\u5e38\u91cd\u8981\u7684\u4e00\u6761\u4e3b\u7ebf\u3002<\/p>\n<hr \/>\n<h2>1. H-EPM&#xff1a;\u591a\u8f6e Agent \u5982\u4f55\u771f\u6b63\u201c\u5229\u7528\u8fc7\u53bb\u7684\u7ecf\u9a8c\u201d&#xff1f;<\/h2>\n<h3>1.1 \u8bba\u6587\u4fe1\u606f<\/h3>\n<p>Experience-Evolving Multi-Turn Tool-Use Agent with Hybrid Episodic-Procedural Memory<\/p>\n<p>arXiv: 2512.07287<\/p>\n<p>\u8bba\u6587\u5df2\u7ecf\u88ab ICML 2026 \u63a5\u6536\u3002\u8bba\u6587\u63d0\u51fa H-EPM&#xff08;Hybrid Episodic-Procedural Memory&#xff09;&#xff0c;\u6838\u5fc3\u76ee\u6807\u662f\u8ba9\u591a\u8f6e Tool-use Agent \u4e0d\u53ea\u662f\u201c\u8bb0\u4f4f\u8fc7\u53bb\u53d1\u751f\u8fc7\u4ec0\u4e48\u201d&#xff0c;\u800c\u662f\u80fd\u591f\u4ece\u8fc7\u53bb\u6210\u529f\u8f68\u8ff9\u4e2d\u63d0\u53d6\u53ef\u590d\u7528\u7684\u7ecf\u9a8c\u3002<\/p>\n<p>\u8bba\u6587&#xff1a;<\/p>\n<p>ArXiv \u8bba\u6587\u4e3b\u9875<\/p>\n<hr \/>\n<h2>1.2 \u5b83\u5230\u5e95\u89e3\u51b3\u4ec0\u4e48\u95ee\u9898&#xff1f;<\/h2>\n<p>\u591a\u8f6e Tool-use Agent \u6700\u5927\u7684\u95ee\u9898\u4e4b\u4e00\u662f&#xff1a;<\/p>\n<p>\u8fc7\u53bb\u6210\u529f\u5b8c\u6210\u8fc7\u7684\u4efb\u52a1&#xff0c;\u4e0b\u4e00\u6b21\u9047\u5230\u76f8\u4f3c\u4f46\u4e0d\u5b8c\u5168\u76f8\u540c\u7684\u4efb\u52a1\u65f6&#xff0c;\u6a21\u578b\u5e76\u4e0d\u4f1a\u5f88\u597d\u5730\u590d\u7528\u8fc7\u53bb\u7ecf\u9a8c\u3002<\/p>\n<p>\u4f8b\u5982&#xff1a;<\/p>\n<p>\u5386\u53f2\u4efb\u52a1&#xff1a;<\/p>\n<p>\u67e5\u8be2\u822a\u73ed<br \/>\n \u2193<br \/>\n\u67e5\u8be2\u9152\u5e97<br \/>\n \u2193<br \/>\n\u6bd4\u8f83\u4ef7\u683c<br \/>\n \u2193<br \/>\n\u9884\u8ba2\u9152\u5e97<\/p>\n<p>\u73b0\u5728\u51fa\u73b0&#xff1a;<\/p>\n<p>\u65b0\u4efb\u52a1&#xff1a;<\/p>\n<p>\u67e5\u8be2\u822a\u73ed<br \/>\n \u2193<br \/>\n\u67e5\u8be2\u9152\u5e97<br \/>\n \u2193<br \/>\n\u67e5\u8be2\u79df\u8f66<br \/>\n \u2193<br \/>\n\u6bd4\u8f83\u4ef7\u683c<\/p>\n<p>\u4f20\u7edf\u65b9\u6cd5\u5b58\u5728\u4e24\u4e2a\u6781\u7aef\u3002<\/p>\n<h4>\u65b9\u6cd5\u4e00&#xff1a;\u76f4\u63a5\u590d\u7528\u5b8c\u6574\u8f68\u8ff9<\/h4>\n<p>\u5386\u53f2Trajectory<br \/>\n\u2193<br \/>\n\u5b8c\u6574Retrieval<br \/>\n\u2193<br \/>\n\u5f53\u524d\u4efb\u52a1<\/p>\n<p>\u95ee\u9898\u662f&#xff1a;<\/p>\n<p>\u5386\u53f2\u4efb\u52a1\u548c\u5f53\u524d\u4efb\u52a1\u4e0d\u53ef\u80fd\u5b8c\u5168\u4e00\u6837\u3002<\/p>\n<p>\u56e0\u6b64\u5b8c\u6574\u8f68\u8ff9\u5f80\u5f80\u5305\u542b\u5927\u91cf\u4e0e\u5f53\u524d\u73af\u5883\u65e0\u5173\u7684\u4fe1\u606f\u3002<\/p>\n<hr \/>\n<h4>\u65b9\u6cd5\u4e8c&#xff1a;\u53ea\u590d\u7528 Tool-level Pattern<\/h4>\n<p>\u4f8b\u5982&#xff1a;<\/p>\n<p>search_flight<br \/>\n\u2192 search_hotel<br \/>\n\u2192 book_hotel<\/p>\n<p>\u53ea\u8bb0&#xff1a;<\/p>\n<p>Tool A \u2192 Tool B \u2192 Tool C<\/p>\n<p>\u867d\u7136\u5177\u6709\u6cdb\u5316\u6027&#xff0c;\u4f46\u53c8\u4e22\u5931\u4e86&#xff1a;<\/p>\n<p>\u4e3a\u4ec0\u4e48\u5f53\u65f6\u8981\u8fd9\u4e48\u8c03\u7528&#xff1f;<\/p>\n<p>\u4e5f\u5c31\u662f&#xff1a;<\/p>\n<p>Tool transition<br \/>\n&#043;<br \/>\nContext<\/p>\n<p>\u4e4b\u95f4\u7684\u8054\u7cfb\u3002<\/p>\n<hr \/>\n<h2>1.3 H-EPM\u7684\u6838\u5fc3\u601d\u60f3<\/h2>\n<p>\u8bba\u6587\u63d0\u51fa&#xff1a;<\/p>\n<p>Hybrid Episodic-Procedural Memory<\/p>\n<p>\u4e5f\u5c31\u662f\u628a\u7ecf\u9a8c\u62c6\u6210\u4e24\u4e2a\u5c42\u6b21&#xff1a;<\/p>\n<p>                Historical Trajectories<br \/>\n                         \u2502<br \/>\n                         \u2193<br \/>\n                 State Summarization<br \/>\n                         \u2502<br \/>\n                         \u2193<br \/>\n                State-Annotated Tool Graph<br \/>\n                         \u2502<br \/>\n              \u250c\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2534\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2510<br \/>\n              \u2193                     \u2193<br \/>\n       Procedural Memory      Episodic Memory<br \/>\n       \u7a0b\u5e8f\u6027\u8bb0\u5fc6              \u60c5\u666f\u8bb0\u5fc6<br \/>\n              \u2502                     \u2502<br \/>\n              \u2514\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u252c\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2518<br \/>\n                         \u2193<br \/>\n                 Adaptive Tool Selection<\/p>\n<p>\u5b98\u65b9\u5b9e\u73b0\u4e5f\u91c7\u7528\u7c7b\u4f3c\u7684\u7ed3\u6784&#xff1a;\u5386\u53f2\u8f68\u8ff9\u7ecf\u8fc7\u72b6\u6001\u6458\u8981\u540e\u5f62\u6210\u5e26\u72b6\u6001\u4fe1\u606f\u7684 Tool Graph&#xff0c;\u518d\u5206\u522b\u5f62\u6210 procedural memory \u548c episodic memory\u3002<\/p>\n<hr \/>\n<h2>1.4 \u4ec0\u4e48\u662f Procedural Memory&#xff1f;<\/h2>\n<p>Procedural Memory \u53ef\u4ee5\u7406\u89e3\u6210&#xff1a;<\/p>\n<p>\u201c\u6211\u4ee5\u524d\u662f\u600e\u4e48\u505a\u8fd9\u7c7b\u4e8b\u60c5\u7684&#xff1f;\u201d<\/p>\n<p>\u4f8b\u5982&#xff1a;<\/p>\n<p>Search Flight<br \/>\n       \u2193<br \/>\nSearch Hotel<br \/>\n       \u2193<br \/>\nCompare<br \/>\n       \u2193<br \/>\nBook<\/p>\n<p>\u6a21\u578b\u9010\u6e10\u53d1\u73b0&#xff1a;<\/p>\n<p>A \u2192 B \u2192 C<\/p>\n<p>\u7ecf\u5e38\u662f\u6709\u6548\u7684\u3002<\/p>\n<p>\u4e8e\u662f\u5f62\u6210&#xff1a;<\/p>\n<p>Procedural Pattern<\/p>\n<p>\u5b83\u4e0d\u5173\u5fc3\u67d0\u4e00\u6b21\u4efb\u52a1\u7684\u5168\u90e8\u7ec6\u8282&#xff0c;\u800c\u66f4\u52a0\u5173\u6ce8&#xff1a;<\/p>\n<p>\u5de5\u5177\u4e4b\u95f4\u6709\u4ec0\u4e48\u7a33\u5b9a\u7684\u4f9d\u8d56\u5173\u7cfb\u3002<\/p>\n<hr \/>\n<h2>1.5 \u4ec0\u4e48\u662f Episodic Memory&#xff1f;<\/h2>\n<p>Episodic Memory \u5219\u8d1f\u8d23&#xff1a;<\/p>\n<p>\u201c\u5f53\u65f6\u4e3a\u4ec0\u4e48\u8fd9\u4e48\u505a&#xff1f;\u201d<\/p>\n<p>\u4f8b\u5982&#xff1a;<\/p>\n<p>Tool A<br \/>\n \u2193<br \/>\n\u5f53\u524d\u72b6\u6001&#xff1a;<br \/>\n\u7528\u6237\u9884\u7b97 &lt; $500<br \/>\n\u76ee\u7684\u5730 &#061; Tokyo<br \/>\n\u65f6\u95f4 &#061; Christmas<br \/>\n \u2193<br \/>\nTool B<\/p>\n<p>\u4e8e\u662f Tool Graph \u7684\u8fb9\u4e0d\u518d\u53ea\u662f&#xff1a;<\/p>\n<p>A \u2192 B<\/p>\n<p>\u800c\u662f&#xff1a;<\/p>\n<p>A \u2192 B<br \/>\nContext Summary<\/p>\n<p>\u8fd9\u6837\u6a21\u578b\u65e2\u77e5\u9053&#xff1a;<\/p>\n<p>A \u540e\u9762\u901a\u5e38\u53ef\u4ee5\u8c03\u7528 B\u3002<\/p>\n<p>\u4e5f\u77e5\u9053&#xff1a;<\/p>\n<p>\u5728\u4ec0\u4e48\u60c5\u51b5\u4e0b A \u2192 B \u624d\u5408\u7406\u3002<\/p>\n<hr \/>\n<h2>1.6 \u6700\u91cd\u8981\u7684\u521b\u65b0&#xff1a;Memory\u4e0d\u4ec5\u7528\u4e8eInference<\/h2>\n<p>\u5f88\u591a Memory \u5de5\u4f5c\u4e3b\u8981\u7528\u4e8e&#xff1a;<\/p>\n<p>Retrieval<br \/>\n \u2193<br \/>\nPrompt<br \/>\n \u2193<br \/>\nLLM<\/p>\n<p>H-EPM\u8fdb\u4e00\u6b65\u628a Memory \u653e\u5230\u4e86 RL \u8bad\u7ec3\u8fc7\u7a0b\u4e2d\u3002<\/p>\n<p>\u5b83\u53d1\u73b0\u591a\u8f6e Agent RL \u7684\u4e00\u4e2a\u4e25\u91cd\u95ee\u9898&#xff1a;<\/p>\n<p>Trajectory\u5f88\u957f<br \/>\n        \u2193<br \/>\n\u6700\u7ec8\u6210\u529f \/ \u5931\u8d25<br \/>\n        \u2193<br \/>\nReward\u5f88\u7a00\u758f<br \/>\n        \u2193<br \/>\n\u63a2\u7d22\u975e\u5e38\u56f0\u96be<\/p>\n<p>\u4e8e\u662f H-EPM \u4f7f\u7528\u5386\u53f2\u6210\u529f\u7684 Tool Transition \u6765\u6307\u5bfc\u63a2\u7d22&#xff1a;<\/p>\n<p>Historical Successful Transitions<br \/>\n                \u2193<br \/>\n         Bias Exploration<br \/>\n                \u2193<br \/>\n          RL Training<br \/>\n                \u2193<br \/>\n       Better Multi-turn Policy<\/p>\n<p>\u4e5f\u5c31\u662f\u8bf4&#xff1a;<\/p>\n<p>Memory\u4e0d\u4ec5\u662fInference\u7ec4\u4ef6&#xff0c;\u540c\u65f6\u4e5f\u662fTraining\u7ec4\u4ef6\u3002<\/p>\n<p>\u8fd9\u662f\u8fd9\u7bc7\u8bba\u6587\u975e\u5e38\u503c\u5f97\u6ce8\u610f\u7684\u5730\u65b9\u3002<\/p>\n<hr \/>\n<h2>1.7 \u548c\u4f20\u7edfMemory\u65b9\u6cd5\u6709\u4ec0\u4e48\u533a\u522b&#xff1f;<\/h2>\n<p>\u53ef\u4ee5\u603b\u7ed3\u6210&#xff1a;<\/p>\n<table>\n<tr>\u65b9\u6cd5\u590d\u7528\u5185\u5bb9\u6cdb\u5316\u80fd\u529bContext\u4fe1\u606f<\/tr>\n<tbody>\n<tr>\n<td>Full Trajectory Retrieval<\/td>\n<td>\u5b8c\u6574\u8f68\u8ff9<\/td>\n<td>\u4f4e<\/td>\n<td>\u5f3a<\/td>\n<\/tr>\n<tr>\n<td>Tool Retrieval<\/td>\n<td>\u5de5\u5177<\/td>\n<td>\u9ad8<\/td>\n<td>\u5f31<\/td>\n<\/tr>\n<tr>\n<td>Episodic Memory<\/td>\n<td>\u5177\u4f53\u7ecf\u5386<\/td>\n<td>\u4e2d<\/td>\n<td>\u5f3a<\/td>\n<\/tr>\n<tr>\n<td>Procedural Memory<\/td>\n<td>\u884c\u4e3a\u6a21\u5f0f<\/td>\n<td>\u9ad8<\/td>\n<td>\u5f31<\/td>\n<\/tr>\n<tr>\n<td>H-EPM<\/td>\n<td>\u4e24\u8005\u7ed3\u5408<\/td>\n<td>\u9ad8<\/td>\n<td>\u5f3a<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>\u56e0\u6b64 H-EPM \u7684\u6838\u5fc3\u4e0d\u662f&#xff1a;<\/p>\n<p>\u201c\u589e\u52a0\u4e00\u4e2aMemory\u3002\u201d<\/p>\n<p>\u800c\u662f&#xff1a;<\/p>\n<p>\u628a\u201c\u53ef\u6cdb\u5316\u7684\u7a0b\u5e8f\u7ecf\u9a8c\u201d\u548c\u201c\u5177\u4f53\u4efb\u52a1\u4e0a\u4e0b\u6587\u201d\u89e3\u8026&#xff0c;\u7136\u540e\u518d\u91cd\u65b0\u7ec4\u5408\u3002<\/p>\n<hr \/>\n<h2>1.8 \u5b9e\u9a8c\u5982\u4f55\u9a8c\u8bc1&#xff1f;<\/h2>\n<p>\u8bba\u6587\u4e3b\u8981\u9a8c\u8bc1\u4e24\u4e2a\u95ee\u9898\u3002<\/p>\n<h4>\u5b9e\u9a8c\u4e00&#xff1a;Inference-time Tool Selection<\/h4>\n<p>\u6bd4\u8f83&#xff1a;<\/p>\n<p>No Memory<br \/>\nvs<br \/>\nTrajectory Retrieval<br \/>\nvs<br \/>\nTool-level Reuse<br \/>\nvs<br \/>\nH-EPM<\/p>\n<p>\u89c2\u5bdf\u591a\u8f6e Tool-use \u6210\u529f\u7387\u3002<\/p>\n<p>\u8bba\u6587\u62a5\u544a H-EPM \u5728\u591a\u4e2a\u591a\u8f6e Tool-use Benchmark \u4e0a\u53d6\u5f97\u6700\u9ad8\u7ea6 50% \u7684\u63d0\u5347\u3002<\/p>\n<hr \/>\n<h4>\u5b9e\u9a8c\u4e8c&#xff1a;RL Exploration<\/h4>\n<p>\u6bd4\u8f83&#xff1a;<\/p>\n<p>Standard RL<br \/>\nvs<br \/>\nMemory-guided RL<\/p>\n<p>\u91cd\u70b9\u89c2\u5bdf&#xff1a;<\/p>\n<p>In-domain<br \/>\nOOD<br \/>\nLong-horizon<\/p>\n<p>\u7ed3\u679c\u663e\u793a&#xff0c;H-EPM \u53ef\u4ee5\u8fdb\u4e00\u6b65\u63d0\u5347 RL policy&#xff0c;\u5728 OOD \u4efb\u52a1\u4e0a\u6700\u9ad8\u83b7\u5f97\u7ea6 40% \u7684\u63d0\u5347\u3002<\/p>\n<hr \/>\n<h2>1.9 \u4e00\u53e5\u8bdd\u603b\u7ed3<\/h2>\n<p>H-EPM\u89e3\u51b3\u7684\u4e0d\u662f\u201c\u6a21\u578b\u6ca1\u6709\u8bb0\u5fc6\u201d&#xff0c;\u800c\u662f\u201c\u6a21\u578b\u65e0\u6cd5\u628a\u8fc7\u53bb\u7ecf\u9a8c\u8f6c\u5316\u6210\u672a\u6765\u53ef\u4ee5\u590d\u7528\u7684\u884c\u4e3a\u6a21\u5f0f\u201d\u3002<\/p>\n<hr \/>\n<h2>2. Rhea&#xff1a;\u957f\u5bf9\u8bdd\u4e3a\u4ec0\u4e48\u8d8a\u804a\u8d8a\u5bb9\u6613\u201c\u5fd8\u8bb0\u6700\u91cd\u8981\u7684\u4e1c\u897f\u201d&#xff1f;<\/h2>\n<h3>2.1 \u8bba\u6587\u4fe1\u606f<\/h3>\n<p>Rhea: Role-aware Heuristic Episodic Attention for Conversational LLMs<\/p>\n<p>arXiv: 2512.06869<\/p>\n<p>ArXiv \u8bba\u6587\u4e3b\u9875<\/p>\n<hr \/>\n<h2>2.2 \u5b83\u89e3\u51b3\u7684\u95ee\u9898<\/h2>\n<p>Rhea\u89c2\u5bdf\u5230\u4e00\u4e2a\u975e\u5e38\u5178\u578b\u7684\u73b0\u8c61&#xff1a;<\/p>\n<p>LLM \u5355\u8f6e\u8868\u73b0\u5f88\u597d&#xff0c;\u4f46\u662f\u968f\u7740\u591a\u8f6e\u5bf9\u8bdd\u4e0d\u65ad\u589e\u52a0&#xff0c;Context Integrity \u4f1a\u9010\u6e10\u4e0b\u964d\u3002<\/p>\n<p>\u8bba\u6587\u628a\u8fd9\u4e2a\u73b0\u8c61\u79f0\u4e3a&#xff1a;<\/p>\n<p>Cumulative Contextual Decay<\/p>\n<p>\u4e5f\u5c31\u662f&#xff1a;<\/p>\n<p>Turn 1<br \/>\n\u2193<br \/>\nTurn 2<br \/>\n\u2193<br \/>\nTurn 3<br \/>\n\u2193<br \/>\n&#8230;<br \/>\n\u2193<br \/>\nTurn 20<\/p>\n<p>\u968f\u7740\u5386\u53f2\u589e\u52a0&#xff1a;<\/p>\n<p>Attention Pollution<br \/>\nAttention Dilution<br \/>\nAttention Drift<\/p>\n<p>\u6700\u7ec8\u9020\u6210&#xff1a;<\/p>\n<p>\u6307\u4ee4\u5fd8\u8bb0<br \/>\n\u89d2\u8272\u6f02\u79fb<br \/>\n\u4e0a\u4e0b\u6587\u7406\u89e3\u9519\u8bef<\/p>\n<hr \/>\n<h2>2.3 \u4e3a\u4ec0\u4e48\u7b80\u5355Context Window\u4e0d\u591f&#xff1f;<\/h2>\n<p>\u5047\u8bbe\u6700\u5f00\u59cb\u7528\u6237\u8bf4&#xff1a;<\/p>\n<p>\u4f60\u662f\u4e00\u540d\u4e25\u683c\u7684\u6570\u5b66\u8001\u5e08\u3002<br \/>\n\u56de\u7b54\u5fc5\u987b\u7b80\u6d01\u3002<br \/>\n\u4e0d\u8981\u4f7f\u7528Emoji\u3002<\/p>\n<p>\u540e\u9762\u53d1\u751f20\u8f6e\u804a\u5929&#xff1a;<\/p>\n<p>\u7528\u6237&#xff1a;\u89e3\u91ca\u4e00\u4e0b\u5fae\u79ef\u5206<br \/>\n\u52a9\u624b&#xff1a;&#8230;<br \/>\n\u7528\u6237&#xff1a;\u6362\u4e00\u4e2a\u4f8b\u5b50<br \/>\n\u52a9\u624b&#xff1a;&#8230;<br \/>\n\u7528\u6237&#xff1a;\u518d\u8be6\u7ec6\u4e00\u70b9<br \/>\n\u52a9\u624b&#xff1a;&#8230;<br \/>\n&#8230;<\/p>\n<p>\u5982\u679c\u6bcf\u4e00\u8f6e\u90fd\u52a0\u5165Context&#xff1a;<\/p>\n<p>System Instruction<br \/>\n&#043;<br \/>\nTurn1<br \/>\n&#043;<br \/>\nTurn2<br \/>\n&#043;<br \/>\n&#8230;<br \/>\n&#043;<br \/>\nTurn20<\/p>\n<p>\u771f\u6b63\u91cd\u8981\u7684 Instruction&#xff1a;<\/p>\n<p>\u201c\u4f60\u662f\u4e00\u540d\u4e25\u683c\u7684\u6570\u5b66\u8001\u5e08\u201d<\/p>\n<p>\u53cd\u800c\u53ef\u80fd\u88ab\u5927\u91cf\u666e\u901a\u5bf9\u8bdd\u4fe1\u606f\u6df9\u6ca1\u3002<\/p>\n<hr \/>\n<h2>2.4 Rhea\u7684\u6838\u5fc3\u601d\u60f3<\/h2>\n<p>Rhea\u6ca1\u6709\u628a\u6240\u6709Conversation History\u5f53\u6210\u540c\u4e00\u79cd\u4fe1\u606f&#xff0c;\u800c\u662f\u62c6\u6210\u4e24\u4e2a Memory&#xff1a;<\/p>\n<p>Conversation History<br \/>\n        \u2502<br \/>\n        \u251c\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2510<br \/>\n        \u2193              \u2193<br \/>\nInstructional      Episodic<br \/>\nMemory             Memory<br \/>\n        \u2502              \u2502<br \/>\n        \u2193              \u2193<br \/>\nGlobal Rules       Dynamic Events<br \/>\n        \u2502              \u2502<br \/>\n        \u2514\u2500\u2500\u2500\u2500\u2500\u2500\u252c\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2518<br \/>\n               \u2193<br \/>\n        Priority Attention<br \/>\n               \u2193<br \/>\n          LLM Response<\/p>\n<hr \/>\n<h2>2.5 Instructional Memory<\/h2>\n<p>IM\u4e3b\u8981\u5b58&#xff1a;<\/p>\n<p>Global Constraints<br \/>\nRole<br \/>\nSystem Instruction<br \/>\nPersistent Preferences<\/p>\n<p>\u4f8b\u5982&#xff1a;<\/p>\n<p>Role &#061; Teacher<\/p>\n<p>Style &#061; Concise<\/p>\n<p>Language &#061; Chinese<\/p>\n<p>Must not use emoji<\/p>\n<p>\u8fd9\u4e9b\u4fe1\u606f\u5177\u6709\u4e00\u4e2a\u91cd\u8981\u7279\u70b9&#xff1a;<\/p>\n<p>\u8de8\u6574\u4e2a\u5bf9\u8bdd\u957f\u671f\u6709\u6548\u3002<\/p>\n<p>\u56e0\u6b64\u4e0d\u80fd\u548c\u666e\u901a\u5386\u53f2\u6d88\u606f\u5e73\u7b49\u5bf9\u5f85\u3002<\/p>\n<hr \/>\n<h2>2.6 Episodic Memory<\/h2>\n<p>EM\u5219\u5b58&#xff1a;<\/p>\n<p>\u6700\u8fd1\u53d1\u751f\u4e86\u4ec0\u4e48<br \/>\n\u7528\u6237\u521a\u624d\u8bf4\u4e86\u4ec0\u4e48<br \/>\n\u5f53\u524d\u4efb\u52a1\u662f\u4ec0\u4e48<br \/>\n\u54ea\u4e9b\u5386\u53f2\u4fe1\u606f\u4e0e\u5f53\u524dTurn\u76f8\u5173<\/p>\n<p>\u4f8b\u5982&#xff1a;<\/p>\n<p>User&#xff1a;<br \/>\n\u6211\u4e0b\u5468\u8981\u53c2\u52a0\u8003\u8bd5\u3002<\/p>\n<p>\u2193<\/p>\n<p>Episodic Memory&#xff1a;<br \/>\nUser has an exam next week.<\/p>\n<p>\u5f53\u540e\u9762\u7528\u6237\u8bf4&#xff1a;<\/p>\n<p>\u5e2e\u6211\u5236\u5b9a\u5b66\u4e60\u8ba1\u5212\u3002<\/p>\n<p>\u8fd9\u4e2a\u4fe1\u606f\u5c31\u5e94\u8be5\u88ab\u53ec\u56de\u3002<\/p>\n<hr \/>\n<h2>2.7 Rhea\u6700\u5173\u952e\u7684\u533a\u522b&#xff1a;Priority Attention<\/h2>\n<p>Rhea\u4e0d\u662f\u7b80\u5355&#xff1a;<\/p>\n<p>Retrieve Top-K<\/p>\n<p>\u800c\u662f&#xff1a;<\/p>\n<p>Global Instruction<br \/>\n      \u2193<br \/>\nHighest Priority<\/p>\n<p>Relevant Episodic Memory<br \/>\n      \u2193<br \/>\nDynamic Retrieval<\/p>\n<p>Irrelevant History<br \/>\n      \u2193<br \/>\nDiscard \/ Downweight<\/p>\n<p>\u6240\u4ee5\u53ef\u4ee5\u7406\u89e3\u6210&#xff1a;<\/p>\n<p>\u5148\u4fdd\u8bc1\u201c\u6211\u662f\u8c01\u3001\u5fc5\u987b\u9075\u5b88\u4ec0\u4e48\u201d&#xff0c;\u518d\u8003\u8651\u201c\u521a\u521a\u53d1\u751f\u4e86\u4ec0\u4e48\u201d\u3002<\/p>\n<hr \/>\n<h2>2.8 \u5b9e\u9a8c\u9a8c\u8bc1\u8def\u7ebf<\/h2>\n<p>\u8bba\u6587\u5728\u591a\u4e2a\u591a\u8f6e\u5bf9\u8bddBenchmark\u4e0a\u6d4b\u8bd5&#xff0c;\u5305\u62ec&#xff1a;<\/p>\n<ul>\n<li>\n<p>MT-Eval<\/p>\n<\/li>\n<li>\n<p>Long-MT-Bench&#043;<\/p>\n<\/li>\n<\/ul>\n<p>\u91cd\u70b9\u89c2\u5bdf&#xff1a;<\/p>\n<p>Multi-turn Accuracy<br \/>\nInstruction Fidelity<br \/>\nLong-horizon Performance<\/p>\n<p>\u7ed3\u679c&#xff1a;<\/p>\n<ul>\n<li>\n<p>\u6574\u4f53\u51c6\u786e\u7387\u63d0\u5347 1.04 \/ 10<\/p>\n<\/li>\n<li>\n<p>\u76f8\u5bf9\u5f3aBaseline\u7ea6 16%\u63d0\u5347<\/p>\n<\/li>\n<li>\n<p>\u957f\u7a0b\u4ea4\u4e92\u4e2d Instruction Fidelity \u7684 IAR &gt; 8.1<\/p>\n<\/li>\n<\/ul>\n<hr \/>\n<h2>2.9 \u548cH-EPM\u7684\u533a\u522b<\/h2>\n<p>\u8fd9\u4e24\u4e2a\u65b9\u6cd5\u975e\u5e38\u5bb9\u6613\u6df7\u6dc6\u3002<\/p>\n<h4>H-EPM<\/h4>\n<p>\u6838\u5fc3&#xff1a;<\/p>\n<p>\u590d\u7528\u8fc7\u53bb\u505a\u4e8b\u60c5\u7684\u7ecf\u9a8c\u3002<\/p>\n<p>\u91cd\u70b9&#xff1a;<\/p>\n<p>Tool<br \/>\nTrajectory<br \/>\nProcedure<br \/>\nRL Exploration<\/p>\n<h4>Rhea<\/h4>\n<p>\u6838\u5fc3&#xff1a;<\/p>\n<p>\u63a7\u5236Conversation History\u4e2d\u7684\u4fe1\u606f\u4f18\u5148\u7ea7\u3002<\/p>\n<p>\u91cd\u70b9&#xff1a;<\/p>\n<p>Instruction<br \/>\nConversation<br \/>\nAttention<br \/>\nContext Decay<\/p>\n<p>\u56e0\u6b64&#xff1a;<\/p>\n<p>Rhea<br \/>\n&#061; Context Management<\/p>\n<p>H-EPM<br \/>\n&#061; Experience Management<\/p>\n<hr \/>\n<h2>3. GTPO&#xff1a;\u4e3a\u4ec0\u4e48\u591a\u8f6eAgent RL\u9700\u8981\u201cTurn-level Reward\u201d&#xff1f;<\/h2>\n<h3>3.1 \u8bba\u6587\u4fe1\u606f<\/h3>\n<p>Empowering Multi-Turn Tool-Integrated Agentic Reasoning with Group Turn Policy Optimization<\/p>\n<p>arXiv: 2511.14846<\/p>\n<p>\u8be5\u8bba\u6587\u540e\u6765\u53d1\u8868\u5728 ACL 2026\u3002<\/p>\n<p>ArXiv \u8bba\u6587\u4e3b\u9875<\/p>\n<hr \/>\n<h2>3.2 \u5b83\u89e3\u51b3\u4ec0\u4e48\u95ee\u9898&#xff1f;<\/h2>\n<p>\u4f20\u7edf GRPO \u5728\u591a\u8f6e Tool-use \u4e2d\u5b58\u5728\u4e00\u4e2a\u5f88\u4e25\u91cd\u7684\u95ee\u9898&#xff1a;<\/p>\n<p>Turn 1<br \/>\n \u2193<br \/>\nTurn 2<br \/>\n \u2193<br \/>\nTurn 3<br \/>\n \u2193<br \/>\nTurn 4<br \/>\n \u2193<br \/>\n\u6700\u7ec8Answer<br \/>\n \u2193<br \/>\nReward &#061; 1<\/p>\n<p>\u6216\u8005&#xff1a;<\/p>\n<p>\u6700\u7ec8\u5931\u8d25<br \/>\nReward &#061; 0<\/p>\n<p>\u90a3\u4e48&#xff1a;<\/p>\n<p>\u5230\u5e95\u662f\u54ea\u4e00\u4e2aTurn\u51fa\u4e86\u95ee\u9898&#xff1f;<\/p>\n<p>\u6a21\u578b\u4e0d\u77e5\u9053\u3002<\/p>\n<p>\u8fd9\u5c31\u662f&#xff1a;<\/p>\n<p>Sparse \/ Coarse-grained Reward<\/p>\n<p>\u8bba\u6587\u6307\u51fa&#xff0c;\u4f20\u7edf GRPO \u7684 trajectory-level reward \u5bf9\u590d\u6742\u591a\u8f6e\u4ea4\u4e92\u63d0\u4f9b\u7684\u5b66\u4e60\u4fe1\u53f7\u592a\u7c97&#xff0c;\u5bb9\u6613\u5bfc\u81f4\u8bad\u7ec3\u505c\u6ede\u3002<\/p>\n<hr \/>\n<h2>3.3 GTPO\u600e\u4e48\u89e3\u51b3&#xff1f;<\/h2>\n<p>GTPO&#xff1a;<\/p>\n<p>Group Turn Policy Optimization<\/p>\n<p>\u6838\u5fc3\u601d\u60f3&#xff1a;<\/p>\n<p>\u4e0d\u518d\u53ea\u8bc4\u4ef7\u6574\u4e2aTrajectory&#xff0c;\u800c\u662f\u8bc4\u4ef7\u6bcf\u4e00\u4e2aTurn\u3002<\/p>\n<p>\u53d8\u6210&#xff1a;<\/p>\n<p>Trajectory<br \/>\n\u2502<br \/>\n\u251c\u2500\u2500 Turn 1 \u2192 Reward<br \/>\n\u251c\u2500\u2500 Turn 2 \u2192 Reward<br \/>\n\u251c\u2500\u2500 Turn 3 \u2192 Reward<br \/>\n\u251c\u2500\u2500 Turn 4 \u2192 Reward<br \/>\n\u2514\u2500\u2500 Turn 5 \u2192 Reward<\/p>\n<hr \/>\n<h2>3.4 \u4e09\u4e2a\u6838\u5fc3\u521b\u65b0<\/h2>\n<h3>\u521b\u65b0\u4e00&#xff1a;Turn-level Reward Assignment<\/h3>\n<p>\u6bcf\u4e00\u4e2aTurn\u90fd\u6709\u53cd\u9988&#xff1a;<\/p>\n<p>r1<br \/>\nr2<br \/>\nr3<br \/>\n&#8230;<br \/>\nrT<\/p>\n<p>\u8fd9\u6837\u6a21\u578b\u80fd\u591f\u77e5\u9053&#xff1a;<\/p>\n<p>Turn 3<br \/>\n\u2193<br \/>\n\u8d21\u732e\u5f88\u5927<\/p>\n<p>Turn 4<br \/>\n\u2193<br \/>\n\u5bfc\u81f4\u5931\u8d25<\/p>\n<p>\u76f8\u6bd4&#xff1a;<\/p>\n<p>Entire trajectory &#061; 0<\/p>\n<p>\u5b66\u4e60\u4fe1\u53f7\u660e\u663e\u66f4\u52a0\u7cbe\u7ec6\u3002<\/p>\n<hr \/>\n<h3>\u521b\u65b0\u4e8c&#xff1a;Return-based Advantage<\/h3>\n<p>\u4f20\u7edf\u65b9\u6cd5\u53ef\u80fd\u4f7f\u7528\u6574\u4e2aTrajectory\u7684reward\u8fdb\u884c advantage estimation\u3002<\/p>\n<p>GTPO\u5219\u8003\u8651&#xff1a;<\/p>\n<p>\u5f53\u524dTurn\u4e4b\u540e\u8fd8\u80fd\u83b7\u5f97\u591a\u5c11Return<\/p>\n<p>\u4e5f\u5c31\u662f&#xff1a;<\/p>\n<p>Turn t<br \/>\n\u2193<br \/>\nFuture Return<br \/>\n\u2193<br \/>\nAdvantage<\/p>\n<p>\u56e0\u6b64\u8d8a\u63a5\u8fd1\u6210\u529f\u7ed3\u679c\u3001\u5bf9\u6700\u7ec8\u6210\u529f\u8d21\u732e\u8d8a\u5927\u7684Turn&#xff0c;\u80fd\u591f\u5f97\u5230\u66f4\u52a0\u5408\u7406\u7684\u8bad\u7ec3\u4fe1\u53f7\u3002<\/p>\n<hr \/>\n<h3>\u521b\u65b0\u4e09&#xff1a;Self-supervised Reward Shaping<\/h3>\n<p>\u591a\u8f6e Tool-use \u4e00\u4e2a\u91cd\u8981\u7279\u70b9\u662f&#xff1a;<\/p>\n<p>\u6a21\u578b\u81ea\u5df1\u751f\u6210\u7684\u4ee3\u7801 \/ Tool Call \u672c\u8eab\u5c31\u5305\u542b\u4e00\u4e9b\u53ef\u9a8c\u8bc1\u4fe1\u606f\u3002<\/p>\n<p>\u4f8b\u5982&#xff1a;<\/p>\n<p>\u751f\u6210\u4ee3\u7801<br \/>\n \u2193<br \/>\nExecute<br \/>\n \u2193<br \/>\n\u5f97\u5230\u7ed3\u679c<br \/>\n \u2193<br \/>\n\u53ef\u4ee5\u9a8c\u8bc1<\/p>\n<p>\u56e0\u6b64\u53ef\u4ee5\u5229\u7528\u8fd9\u4e9b self-supervision signal&#xff0c;\u628a&#xff1a;<\/p>\n<p>Binary Reward<br \/>\n0 \/ 1<\/p>\n<p>\u8f6c\u5316\u4e3a\u66f4\u52a0 dense \u7684 reward\u3002<\/p>\n<hr \/>\n<h2>3.5 \u548cGRPO\u7684\u672c\u8d28\u533a\u522b<\/h2>\n<p>\u53ef\u4ee5\u8fd9\u6837\u7406\u89e3&#xff1a;<\/p>\n<p>GRPO&#xff1a;<\/p>\n<p>[Turn1 \u2192 Turn2 \u2192 Turn3 \u2192 Turn4]<br \/>\n                 \u2193<br \/>\n             Reward &#061; 1<\/p>\n<p>GTPO&#xff1a;<\/p>\n<p>Turn1 \u2192 r1<br \/>\nTurn2 \u2192 r2<br \/>\nTurn3 \u2192 r3<br \/>\nTurn4 \u2192 r4<br \/>\n          \u2193<br \/>\n   Discounted Return<br \/>\n          \u2193<br \/>\n      Advantage<\/p>\n<p>\u6240\u4ee5&#xff1a;<\/p>\n<p>GRPO\u662fTrajectory-level Learning&#xff0c;GTPO\u8fdb\u4e00\u6b65\u53d8\u6210Turn-level Learning\u3002<\/p>\n<hr \/>\n<h2>3.6 \u5b9e\u9a8c\u8def\u7ebf<\/h2>\n<p>\u8bba\u6587\u91cd\u70b9\u6bd4\u8f83&#xff1a;<\/p>\n<p>GRPO<br \/>\nvs<br \/>\nGTPO<\/p>\n<p>\u5b9e\u9a8c\u4efb\u52a1\u5305\u62ec&#xff1a;<\/p>\n<ul>\n<li>\n<p>Math Reasoning<\/p>\n<\/li>\n<li>\n<p>Commonsense Reasoning<\/p>\n<\/li>\n<li>\n<p>Program Synthesis<\/p>\n<\/li>\n<\/ul>\n<p>\u7ed3\u679c&#xff1a;<\/p>\n<p>Math&#xff1a;<br \/>\nGTPO &gt; GRPO \u2248 &#043;3.0%<\/p>\n<p>Commonsense&#xff1a;<br \/>\n\u2248 &#043;3.9%<\/p>\n<p>Program Synthesis&#xff1a;<br \/>\n\u540c\u6837\u53d6\u5f97\u63d0\u5347<\/p>\n<p>\u540c\u65f6\u8bba\u6587\u5f3a\u8c03&#xff1a;<\/p>\n<p>GTPO\u6ca1\u6709\u5f15\u5165\u660e\u663e\u989d\u5916\u8ba1\u7b97\u5f00\u9500\u3002<\/p>\n<hr \/>\n<h2>3.7 \u4e00\u53e5\u8bdd\u7406\u89e3<\/h2>\n<p>GTPO\u89e3\u51b3\u7684\u662f\u201c\u591a\u8f6eRL\u77e5\u9053\u6700\u7ec8\u7ed3\u679c&#xff0c;\u4f46\u4e0d\u77e5\u9053\u6bcf\u4e00\u6b65\u5230\u5e95\u597d\u4e0d\u597d\u201d\u7684\u95ee\u9898\u3002<\/p>\n<hr \/>\n<h2>4. Consistently Simulating Human Personas&#xff1a;\u5982\u4f55\u6784\u5efa\u771f\u6b63\u7a33\u5b9a\u7684\u201c\u4eba\u7c7b\u6a21\u62df\u5668\u201d&#xff1f;<\/h2>\n<h3>4.1 \u8bba\u6587\u4fe1\u606f<\/h3>\n<p>Consistently Simulating Human Personas with Multi-Turn Reinforcement Learning<\/p>\n<p>arXiv: 2511.00222<\/p>\n<p>\u8be5\u5de5\u4f5c\u53d1\u8868\u4e8e NeurIPS 2025\u3002<\/p>\n<p>ArXiv \u8bba\u6587\u4e3b\u9875<\/p>\n<hr \/>\n<h2>4.2 \u4e3a\u4ec0\u4e48\u9700\u8981Human Simulator&#xff1f;<\/h2>\n<p>\u5982\u679c\u6211\u4eec\u60f3\u8bad\u7ec3\u4e00\u4e2a\u591a\u8f6e\u5bf9\u8bddAgent&#xff1a;<\/p>\n<p>Agent<br \/>\n \u2195<br \/>\nUser<\/p>\n<p>\u771f\u6b63\u7684\u7528\u6237\u4e0d\u53ef\u80fd\u6c38\u8fdc\u5728\u7ebf\u3002<\/p>\n<p>\u56e0\u6b64\u5f88\u591a\u7814\u7a76\u4f1a&#xff1a;<\/p>\n<p>LLM<br \/>\n\u2193<br \/>\n\u6a21\u62dfUser<\/p>\n<p>\u4e8e\u662f&#xff1a;<\/p>\n<p>Agent<br \/>\n \u2195<br \/>\nLLM User Simulator<\/p>\n<p>\u95ee\u9898\u6765\u4e86&#xff1a;<\/p>\n<p>LLM\u867d\u7136\u8bed\u8a00\u80fd\u529b\u5f88\u5f3a&#xff0c;\u4f46\u5b83\u771f\u7684\u80fd\u4e00\u76f4\u201c\u6f14\u597d\u4e00\u4e2a\u4eba\u201d\u5417&#xff1f;<\/p>\n<p>\u7b54\u6848\u5f80\u5f80\u662f\u5426\u5b9a\u7684\u3002<\/p>\n<hr \/>\n<h2>4.3 Persona Drift<\/h2>\n<p>\u4f8b\u5982\u7ed9\u6a21\u578b&#xff1a;<\/p>\n<p>\u4f60\u662f\u4e00\u540d\u5bf9\u6570\u5b66\u6ca1\u6709\u5174\u8da3\u7684\u9ad8\u4e2d\u751f\u3002<br \/>\n\u4f60\u5bb3\u6015\u8003\u8bd5\u3002<br \/>\n\u4f60\u66f4\u559c\u6b22\u4f53\u80b2\u3002<\/p>\n<p>\u5f00\u59cb&#xff1a;<\/p>\n<p>User&#xff1a;<br \/>\n\u6211\u771f\u7684\u5f88\u8ba8\u538c\u6570\u5b66\u3002<\/p>\n<p>10\u8f6e\u4ee5\u540e&#xff1a;<\/p>\n<p>User&#xff1a;<br \/>\n\u6211\u6700\u559c\u6b22\u6570\u5b66\u4e86&#xff01;<\/p>\n<p>\u8fd9\u5c31\u662f&#xff1a;<\/p>\n<p>Persona Drift<\/p>\n<p>\u66f4\u4e25\u91cd\u7684\u662f&#xff1a;<\/p>\n<p>Turn 2&#xff1a;<br \/>\n\u6211\u4ece\u6765\u6ca1\u53bb\u8fc7\u7f8e\u56fd\u3002<\/p>\n<p>Turn 15&#xff1a;<br \/>\n\u6211\u53bb\u5e74\u5728\u7ebd\u7ea6\u65c5\u884c\u3002<\/p>\n<p>\u4ea7\u751f&#xff1a;<\/p>\n<p>Self-Contradiction<\/p>\n<hr \/>\n<h2>4.4 \u8bba\u6587\u63d0\u51fa\u4e09\u4e2aConsistency\u6307\u6807<\/h2>\n<p>\u8fd9\u662f\u8fd9\u7bc7\u8bba\u6587\u6700\u503c\u5f97\u501f\u9274\u7684\u5730\u65b9\u3002<\/p>\n<hr \/>\n<h3>\u6307\u6807\u4e00&#xff1a;Prompt-to-Line Consistency<\/h3>\n<p>\u68c0\u67e5&#xff1a;<\/p>\n<p>\u5f53\u524d\u56de\u7b54\u662f\u5426\u7b26\u5408\u6700\u521d\u7684 Persona&#xff1f;<\/p>\n<p>\u5f62\u5f0f\u4e0a&#xff1a;<\/p>\n<p>Persona<br \/>\n \u2193<br \/>\nCurrent Response<br \/>\n \u2193<br \/>\nConsistency<\/p>\n<p>\u4f8b\u5982&#xff1a;<\/p>\n<p>Persona&#xff1a;<br \/>\n\u8ba8\u538c\u6570\u5b66<\/p>\n<p>Response&#xff1a;<br \/>\n\u6211\u5f88\u559c\u6b22\u6570\u5b66\u3002<\/p>\n<p>\u2192 Inconsistent<\/p>\n<hr \/>\n<h3>\u6307\u6807\u4e8c&#xff1a;Line-to-Line Consistency<\/h3>\n<p>\u68c0\u67e5&#xff1a;<\/p>\n<p>\u5f53\u524d\u56de\u7b54\u548c\u8fc7\u53bb\u8bf4\u8fc7\u7684\u8bdd\u662f\u5426\u77db\u76fe&#xff1f;<\/p>\n<p>\u4f8b\u5982&#xff1a;<\/p>\n<p>Turn 3&#xff1a;<br \/>\n\u6211\u6ca1\u6709\u5ba0\u7269\u3002<\/p>\n<p>Turn 15&#xff1a;<br \/>\n\u6211\u7684\u72d7\u4eca\u5929\u751f\u75c5\u4e86\u3002<\/p>\n<p>\u2192 Contradiction<\/p>\n<p>\u5b83\u5173\u6ce8\u7684\u662f&#xff1a;<\/p>\n<p>Past Utterance<br \/>\n      \u2195<br \/>\nCurrent Utterance<\/p>\n<hr \/>\n<h3>\u6307\u6807\u4e09&#xff1a;Q&amp;A Consistency<\/h3>\n<p>\u8fd9\u662f\u975e\u5e38\u6709\u610f\u601d\u7684\u4e00\u79cd\u65b9\u6cd5\u3002<\/p>\n<p>\u7cfb\u7edf\u6839\u636e Persona \u751f\u6210\u4e00\u4e9b\u95ee\u9898&#xff1a;<\/p>\n<p>\u4f60\u6700\u559c\u6b22\u4ec0\u4e48&#xff1f;<br \/>\n\u4f60\u662f\u5426\u559c\u6b22\u6570\u5b66&#xff1f;<br \/>\n\u4f60\u4f4f\u5728\u54ea\u91cc&#xff1f;<\/p>\n<p>\u7136\u540e\u4ece\u5bf9\u8bdd\u4e2d\u63a8\u65ad\u6a21\u578b\u7684\u7b54\u6848&#xff0c;\u518d\u4e0e Persona \u4e2d\u7684\u6b63\u786e\u7b54\u6848\u6bd4\u8f83\u3002<\/p>\n<p>\u4e5f\u5c31\u662f&#xff1a;<\/p>\n<p>Persona<br \/>\n \u2193<br \/>\nReference Answer<\/p>\n<p>Dialogue<br \/>\n \u2193<br \/>\nInferred Answer<\/p>\n<p>Reference<br \/>\n   vs<br \/>\nInferred<\/p>\n<p>\u8fd9\u6837\u53ef\u4ee5\u5224\u65ad\u6a21\u578b\u957f\u671f\u7ef4\u6301\u7684&#xff1a;<\/p>\n<p>Belief<br \/>\nIdentity<br \/>\nPreference<\/p>\n<p>\u662f\u5426\u7a33\u5b9a\u3002<\/p>\n<p>\u76f8\u5173\u65b9\u6cd5\u7ec6\u8282\u548c\u4e09\u4e2a\u6307\u6807\u7684\u5b9a\u4e49\u4e5f\u5728\u8bba\u6587\u9644\u5f55\u4e2d\u8fdb\u884c\u4e86\u8bf4\u660e\u3002<\/p>\n<hr \/>\n<h2>4.5 \u66f4\u5173\u952e\u7684\u4e00\u6b65&#xff1a;\u628aConsistency\u53d8\u6210Reward<\/h2>\n<p>\u8fd9\u7bc7\u8bba\u6587\u6ca1\u6709\u505c\u7559\u5728&#xff1a;<\/p>\n<p>Evaluation<\/p>\n<p>\u800c\u662f&#xff1a;<\/p>\n<p>Consistency Metric<br \/>\n       \u2193<br \/>\nReward<br \/>\n       \u2193<br \/>\nMulti-turn RL<br \/>\n       \u2193<br \/>\nBetter User Simulator<\/p>\n<p>\u4e8e\u662f\u6574\u4e2a\u95ed\u73af&#xff1a;<\/p>\n<p>Persona<br \/>\n \u2193<br \/>\nLLM User Simulator<br \/>\n \u2193<br \/>\nMulti-turn Dialogue<br \/>\n \u2193<br \/>\nConsistency Evaluation<br \/>\n \u2193<br \/>\nReward<br \/>\n \u2193<br \/>\nRL<br \/>\n \u2193<br \/>\nMore Consistent Simulator<\/p>\n<hr \/>\n<h2>4.6 \u5b9e\u9a8c\u4f7f\u7528\u4e86\u4e09\u7c7bUser<\/h2>\n<p>\u8bba\u6587\u8bad\u7ec3\u4e09\u4e2a\u7528\u6237\u89d2\u8272&#xff1a;<\/p>\n<p>Patient<br \/>\nStudent<br \/>\nSocial Chat Partner<\/p>\n<p>\u8fd9\u975e\u5e38\u91cd\u8981&#xff0c;\u56e0\u4e3a\u5982\u679c\u53ea\u9a8c\u8bc1\u4e00\u4e2aPersona&#xff0c;\u5f88\u96be\u8bc1\u660e\u65b9\u6cd5\u5177\u6709\u6cdb\u5316\u6027\u3002<\/p>\n<hr \/>\n<h2>4.7 \u5b9e\u9a8c\u7ed3\u679c<\/h2>\n<p>\u8bba\u6587\u62a5\u544a&#xff1a;<\/p>\n<p>Multi-turn RL \u4f7f Persona inconsistency \u964d\u4f4e\u8d85\u8fc7 55%\u3002<\/p>\n<p>\u5e76\u4e14\u4e09\u4e2aConsistency\u6307\u6807\u90fd\u7ecf\u8fc7\u4e86\u4eba\u5de5\u6807\u6ce8\u9a8c\u8bc1\u3002<\/p>\n<hr \/>\n<h2>4.8 \u548c\u666e\u901aPersona Prompt\u7684\u533a\u522b<\/h2>\n<p>\u4f20\u7edf\u65b9\u6cd5&#xff1a;<\/p>\n<p>System Prompt<br \/>\n&#043;<br \/>\nPersona<br \/>\n\u2193<br \/>\nLLM<\/p>\n<p>\u8fd9\u76f8\u5f53\u4e8e&#xff1a;<\/p>\n<p>\u201c\u544a\u8bc9\u6a21\u578b\u4f60\u662f\u8c01\u3002\u201d<\/p>\n<p>\u672c\u6587&#xff1a;<\/p>\n<p>Persona<br \/>\n \u2193<br \/>\nDialogue<br \/>\n \u2193<br \/>\nConsistency Reward<br \/>\n \u2193<br \/>\nRL<\/p>\n<p>\u76f8\u5f53\u4e8e&#xff1a;<\/p>\n<p>\u201c\u901a\u8fc7\u8bad\u7ec3\u8ba9\u6a21\u578b\u771f\u6b63\u5b66\u4f1a\u6301\u7eed\u4fdd\u6301\u8fd9\u4e2a\u8eab\u4efd\u3002\u201d<\/p>\n<p>\u8fd9\u4e24\u8005\u662f\u5b8c\u5168\u4e0d\u540c\u7684\u3002<\/p>\n<hr \/>\n<h2>5. EvolIF&#xff1a;\u4f20\u7edfMulti-Turn Benchmark\u4e3a\u4ec0\u4e48\u201c\u4e0d\u591f\u771f\u5b9e\u201d&#xff1f;<\/h2>\n<h3>5.1 \u8bba\u6587\u4fe1\u606f<\/h3>\n<p>One Battle After Another: Probing LLMs&#039; Limits on Multi-Turn Instruction Following with a Benchmark Evolving Framework<\/p>\n<p>arXiv: 2511.03508<\/p>\n<p>\u8be5\u5de5\u4f5c\u540e\u6765\u53d1\u8868\u5728 ACL 2026 Long Papers\u3002<\/p>\n<p>ArXiv \u8bba\u6587\u4e3b\u9875<\/p>\n<hr \/>\n<h2>5.2 \u5b83\u89e3\u51b3\u7684\u95ee\u9898<\/h2>\n<p>\u4f20\u7edf\u591a\u8f6eBenchmark\u901a\u5e38\u662f&#xff1a;<\/p>\n<p>Turn 1<br \/>\nTurn 2<br \/>\nTurn 3<br \/>\n&#8230;<br \/>\nTurn N<\/p>\n<p>\u95ee\u9898\u662f&#xff1a;<\/p>\n<p>N\u662f\u63d0\u524d\u89c4\u5b9a\u597d\u7684\u3002<\/p>\n<p>\u4f8b\u5982&#xff1a;<\/p>\n<p>\u6700\u591a10\u8f6e<\/p>\n<p>\u65e0\u8bba\u6a21\u578b\u8868\u73b0\u597d\u4e0d\u597d&#xff1a;<\/p>\n<p>10\u8f6e\u7ed3\u675f<\/p>\n<p>\u8fd9\u548c\u771f\u5b9e\u7528\u6237\u5e76\u4e0d\u4e00\u6837\u3002<\/p>\n<p>\u73b0\u5b9e\u60c5\u51b5\u662f&#xff1a;<\/p>\n<p>\u6a21\u578b\u8868\u73b0\u5f88\u597d<br \/>\n\u2192 \u7528\u6237\u7ee7\u7eed\u804a<\/p>\n<p>\u6a21\u578b\u5f00\u59cb\u72af\u9519<br \/>\n\u2192 \u7528\u6237\u7ea0\u6b63<\/p>\n<p>\u6a21\u578b\u7ee7\u7eed\u72af\u9519<br \/>\n\u2192 \u7528\u6237\u5931\u53bb\u8010\u5fc3<br \/>\n\u2192 \u79bb\u5f00<\/p>\n<p>\u6240\u4ee5&#xff1a;<\/p>\n<p>\u771f\u5b9e\u5bf9\u8bdd\u957f\u5ea6\u53d6\u51b3\u4e8e\u6a21\u578b\u8868\u73b0\u3002<\/p>\n<hr \/>\n<h2>5.3 EvolIF\u7684\u6838\u5fc3\u601d\u60f3<\/h2>\n<p>EvolIF\u63d0\u51fa&#xff1a;<\/p>\n<p>\u8ba9Benchmark\u81ea\u5df1\u201c\u8fdb\u5316\u201d\u3002<\/p>\n<p>\u6838\u5fc3\u7ed3\u6784\u5305\u62ec&#xff1a;<\/p>\n<p>User Intent<br \/>\n      \u2193<br \/>\nConstraint Tracking<br \/>\n      \u2193<br \/>\nInstruction Tracking<br \/>\n      \u2193<br \/>\nTopic Tracking<br \/>\n      \u2193<br \/>\nQuery Synthesis Agent<br \/>\n      \u2193<br \/>\nUser Query<br \/>\n      \u2193<br \/>\nLLM Response<br \/>\n      \u2193<br \/>\nState Update<br \/>\n      \u2193<br \/>\nNext User Query<\/p>\n<p>\u8bba\u6587\u4f7f\u7528\u4e09\u5c42 tracking mechanism \u6765\u8ddf\u8e2a&#xff1a;<\/p>\n<p>Constraints<br \/>\nInstructions<br \/>\nTopics<\/p>\n<p>\u7136\u540e\u52a8\u6001\u751f\u6210\u4e0b\u4e00\u8f6e\u7528\u6237\u884c\u4e3a\u3002<\/p>\n<hr \/>\n<h2>5.4 \u4e3a\u4ec0\u4e48\u53ebEvolving&#xff1f;<\/h2>\n<p>\u56e0\u4e3a&#xff1a;<\/p>\n<p>State_t<br \/>\n \u2193<br \/>\nLLM Response<br \/>\n \u2193<br \/>\nUser Reaction<br \/>\n \u2193<br \/>\nState_{t&#043;1}<br \/>\n \u2193<br \/>\nNew Constraint<br \/>\n \u2193<br \/>\nNew Topic<br \/>\n \u2193<br \/>\nNew Instruction<\/p>\n<p>\u4e5f\u5c31\u662f\u8bf4&#xff1a;<\/p>\n<p>\u4e0b\u4e00\u8f6e\u4e0d\u662f\u63d0\u524d\u5199\u597d\u7684\u3002<\/p>\n<p>\u800c\u662f\u7531\u5f53\u524d\u4ea4\u4e92\u72b6\u6001\u51b3\u5b9a\u3002<\/p>\n<hr \/>\n<h2>5.5 \u6700\u91cd\u8981\u7684\u521b\u65b0&#xff1a;User Patience<\/h2>\n<p>EvolIF\u501f\u9274 Flow Theory&#xff0c;\u5f15\u5165\u7528\u6237\u8010\u5fc3\u7684\u6982\u5ff5\u3002<\/p>\n<p>\u4f20\u7edfBenchmark&#xff1a;<\/p>\n<p>Fixed Turns<\/p>\n<p>EvolIF&#xff1a;<\/p>\n<p>Model performs well<br \/>\n      \u2193<br \/>\nUser continues<\/p>\n<p>Model fails<br \/>\n      \u2193<br \/>\nUser gives correction<\/p>\n<p>Repeated failure<br \/>\n      \u2193<br \/>\nUser patience decreases<\/p>\n<p>Patience exhausted<br \/>\n      \u2193<br \/>\nConversation ends<\/p>\n<p>\u56e0\u6b64&#xff1a;<\/p>\n<p>\u5bf9\u8bdd\u7ec8\u6b62\u6761\u4ef6\u4ece\u201c\u56fa\u5b9aTurn\u6570\u201d\u53d8\u6210\u201c\u7528\u6237\u662f\u5426\u8fd8\u613f\u610f\u7ee7\u7eed\u201d\u3002<\/p>\n<p>\u8fd9\u4e00\u6b65\u975e\u5e38\u63a5\u8fd1\u771f\u5b9eHuman-Agent Interaction\u3002<\/p>\n<hr \/>\n<h2>5.6 \u5b9e\u9a8c\u9a8c\u8bc1\u8def\u7ebf<\/h2>\n<p>EvolIF\u5305\u542b\u591a\u4e2a\u7ea6\u675f\u7c7b\u522b&#xff0c;\u5f53\u524d\u7248\u672c\u8986\u76d6 12\u4e2a constraint groups\u3002<\/p>\n<p>\u8bba\u6587\u6d4b\u8bd5&#xff1a;<\/p>\n<p>GPT-5<br \/>\nGemini-3-Pro<br \/>\nMiniMax-M2<br \/>\nKimi-K2<br \/>\nQwen3-235B<br \/>\nGrok-4-Fast<br \/>\nDeepSeek-V3.2<br \/>\nSeed-1.6<br \/>\nLlama-4-Maverick<br \/>\nMistral-Large-3<\/p>\n<p>\u7ed3\u679c\u4e2d&#xff1a;<\/p>\n<p>GPT-5<br \/>\nRobustness &#061; 66.40%<\/p>\n<p>\u9ad8\u4e8e&#xff1a;<\/p>\n<p>Gemini-3.0-Pro &#061; 60.81%<\/p>\n<p>\u5dee\u8ddd&#xff1a;<\/p>\n<p>5.59 percentage points<\/p>\n<hr \/>\n<h2>5.7 EvolIF\u771f\u6b63\u91cd\u8981\u7684\u5730\u65b9<\/h2>\n<p>\u8fd9\u7bc7\u8bba\u6587\u7684\u4ef7\u503c\u5176\u5b9e\u4e0d\u53ea\u662f&#xff1a;<\/p>\n<p>\u201c\u63d0\u51fa\u4e00\u4e2aBenchmark\u3002\u201d<\/p>\n<p>\u800c\u662f\u63d0\u51fa\u4e00\u79cd\u65b0\u7684\u8bc4\u6d4b\u601d\u60f3&#xff1a;<\/p>\n<h4>Traditional Evaluation<\/h4>\n<p>Input<br \/>\n \u2193<br \/>\nN Turns<br \/>\n \u2193<br \/>\nScore<\/p>\n<h4>EvolIF<\/h4>\n<p>User State<br \/>\n \u2193<br \/>\nInteraction<br \/>\n \u2193<br \/>\nModel Response<br \/>\n \u2193<br \/>\nUser Reaction<br \/>\n \u2193<br \/>\nState Evolution<br \/>\n \u2193<br \/>\nNext Interaction<br \/>\n \u2193<br \/>\n&#8230;<br \/>\n \u2193<br \/>\nUser Patience Exhausted<\/p>\n<p>\u56e0\u6b64\u5b83\u8bc4\u4ef7\u7684\u4e0d\u662f\u5355\u7eaf&#xff1a;<\/p>\n<p>\u201c\u6a21\u578b\u7b2cN\u8f6e\u56de\u7b54\u5f97\u597d\u4e0d\u597d&#xff1f;\u201d<\/p>\n<p>\u800c\u662f&#xff1a;<\/p>\n<p>\u201c\u6a21\u578b\u80fd\u4e0d\u80fd\u8ba9\u7528\u6237\u613f\u610f\u7ee7\u7eed\u548c\u5b83\u4ea4\u4e92&#xff1f;\u201d<\/p>\n<p>\u8fd9\u662f\u591a\u8f6e\u5bf9\u8bdd\u8bc4\u4ef7\u975e\u5e38\u91cd\u8981\u7684\u8f6c\u53d8\u3002<\/p>\n<hr \/>\n<h2>6. FunReason-MT&#xff1a;\u9ad8\u8d28\u91cf\u591a\u8f6eTool-use\u6570\u636e\u5230\u5e95\u600e\u4e48\u6784\u9020&#xff1f;<\/h2>\n<h3>6.1 \u8bba\u6587\u4fe1\u606f<\/h3>\n<p>FunReason-MT Technical Report: Advanced Data Synthesis Solution for Real-world Multi-Turn Tool-use<\/p>\n<p>arXiv: 2510.24645<\/p>\n<p>ArXiv \u8bba\u6587\u4e3b\u9875<\/p>\n<hr \/>\n<h2>6.2 \u5b83\u89e3\u51b3\u4ec0\u4e48\u95ee\u9898&#xff1f;<\/h2>\n<p>\u73b0\u5728\u5f88\u591aAgent\u8bad\u7ec3\u7684\u95ee\u9898\u4e0d\u662f&#xff1a;<\/p>\n<p>\u201c\u6ca1\u6709\u6a21\u578b\u3002\u201d<\/p>\n<p>\u800c\u662f&#xff1a;<\/p>\n<p>\u6ca1\u6709\u8db3\u591f\u597d\u7684\u591a\u8f6e Tool-use \u6570\u636e\u3002<\/p>\n<p>\u4f20\u7edf\u6570\u636e\u751f\u6210&#xff1a;<\/p>\n<p>Random Environment Sampling<\/p>\n<p>\u6216\u8005&#xff1a;<\/p>\n<p>Multi-Agent Role Playing<\/p>\n<p>\u5bb9\u6613\u751f\u6210&#xff1a;<\/p>\n<p>\u7b80\u5355Tool Call<br \/>\n\u7b80\u5355Task<br \/>\n\u4f4e\u903b\u8f91\u4f9d\u8d56<\/p>\n<p>\u4f46\u771f\u5b9e\u4efb\u52a1\u53ef\u80fd\u662f&#xff1a;<\/p>\n<p>User Goal<br \/>\n \u2193<br \/>\nSearch<br \/>\n \u2193<br \/>\nTool Result<br \/>\n \u2193<br \/>\nReason<br \/>\n \u2193<br \/>\nCall Tool B<br \/>\n \u2193<br \/>\nTool Result<br \/>\n \u2193<br \/>\n\u4fee\u6539\u7b56\u7565<br \/>\n \u2193<br \/>\nCall Tool C<br \/>\n \u2193<br \/>\nVerification<br \/>\n \u2193<br \/>\nFinal Answer<\/p>\n<p>\u4e5f\u5c31\u662f\u8bf4&#xff1a;<\/p>\n<p>\u771f\u6b63\u56f0\u96be\u7684\u662fMulti-turn Logical Dependency\u3002<\/p>\n<hr \/>\n<h2>6.3 FunReason-MT\u7684\u4e09\u9636\u6bb5<\/h2>\n<p>\u8bba\u6587\u63d0\u51fa\u4e09\u4e2a\u6838\u5fc3\u7ec4\u4ef6\u3002<\/p>\n<hr \/>\n<h3>\u7b2c\u4e00\u9636\u6bb5&#xff1a;Environment-API Graph Interaction<\/h3>\n<p>\u9996\u5148\u4e0d\u518d\u968f\u673a\u751f\u6210 Tool Call\u3002<\/p>\n<p>\u800c\u662f\u5efa\u7acb&#xff1a;<\/p>\n<p>Environment<br \/>\n       \u2193<br \/>\nAvailable APIs<br \/>\n       \u2193<br \/>\nAPI Graph<\/p>\n<p>\u4f8b\u5982&#xff1a;<\/p>\n<p>Search Flight<br \/>\n      \u2193<br \/>\nGet Flight Detail<br \/>\n      \u2193<br \/>\nBook Flight<br \/>\n      \u2193<br \/>\nPayment<\/p>\n<p>\u8fd9\u6837\u53ef\u4ee5\u4ea7\u751f&#xff1a;<\/p>\n<p>\u6709\u771f\u5b9e\u4f9d\u8d56\u5173\u7cfb\u7684Tool trajectory\u3002<\/p>\n<hr \/>\n<h2>6.4 \u7b2c\u4e8c\u9636\u6bb5&#xff1a;Advanced Tool-Query Synthesis<\/h2>\n<p>\u666e\u901a\u65b9\u6cd5\u53ef\u80fd&#xff1a;<\/p>\n<p>\u968f\u673a\u751f\u6210User Query<\/p>\n<p>\u7ed3\u679c&#xff1a;<\/p>\n<p>Query<br \/>\n\u2193<br \/>\n\u4e00\u4e2aTool<br \/>\n\u2193<br \/>\n\u7ed3\u675f<\/p>\n<p>FunReason-MT\u5e0c\u671b\u6784\u9020&#xff1a;<\/p>\n<p>\u590d\u6742User Goal<br \/>\n \u2193<br \/>\n\u591a\u4e2a\u5de5\u5177<br \/>\n \u2193<br \/>\n\u591a\u4e2a\u4f9d\u8d56<br \/>\n \u2193<br \/>\n\u591a\u8f6e\u4ea4\u4e92<\/p>\n<p>\u56e0\u6b64\u5b83\u4e13\u95e8\u8bbe\u8ba1 Tool-Query Synthesis\u3002<\/p>\n<hr \/>\n<h2>6.5 \u7b2c\u4e09\u9636\u6bb5&#xff1a;Guided Iterative Chain<\/h2>\n<p>\u6700\u7ec8\u8fd8\u9700\u8981\u8ba9\u6a21\u578b\u4ea7\u751f&#xff1a;<\/p>\n<p>Reasoning<br \/>\n&#043;<br \/>\nTool Call<br \/>\n&#043;<br \/>\nTool Result<br \/>\n&#043;<br \/>\nNext Reasoning<\/p>\n<p>\u56e0\u6b64\u91c7\u7528 Guided Iterative Chain&#xff1a;<\/p>\n<p>Goal<br \/>\n \u2193<br \/>\nReason<br \/>\n \u2193<br \/>\nTool Call<br \/>\n \u2193<br \/>\nObservation<br \/>\n \u2193<br \/>\nReason<br \/>\n \u2193<br \/>\nTool Call<br \/>\n \u2193<br \/>\nObservation<br \/>\n \u2193<br \/>\nFinal<\/p>\n<p>\u6700\u7ec8\u5f62\u6210\u9ad8\u8d28\u91cf Multi-turn Agent Trajectory\u3002<\/p>\n<hr \/>\n<h2>6.6 \u6570\u636e\u751f\u6210\u6574\u4f53Pipeline<\/h2>\n<p>\u53ef\u4ee5\u603b\u7ed3\u6210&#xff1a;<\/p>\n<p>Real-world Environment<br \/>\n        \u2502<br \/>\n        \u2193<br \/>\nEnvironment-API Graph<br \/>\n        \u2502<br \/>\n        \u2193<br \/>\nTargeted Tool Trajectories<br \/>\n        \u2502<br \/>\n        \u2193<br \/>\nAdvanced Tool-Query Synthesis<br \/>\n        \u2502<br \/>\n        \u2193<br \/>\nHard Multi-turn Query<br \/>\n        \u2502<br \/>\n        \u2193<br \/>\nGuided Iterative Chain<br \/>\n        \u2502<br \/>\n        \u2193<br \/>\nReasoning &#043; Tool Calls<br \/>\n        \u2502<br \/>\n        \u2193<br \/>\nQuality Filtering<br \/>\n        \u2502<br \/>\n        \u2193<br \/>\nTraining Dataset<br \/>\n        \u2502<br \/>\n        \u2193<br \/>\nRL \/ SFT<br \/>\n        \u2502<br \/>\n        \u2193<br \/>\nAgent Model<\/p>\n<hr \/>\n<h2>6.7 \u5b9e\u9a8c\u9a8c\u8bc1<\/h2>\n<p>\u8bba\u6587\u4f7f\u7528&#xff1a;<\/p>\n<p>Berkeley Function-Calling Leaderboard&#xff08;BFCL&#xff09;<\/p>\n<p>\u8fdb\u884c\u9a8c\u8bc1\u3002<\/p>\n<p>\u4e00\u4e2a\u975e\u5e38\u6709\u4ee3\u8868\u6027\u7684\u7ed3\u679c&#xff1a;<\/p>\n<p>Qwen3-4B<br \/>\nBFCLv3 Multi-turn &#061; 15.75<\/p>\n<p>\u52a0\u5165 FunReason-MT \u8bad\u7ec3\u540e&#xff1a;<\/p>\n<p>Qwen3-4B &#043; FunReason-MT<br \/>\n\u2248 57.75<\/p>\n<p>\u5728\u4f5c\u8005\u5f53\u524d\u516c\u5f00\u6a21\u578b\u7ed3\u679c\u4e2d&#xff0c;4B\u6a21\u578b\u7684\u591a\u8f6e\u6027\u80fd\u5df2\u7ecf\u8d85\u8fc7\u90e8\u5206\u66f4\u5927\u6a21\u578b&#xff1b;\u540c\u65f6\u5728 BFCLv4 OOD Agentic Evaluation \u4e0a\u4e5f\u8868\u73b0\u7a81\u51fa\u3002<\/p>\n<hr \/>\n<h2>6.8 \u4e3a\u4ec0\u4e48\u8fd9\u7bc7\u8bba\u6587\u503c\u5f97\u5173\u6ce8&#xff1f;<\/h2>\n<p>\u56e0\u4e3a\u5b83\u8bf4\u660e&#xff1a;<\/p>\n<p>\u591a\u8f6eAgent\u80fd\u529b\u4e0d\u4ec5\u53d6\u51b3\u4e8e\u6a21\u578bArchitecture&#xff0c;\u8fd8\u9ad8\u5ea6\u53d6\u51b3\u4e8e\u8bad\u7ec3\u6570\u636e\u4e2d\u662f\u5426\u771f\u6b63\u5b58\u5728\u201c\u591a\u8f6e\u903b\u8f91\u201d\u3002<\/p>\n<p>\u5982\u679c\u8bad\u7ec3\u6570\u636e\u53ea\u662f&#xff1a;<\/p>\n<p>User<br \/>\n \u2193<br \/>\nTool<br \/>\n \u2193<br \/>\nAnswer<\/p>\n<p>\u6a21\u578b\u5f88\u96be\u5b66\u4f1a&#xff1a;<\/p>\n<p>Goal<br \/>\n \u2193<br \/>\nPlan<br \/>\n \u2193<br \/>\nTool<br \/>\n \u2193<br \/>\nObservation<br \/>\n \u2193<br \/>\nRe-plan<br \/>\n \u2193<br \/>\nTool<br \/>\n \u2193<br \/>\nVerification<\/p>\n<p>\u800c\u8fd9\u6070\u6070\u662f Agent \u4e0e\u666e\u901a Chatbot \u7684\u6838\u5fc3\u533a\u522b\u3002<\/p>\n<hr \/>\n<h2>7. \u516d\u7bc7\u8bba\u6587\u653e\u5728\u4e00\u8d77&#xff0c;\u5230\u5e95\u6709\u4ec0\u4e48\u5173\u7cfb&#xff1f;<\/h2>\n<p>\u73b0\u5728\u628a\u516d\u7bc7\u8bba\u6587\u653e\u5728\u540c\u4e00\u5f20\u56fe\u91cc&#xff1a;<\/p>\n<p>                  Multi-Turn Agent<br \/>\n                        \u2502<br \/>\n        \u250c\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u253c\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2510<br \/>\n        \u2502               \u2502                \u2502<br \/>\n        \u2193               \u2193                \u2193<br \/>\n      Data            Memory            RL<br \/>\n        \u2502               \u2502                \u2502<br \/>\n        \u2193               \u2193                \u2193<br \/>\n FunReason-MT        Rhea              GTPO<br \/>\n        \u2502               \u2502                \u2502<br \/>\n        \u2502               \u2193                \u2193<br \/>\n        \u2502             Context          Turn-level<br \/>\n        \u2502             Memory           Reward<br \/>\n        \u2502               \u2502                \u2502<br \/>\n        \u2514\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2510       \u2502       \u250c\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2518<br \/>\n                \u2193       \u2193       \u2193<br \/>\n             H-EPM<br \/>\n                \u2502<br \/>\n                \u2193<br \/>\n       Experience Reuse<br \/>\n                \u2502<br \/>\n                \u2193<br \/>\n        Long-horizon Agent<br \/>\n                \u2502<br \/>\n                \u251c\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2510<br \/>\n                \u2193               \u2193<br \/>\n        Human Simulator      Evaluation<br \/>\n                \u2502               \u2502<br \/>\n                \u2193               \u2193<br \/>\n          Persona RL          EvolIF<br \/>\n                \u2502               \u2502<br \/>\n                \u2514\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u252c\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2518<br \/>\n                        \u2193<br \/>\n               Multi-turn System<\/p>\n<hr \/>\n<h2>8. \u516d\u7bc7\u8bba\u6587\u6700\u6838\u5fc3\u7684\u5dee\u5f02<\/h2>\n<table>\n<tr>\u8bba\u6587\u4e3b\u8981\u89e3\u51b3\u95ee\u9898\u6838\u5fc3\u5bf9\u8c61\u65b9\u6cd5\u5173\u952e\u8bcd\u9a8c\u8bc1\u91cd\u70b9<\/tr>\n<tbody>\n<tr>\n<td>H-EPM<\/td>\n<td>\u5386\u53f2\u7ecf\u9a8c\u65e0\u6cd5\u590d\u7528<\/td>\n<td>Agent Memory<\/td>\n<td>Episodic &#043; Procedural<\/td>\n<td>Tool-use \/ OOD<\/td>\n<\/tr>\n<tr>\n<td>Rhea<\/td>\n<td>Context\u9010\u6e10\u8870\u51cf<\/td>\n<td>Conversation Memory<\/td>\n<td>Instruction &#043; Episodic<\/td>\n<td>Long Dialogue<\/td>\n<\/tr>\n<tr>\n<td>GTPO<\/td>\n<td>RL Reward\u592a\u7c97<\/td>\n<td>RL Training<\/td>\n<td>Turn-level Reward<\/td>\n<td>Multi-turn TIR<\/td>\n<\/tr>\n<tr>\n<td>Persona RL<\/td>\n<td>\u4eba\u7c7b\u6a21\u62df\u5668Persona\u6f02\u79fb<\/td>\n<td>User Simulator<\/td>\n<td>Consistency Reward<\/td>\n<td>Persona Consistency<\/td>\n<\/tr>\n<tr>\n<td>EvolIF<\/td>\n<td>Benchmark\u4e0d\u771f\u5b9e<\/td>\n<td>Evaluation<\/td>\n<td>Evolving User<\/td>\n<td>Long-horizon IF<\/td>\n<\/tr>\n<tr>\n<td>FunReason-MT<\/td>\n<td>\u7f3a\u4e4f\u9ad8\u8d28\u91cf\u6570\u636e<\/td>\n<td>Training Data<\/td>\n<td>API Graph &#043; Synthesis<\/td>\n<td>BFCL<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<hr \/>\n<h2>9. \u4e00\u4e2a\u975e\u5e38\u91cd\u8981\u7684\u7814\u7a76\u8d8b\u52bf&#xff1a;\u4eceContext\u8d70\u5411State<\/h2>\n<p>\u5982\u679c\u628a\u8fd9\u4e9b\u8bba\u6587\u653e\u5728\u65f6\u95f4\u7ebf\u4e0a&#xff0c;\u4f1a\u53d1\u73b0\u4e00\u4e2a\u975e\u5e38\u660e\u663e\u7684\u53d8\u5316\u3002<\/p>\n<p>\u65e9\u671f&#xff1a;<\/p>\n<p>Conversation History<\/p>\n<p>\u7814\u7a76\u91cd\u70b9&#xff1a;<\/p>\n<p>\u5982\u4f55\u8ba9\u6a21\u578b\u770b\u66f4\u591a\u5386\u53f2&#xff1f;<\/p>\n<p>\u968f\u540e&#xff1a;<\/p>\n<p>Memory<\/p>\n<p>\u7814\u7a76\u91cd\u70b9&#xff1a;<\/p>\n<p>\u54ea\u4e9b\u5386\u53f2\u5e94\u8be5\u4fdd\u5b58&#xff1f;<\/p>\n<p>\u8fdb\u4e00\u6b65&#xff1a;<\/p>\n<p>Structured Memory<\/p>\n<p>\u7814\u7a76\u91cd\u70b9&#xff1a;<\/p>\n<p>\u4e0d\u540c\u5386\u53f2\u4fe1\u606f\u5e94\u8be5\u627f\u62c5\u4ec0\u4e48\u529f\u80fd&#xff1f;<\/p>\n<p>\u518d\u8fdb\u4e00\u6b65&#xff1a;<\/p>\n<p>State Evolution<\/p>\n<p>\u7814\u7a76\u91cd\u70b9&#xff1a;<\/p>\n<p>\u5f53\u524d\u7528\u6237\u72b6\u6001\u3001\u4efb\u52a1\u72b6\u6001\u3001\u73af\u5883\u72b6\u6001\u53d1\u751f\u4e86\u4ec0\u4e48\u53d8\u5316&#xff1f;<\/p>\n<p>\u6700\u7ec8&#xff1a;<\/p>\n<p>State<br \/>\n \u2193<br \/>\nAction<br \/>\n \u2193<br \/>\nEnvironment<br \/>\n \u2193<br \/>\nObservation<br \/>\n \u2193<br \/>\nState Update<br \/>\n \u2193<br \/>\nAction<br \/>\n&#8230;<\/p>\n<p>\u8fd9\u5b9e\u9645\u4e0a\u5df2\u7ecf\u8d8a\u6765\u8d8a\u63a5\u8fd1&#xff1a;<\/p>\n<p>Reinforcement Learning \/ Agentic Interaction<\/p>\n<hr \/>\n<h2>10. \u5bf9\u201c\u591a\u8f6e\u5bf9\u8bdd\u6a21\u578b\u201d\u7814\u7a76\u6700\u91cd\u8981\u7684\u542f\u53d1<\/h2>\n<p>\u5982\u679c\u4f60\u7684\u7814\u7a76\u76ee\u6807\u662f&#xff1a;<\/p>\n<p>\u4efb\u52a1\u5bfc\u5411\u7684\u591a\u8f6e\u5bf9\u8bdd\u6a21\u578b \/ \u591a\u8f6e\u4ea4\u4e92Agent<\/p>\n<p>\u90a3\u4e48\u8fd9 6 \u7bc7\u8bba\u6587\u53ef\u4ee5\u63d0\u4f9b\u4e00\u4e2a\u975e\u5e38\u5b8c\u6574\u7684\u7814\u7a76\u6846\u67b6\u3002<\/p>\n<hr \/>\n<h3>10.1 \u7b2c\u4e00\u5c42&#xff1a;User Simulator<\/h3>\n<p>\u9996\u5148\u9700\u8981\u89e3\u51b3&#xff1a;<\/p>\n<p>\u8c01\u548cAgent\u5bf9\u8bdd&#xff1f;<\/p>\n<p>\u53ef\u4ee5\u53c2\u8003&#xff1a;<\/p>\n<p>Persona RL<\/p>\n<p>\u6784\u5efa&#xff1a;<\/p>\n<p>User Persona<br \/>\n&#043;<br \/>\nUser Goal<br \/>\n&#043;<br \/>\nUser State<br \/>\n&#043;<br \/>\nDialogue History<\/p>\n<p>\u5e76\u4e14\u901a\u8fc7&#xff1a;<\/p>\n<p>Prompt-to-Line<br \/>\nLine-to-Line<br \/>\nQ&amp;A Consistency<\/p>\n<p>\u4fdd\u8bc1\u6a21\u62df\u7528\u6237\u4e0d\u4f1a\u968f\u5bf9\u8bdd\u53d1\u751f\u4e25\u91cd\u6f02\u79fb\u3002<\/p>\n<hr \/>\n<h2>10.2 \u7b2c\u4e8c\u5c42&#xff1a;Conversation State<\/h2>\n<p>\u7136\u540e\u89e3\u51b3&#xff1a;<\/p>\n<p>Agent\u5230\u5e95\u5e94\u8be5\u8bb0\u4f4f\u4ec0\u4e48&#xff1f;<\/p>\n<p>\u53ef\u4ee5\u53c2\u8003&#xff1a;<\/p>\n<p>Rhea<\/p>\n<p>\u628a\u5386\u53f2\u62c6\u6210&#xff1a;<\/p>\n<p>Global Instruction<br \/>\nTask State<br \/>\nUser Preference<br \/>\nRecent Episode<\/p>\n<p>\u800c\u4e0d\u662f\u7b80\u5355&#xff1a;<\/p>\n<p>\u5168\u90e8Conversation History<\/p>\n<hr \/>\n<h2>10.3 \u7b2c\u4e09\u5c42&#xff1a;Experience Memory<\/h2>\n<p>\u8fdb\u4e00\u6b65\u89e3\u51b3&#xff1a;<\/p>\n<p>\u4ee5\u524d\u505a\u8fc7\u7c7b\u4f3c\u4efb\u52a1\u600e\u4e48\u529e&#xff1f;<\/p>\n<p>\u53ef\u4ee5\u53c2\u8003&#xff1a;<\/p>\n<p>H-EPM<\/p>\n<p>\u6784\u5efa&#xff1a;<\/p>\n<p>Episodic Memory<br \/>\n&#043;<br \/>\nProcedural Memory<\/p>\n<p>\u8ba9\u6a21\u578b\u5b66\u4e60&#xff1a;<\/p>\n<p>\u8fc7\u53bb\u505a\u8fc7\u4ec0\u4e48<br \/>\n&#043;<br \/>\n\u8fc7\u53bb\u4e3a\u4ec0\u4e48\u8fd9\u4e48\u505a<br \/>\n&#043;<br \/>\n\u54ea\u4e9b\u884c\u4e3a\u53ef\u4ee5\u6cdb\u5316<\/p>\n<hr \/>\n<h2>10.4 \u7b2c\u56db\u5c42&#xff1a;Policy Learning<\/h2>\n<p>\u5982\u679c\u8fdb\u4e00\u6b65\u4f7f\u7528 RL&#xff1a;<\/p>\n<p>\u4e00\u4e2a\u5b8c\u6574Trajectory\u6700\u7ec8\u6210\u529f&#xff0c;\u4f46\u5230\u5e95\u54ea\u4e00\u6b65\u8d21\u732e\u6700\u5927&#xff1f;<\/p>\n<p>\u53c2\u8003&#xff1a;<\/p>\n<p>GTPO<\/p>\n<p>\u628a&#xff1a;<\/p>\n<p>Trajectory Reward<\/p>\n<p>\u8fdb\u4e00\u6b65\u53d8\u6210&#xff1a;<\/p>\n<p>Turn-level Reward<\/p>\n<p>\u8fd9\u6837\u5c31\u53ef\u4ee5\u7814\u7a76&#xff1a;<\/p>\n<p>Turn 1<br \/>\nTurn 2<br \/>\nTurn 3<br \/>\n&#8230;<\/p>\n<p>\u6bcf\u4e00\u6b65\u7684\u7b56\u7565\u5b66\u4e60\u3002<\/p>\n<hr \/>\n<h2>10.5 \u7b2c\u4e94\u5c42&#xff1a;Training Data<\/h2>\n<p>\u7136\u540e\u9700\u8981\u5927\u91cf\u8bad\u7ec3\u6570\u636e\u3002<\/p>\n<p>\u53c2\u8003&#xff1a;<\/p>\n<p>FunReason-MT<\/p>\n<p>\u6784\u9020&#xff1a;<\/p>\n<p>Goal<br \/>\n \u2193<br \/>\nUser Query<br \/>\n \u2193<br \/>\nAgent Reasoning<br \/>\n \u2193<br \/>\nTool<br \/>\n \u2193<br \/>\nObservation<br \/>\n \u2193<br \/>\nNext User Query<br \/>\n \u2193<br \/>\nAgent Reasoning<br \/>\n \u2193<br \/>\nTool<br \/>\n \u2193<br \/>\nFinal<\/p>\n<p>\u771f\u6b63\u5f62\u6210&#xff1a;<\/p>\n<p>\u591a\u8f6e\u903b\u8f91\u4f9d\u8d56\u3002<\/p>\n<hr \/>\n<h2>10.6 \u7b2c\u516d\u5c42&#xff1a;Evaluation<\/h2>\n<p>\u6700\u540e\u4e0d\u80fd\u53ea\u770b&#xff1a;<\/p>\n<p>Final Answer Accuracy<\/p>\n<p>\u800c\u5e94\u8be5\u50cf EvolIF \u4e00\u6837\u8003\u8651&#xff1a;<\/p>\n<p>Task Completion<br \/>\n&#043;<br \/>\nInstruction Following<br \/>\n&#043;<br \/>\nContext Consistency<br \/>\n&#043;<br \/>\nRecovery<br \/>\n&#043;<br \/>\nUser Satisfaction<br \/>\n&#043;<br \/>\nInteraction Length<br \/>\n&#043;<br \/>\nRobustness<\/p>\n<p>\u4e5f\u5c31\u662f&#xff1a;<\/p>\n<p>\u4ece\u201c\u8bc4\u4ef7\u7b54\u6848\u201d\u8f6c\u5411\u201c\u8bc4\u4ef7\u6574\u4e2a\u4ea4\u4e92\u8fc7\u7a0b\u201d\u3002<\/p>\n<hr \/>\n<h2>11. \u5982\u679c\u628a\u8fd96\u7bc7\u8bba\u6587\u8fdb\u4e00\u6b65\u62bd\u8c61&#xff0c;\u53ef\u4ee5\u5f97\u5230\u4e00\u4e2a\u7814\u7a76\u95ed\u73af<\/h2>\n<p>\u6700\u7ec8\u53ef\u4ee5\u5f97\u5230\u8fd9\u6837\u4e00\u4e2a\u5b8c\u6574\u67b6\u6784&#xff1a;<\/p>\n<p>                  \u250c\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2510<br \/>\n                  \u2502    User Simulator   \u2502<br \/>\n                  \u2502    Persona &#043; Goal   \u2502<br \/>\n                  \u2514\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u252c\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2518<br \/>\n                             \u2502<br \/>\n                             \u2193<br \/>\n                    Multi-turn Dialogue<br \/>\n                             \u2502<br \/>\n                             \u2193<br \/>\n                  \u250c\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2510<br \/>\n                  \u2502   State Manager     \u2502<br \/>\n                  \u2502 Instruction Memory  \u2502<br \/>\n                  \u2502 Episodic Memory     \u2502<br \/>\n                  \u2502 Task State          \u2502<br \/>\n                  \u2514\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u252c\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2518<br \/>\n                             \u2502<br \/>\n                             \u2193<br \/>\n                     Agent Reasoning<br \/>\n                             \u2502<br \/>\n                             \u2193<br \/>\n                    Tool \/ Environment<br \/>\n                             \u2502<br \/>\n                             \u2193<br \/>\n                       Observation<br \/>\n                             \u2502<br \/>\n                             \u2193<br \/>\n                     State Evolution<br \/>\n                             \u2502<br \/>\n                             \u2193<br \/>\n                    Next User Turn<br \/>\n                             \u2502<br \/>\n                             \u2193<br \/>\n                         Reward<br \/>\n                             \u2502<br \/>\n                             \u2193<br \/>\n                    Turn-level RL<br \/>\n                             \u2502<br \/>\n                             \u2193<br \/>\n                     Better Policy<br \/>\n                             \u2502<br \/>\n                             \u2193<br \/>\n                    Experience Memory<br \/>\n                             \u2502<br \/>\n                             \u2514\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2192 \u4e0b\u4e00\u6b21\u4efb\u52a1<\/p>\n<p>\u7136\u540e\u5916\u90e8\u518d\u5957\u4e00\u4e2a&#xff1a;<\/p>\n<p>             \u250c\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2510<br \/>\n             \u2502     EvolIF-style     \u2502<br \/>\n             \u2502  Multi-turn Eval     \u2502<br \/>\n             \u2514\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u252c\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2518<br \/>\n                        \u2193<br \/>\n          Long-horizon Interaction Score<\/p>\n<p>\u8fd9\u5df2\u7ecf\u975e\u5e38\u63a5\u8fd1\u4e00\u4e2a\u5b8c\u6574\u7684&#xff1a;<\/p>\n<p>Self-evolving Multi-turn Agent<\/p>\n<hr \/>\n<h2>12. \u6700\u503c\u5f97\u5173\u6ce8\u7684\u4e09\u4e2a\u7814\u7a76\u7a7a\u767d<\/h2>\n<p>\u9605\u8bfb\u8fd9\u516d\u7bc7\u8bba\u6587\u4e4b\u540e&#xff0c;\u6211\u8ba4\u4e3a\u8fd8\u6709\u4e09\u4e2a\u660e\u663e\u7684\u7814\u7a76\u7a7a\u95f4\u3002<\/p>\n<h3>12.1 Memory\u548cUser State\u8fd8\u6ca1\u6709\u771f\u6b63\u7edf\u4e00<\/h3>\n<p>\u73b0\u5728&#xff1a;<\/p>\n<p>Rhea<br \/>\n\u2192 Conversation Memory<\/p>\n<p>H-EPM<br \/>\n\u2192 Tool Experience Memory<\/p>\n<p>Persona RL<br \/>\n\u2192 Persona Consistency<\/p>\n<p>\u4f46\u771f\u6b63\u7684\u4eba\u7c7b\u7528\u6237\u72b6\u6001\u5e94\u8be5\u662f&#xff1a;<\/p>\n<p>User Persona<br \/>\n&#043;<br \/>\nUser Goal<br \/>\n&#043;<br \/>\nUser Preference<br \/>\n&#043;<br \/>\nEmotion<br \/>\n&#043;<br \/>\nKnowledge<br \/>\n&#043;<br \/>\nDialogue History<br \/>\n&#043;<br \/>\nTask Progress<\/p>\n<p>\u5982\u4f55\u628a\u8fd9\u4e9b\u7edf\u4e00\u6210&#xff1a;<\/p>\n<p>Structured User State<\/p>\n<p>\u4ecd\u7136\u503c\u5f97\u7814\u7a76\u3002<\/p>\n<hr \/>\n<h2>12.2 \u201c\u7528\u6237\u6a21\u62df\u5668\u201d\u4e0e\u201c\u8bc4\u4f30\u5668\u201d\u53ef\u4ee5\u8fdb\u4e00\u6b65\u7edf\u4e00<\/h2>\n<p>\u73b0\u5728&#xff1a;<\/p>\n<p>Persona Simulator<\/p>\n<p>\u8d1f\u8d23\u751f\u6210User\u3002<\/p>\n<p>\u800c&#xff1a;<\/p>\n<p>EvolIF<\/p>\n<p>\u8d1f\u8d23\u8bc4\u4f30Interaction\u3002<\/p>\n<p>\u4e00\u4e2a\u66f4\u8fdb\u4e00\u6b65\u7684\u65b9\u5411\u662f&#xff1a;<\/p>\n<p>User Simulator<br \/>\n      \u2193<br \/>\nInteraction<br \/>\n      \u2193<br \/>\nUser Satisfaction<br \/>\n      \u2193<br \/>\nState Update<br \/>\n      \u2193<br \/>\nNext Turn<\/p>\n<p>\u8ba9 User Simulator \u672c\u8eab\u6210\u4e3a&#xff1a;<\/p>\n<p>Dynamic Evaluator<\/p>\n<p>\u8fd9\u6837\u5c31\u4e0d\u9700\u8981\u4eba\u4e3a\u89c4\u5b9a\u56fa\u5b9a10\u8f6e\u300120\u8f6e\u3002<\/p>\n<hr \/>\n<h2>12.3 \u591a\u8f6e\u5bf9\u8bdd\u7684Reward\u4ecd\u7136\u975e\u5e38\u503c\u5f97\u7814\u7a76<\/h2>\n<p>GTPO\u89e3\u51b3\u4e86&#xff1a;<\/p>\n<p>Trajectory Reward<br \/>\n\u2193<br \/>\nTurn Reward<\/p>\n<p>\u4f46\u4e00\u4e2a\u771f\u6b63\u590d\u6742\u7684\u591a\u8f6e\u4efb\u52a1\u53ef\u80fd\u8fd8\u9700\u8981&#xff1a;<\/p>\n<p>Turn Reward<br \/>\n&#043;<br \/>\nTask Progress<br \/>\n&#043;<br \/>\nUser Satisfaction<br \/>\n&#043;<br \/>\nInstruction Following<br \/>\n&#043;<br \/>\nPersona Consistency<br \/>\n&#043;<br \/>\nRecovery<br \/>\n&#043;<br \/>\nTool Efficiency<\/p>\n<p>\u56e0\u6b64\u672a\u6765\u5f88\u53ef\u80fd\u4ece&#xff1a;<\/p>\n<p>Turn-level Reward<\/p>\n<p>\u7ee7\u7eed\u53d1\u5c55\u5230&#xff1a;<\/p>\n<p>Multi-objective Interaction Reward<\/p>\n<p>\u4f8b\u5982&#xff1a;<\/p>\n<p>[ R_t &#061; \\\\lambda_1 R_{\\\\text{task}} &#043; \\\\lambda_2 R_{\\\\text{user}} &#043; \\\\lambda_3 R_{\\\\text{instruction}} &#043; \\\\lambda_4 R_{\\\\text{consistency}} &#043; \\\\lambda_5 R_{\\\\text{efficiency}} ]<\/p>\n<p>\u6700\u7ec8\u8bad\u7ec3\u7684\u5c31\u4e0d\u518d\u662f\u7b80\u5355&#xff1a;<\/p>\n<p>\u201c\u56de\u7b54\u6b63\u786e\u7684\u6a21\u578b\u201d\u3002<\/p>\n<p>\u800c\u662f&#xff1a;<\/p>\n<p>\u80fd\u591f\u6301\u7eed\u5b8c\u6210\u4efb\u52a1\u3001\u7406\u89e3\u7528\u6237\u72b6\u6001\u3001\u4fdd\u6301\u4e00\u81f4\u6027\u3001\u53ca\u65f6\u6062\u590d\u9519\u8bef&#xff0c;\u5e76\u4e14\u8ba9\u7528\u6237\u613f\u610f\u7ee7\u7eed\u4ea4\u4e92\u7684\u6a21\u578b\u3002<\/p>\n<hr \/>\n<h2>13. \u6700\u7ec8\u603b\u7ed3&#xff1a;\u8fd96\u7bc7\u8bba\u6587\u5206\u522b\u5728\u8865\u54ea\u4e00\u5757&#xff1f;<\/h2>\n<p>\u53ef\u4ee5\u7528\u4e00\u53e5\u8bdd\u6982\u62ec&#xff1a;<\/p>\n<h4>FunReason-MT<\/h4>\n<p>\u89e3\u51b3\u201c\u6ca1\u6709\u597d\u7684\u591a\u8f6e\u8bad\u7ec3\u6570\u636e\u201d\u3002<\/p>\n<h4>Persona RL<\/h4>\n<p>\u89e3\u51b3\u201cUser Simulator\u4e0d\u80fd\u4e00\u76f4\u4fdd\u6301\u81ea\u5df1\u662f\u8c01\u201d\u3002<\/p>\n<h4>Rhea<\/h4>\n<p>\u89e3\u51b3\u201cConversation\u8d8a\u957f&#xff0c;\u91cd\u8981\u4fe1\u606f\u8d8a\u5bb9\u6613\u88ab\u6df9\u6ca1\u201d\u3002<\/p>\n<h4>H-EPM<\/h4>\n<p>\u89e3\u51b3\u201c\u8fc7\u53bb\u6210\u529f\u7ecf\u9a8c\u65e0\u6cd5\u6709\u6548\u8fc1\u79fb\u5230\u65b0\u4efb\u52a1\u201d\u3002<\/p>\n<h4>GTPO<\/h4>\n<p>\u89e3\u51b3\u201c\u591a\u8f6eRL\u53ea\u77e5\u9053\u6700\u7ec8\u6210\u529f&#xff0c;\u5374\u4e0d\u77e5\u9053\u54ea\u4e00\u6b65\u505a\u5f97\u597d\u201d\u3002<\/p>\n<h4>EvolIF<\/h4>\n<p>\u89e3\u51b3\u201c\u4f20\u7edfBenchmark\u65e0\u6cd5\u771f\u6b63\u6a21\u62df\u957f\u671f\u4eba\u673a\u4ea4\u4e92\u201d\u3002<\/p>\n<p>\u56e0\u6b64&#xff0c;\u8fd9\u516d\u7bc7\u8bba\u6587\u5171\u540c\u63ed\u793a\u4e86\u4e00\u4e2a\u975e\u5e38\u91cd\u8981\u7684\u8d8b\u52bf&#xff1a;<\/p>\n<p>\u672a\u6765\u7684\u591a\u8f6e\u5bf9\u8bdd\u7814\u7a76&#xff0c;\u6838\u5fc3\u7ade\u4e89\u529b\u53ef\u80fd\u4e0d\u518d\u662f\u5355\u7eaf\u7684Context Length&#xff0c;\u800c\u662f\u6a21\u578b\u80fd\u5426\u5f62\u6210\u201c\u72b6\u6001\u2014\u8bb0\u5fc6\u2014\u884c\u52a8\u2014\u53cd\u9988\u2014\u7ecf\u9a8c\u201d\u7684\u95ed\u73af\u3002<\/p>\n<p>\u4ece&#xff1a;<\/p>\n<p>Context \u2192 Response<\/p>\n<p>\u9010\u6e10\u6f14\u5316\u4e3a&#xff1a;<\/p>\n<p>State<br \/>\n \u2193<br \/>\nMemory<br \/>\n \u2193<br \/>\nReasoning<br \/>\n \u2193<br \/>\nAction<br \/>\n \u2193<br \/>\nEnvironment<br \/>\n \u2193<br \/>\nObservation<br \/>\n \u2193<br \/>\nUser Feedback<br \/>\n \u2193<br \/>\nReward<br \/>\n \u2193<br \/>\nLearning<br \/>\n \u2193<br \/>\nUpdated State<\/p>\n<p>\u8fd9\u4e5f\u662f\u4ece Chatbot \u2192 Agent \u2192 Continual Interactive Agent \u7684\u5173\u952e\u4e00\u6b65\u3002<\/p>\n<hr \/>\n<h3>14. \u516d\u7bc7\u8bba\u6587\u94fe\u63a5\u6c47\u603b<\/h3>\n<li>\n<p>H-EPM \u2014 Experience-Evolving Multi-Turn Tool-Use Agent with Hybrid Episodic-Procedural Memory ArXiv 2512.07287<\/p>\n<\/li>\n<li>\n<p>Rhea \u2014 Role-aware Heuristic Episodic Attention for Conversational LLMs ArXiv 2512.06869<\/p>\n<\/li>\n<li>\n<p>GTPO \u2014 Empowering Multi-Turn Tool-Integrated Agentic Reasoning with Group Turn Policy Optimization ArXiv 2511.14846<\/p>\n<\/li>\n<li>\n<p>One Battle After Another \/ EvolIF ArXiv 2511.03508<\/p>\n<\/li>\n<li>\n<p>Consistently Simulating Human Personas with Multi-Turn Reinforcement Learning ArXiv 2511.00222<\/p>\n<\/li>\n<li>\n<p>FunReason-MT \u2014 Advanced Data Synthesis Solution for Real-world Multi-Turn Tool-use ArXiv 2510.24645<\/p>\n<\/li>\n<hr \/>\n<h3>15. \u4e00\u5f20\u56fe\u8bb0\u4f4f\u6574\u4e2a\u7814\u7a76\u65b9\u5411<\/h3>\n<p>                    \u591a\u8f6e\u5bf9\u8bdd \/ Agent<br \/>\n                           \u2502<br \/>\n          \u250c\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u253c\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2510<br \/>\n          \u2193                \u2193                \u2193<br \/>\n       \u6570\u636e\u6784\u9020           Memory             RL<br \/>\n          \u2502                \u2502                \u2502<br \/>\n    FunReason-MT       Rhea \/ H-EPM        GTPO<br \/>\n          \u2502                \u2502                \u2502<br \/>\n          \u2514\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u253c\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2518<br \/>\n                           \u2193<br \/>\n                   Long-horizon Agent<br \/>\n                           \u2502<br \/>\n                \u250c\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2534\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2510<br \/>\n                \u2193                     \u2193<br \/>\n           User Simulator         Evaluation<br \/>\n                \u2502                     \u2502<br \/>\n          Persona RL                EvolIF<br \/>\n                \u2502                     \u2502<br \/>\n                \u2514\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u252c\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2518<br \/>\n                           \u2193<br \/>\n                Self-Evolving Agent<br \/>\n                           \u2193<br \/>\n       State \u2192 Memory \u2192 Action \u2192 Feedback<br \/>\n              \u2191                       \u2193<br \/>\n              \u2514\u2500\u2500\u2500\u2500\u2500\u2500 Learning \u2500\u2500\u2500\u2500\u2500\u2500\u2500\u2518<\/p>\n<p>\u5982\u679c\u4ece\u79d1\u7814\u9009\u9898\u89d2\u5ea6\u770b&#xff0c;\u6700\u503c\u5f97\u7ee7\u7eed\u6df1\u5165\u7684\u5e76\u4e0d\u662f\u5355\u72ec\u590d\u73b0\u5176\u4e2d\u67d0\u4e00\u7bc7&#xff0c;\u800c\u662f\u628a\u8fd9\u516d\u7bc7\u5de5\u4f5c\u8fde\u63a5\u8d77\u6765&#xff1a;\u52a8\u6001User Simulator &#043; Structured User State &#043; Episodic\/Procedural Memory &#043; Turn-level Reward &#043; Evolving Evaluation\u3002\u8fd9\u6761\u8def\u7ebf\u5df2\u7ecf\u975e\u5e38\u63a5\u8fd1\u201c\u9762\u5411\u957f\u671f\u4ea4\u4e92\u7684\u591a\u8f6e\u5bf9\u8bddAgent\u201d\u8fd9\u4e00\u5b8c\u6574\u7814\u7a76\u6846\u67b6\u3002<\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u8bba\u6587\u65b9\u5411&#xff1a;Multi-Turn Dialogue \/ Agent \/ Memory \/ RL \/ Human Simulator \/ Evaluation \u9605\u8bfb\u8bba\u6587&#xff1a;6\u7bc7 \u6838\u5fc3\u5206\u6790\u6846\u67b6&#xff1a;\u89e3\u51b3\u7684\u95ee\u9898 \u2192 \u89e3\u51b3\u65b9\u6cd5 \u2192 \u4e0e\u5176\u5b83\u65b9\u6cd5\u7684\u533a\u522b \u2192 \u5b9e\u9a8c\u9a8c\u8bc1\u8def\u7ebf 0. \u4e3a\u4ec0\u4e48\u8981\u628a\u8fd9 6 \u7bc7\u8bba\u6587\u653e\u5728\u4e00\u8d77\u770b&#xff1f;<br \/>\n\u8fc7\u53bb\u7684\u5927\u8bed\u8a00\u6a21\u578b\u591a\u8f6e\u5bf9\u8bdd\u7814\u7a76&#xff0c;\u4e00\u4e2a\u975e\u5e38\u5178\u578b\u7684\u601d\u8def\u662f&#xff1a;<br \/>\nUser\u2193<br \/>\nConversation Hi<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[50,86,427,3546],"topic":[],"class_list":["post-95993","post","type-post","status-publish","format-standard","hentry","category-server","tag-50","tag-86","tag-427","tag-3546"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v20.3 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>\u3010\u591a\u8f6e\u5bf9\u8bdd\u8bba\u6587\u5bfc\u8bfb\uff08\u516b\uff09\u3011\u591a\u8f6e\u5bf9\u8bdd\u6b63\u5728\u4ece\u201c\u4e0a\u4e0b\u6587\u8bb0\u5fc6\u201d\u8d70\u5411\u201c\u6301\u7eed\u4ea4\u4e92\u667a\u80fd\u201d - \u7f51\u7855\u4e92\u8054\u5e2e\u52a9\u4e2d\u5fc3<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.wsisp.com\/helps\/95993.html\" \/>\n<meta property=\"og:locale\" content=\"zh_CN\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"\u3010\u591a\u8f6e\u5bf9\u8bdd\u8bba\u6587\u5bfc\u8bfb\uff08\u516b\uff09\u3011\u591a\u8f6e\u5bf9\u8bdd\u6b63\u5728\u4ece\u201c\u4e0a\u4e0b\u6587\u8bb0\u5fc6\u201d\u8d70\u5411\u201c\u6301\u7eed\u4ea4\u4e92\u667a\u80fd\u201d - \u7f51\u7855\u4e92\u8054\u5e2e\u52a9\u4e2d\u5fc3\" \/>\n<meta property=\"og:description\" content=\"\u8bba\u6587\u65b9\u5411&#xff1a;Multi-Turn Dialogue \/ Agent \/ Memory \/ RL \/ Human Simulator \/ Evaluation \u9605\u8bfb\u8bba\u6587&#xff1a;6\u7bc7 \u6838\u5fc3\u5206\u6790\u6846\u67b6&#xff1a;\u89e3\u51b3\u7684\u95ee\u9898 \u2192 \u89e3\u51b3\u65b9\u6cd5 \u2192 \u4e0e\u5176\u5b83\u65b9\u6cd5\u7684\u533a\u522b \u2192 \u5b9e\u9a8c\u9a8c\u8bc1\u8def\u7ebf 0. \u4e3a\u4ec0\u4e48\u8981\u628a\u8fd9 6 \u7bc7\u8bba\u6587\u653e\u5728\u4e00\u8d77\u770b&#xff1f; \u8fc7\u53bb\u7684\u5927\u8bed\u8a00\u6a21\u578b\u591a\u8f6e\u5bf9\u8bdd\u7814\u7a76&#xff0c;\u4e00\u4e2a\u975e\u5e38\u5178\u578b\u7684\u601d\u8def\u662f&#xff1a; User\u2193 Conversation Hi\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.wsisp.com\/helps\/95993.html\" \/>\n<meta property=\"og:site_name\" content=\"\u7f51\u7855\u4e92\u8054\u5e2e\u52a9\u4e2d\u5fc3\" \/>\n<meta property=\"article:published_time\" content=\"2026-08-27T01:00:28+00:00\" \/>\n<meta name=\"author\" content=\"admin\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"\u4f5c\u8005\" \/>\n\t<meta name=\"twitter:data1\" content=\"admin\" \/>\n\t<meta name=\"twitter:label2\" content=\"\u9884\u8ba1\u9605\u8bfb\u65f6\u95f4\" \/>\n\t<meta name=\"twitter:data2\" content=\"11 \u5206\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.wsisp.com\/helps\/95993.html\",\"url\":\"https:\/\/www.wsisp.com\/helps\/95993.html\",\"name\":\"\u3010\u591a\u8f6e\u5bf9\u8bdd\u8bba\u6587\u5bfc\u8bfb\uff08\u516b\uff09\u3011\u591a\u8f6e\u5bf9\u8bdd\u6b63\u5728\u4ece\u201c\u4e0a\u4e0b\u6587\u8bb0\u5fc6\u201d\u8d70\u5411\u201c\u6301\u7eed\u4ea4\u4e92\u667a\u80fd\u201d - \u7f51\u7855\u4e92\u8054\u5e2e\u52a9\u4e2d\u5fc3\",\"isPartOf\":{\"@id\":\"https:\/\/www.wsisp.com\/helps\/#website\"},\"datePublished\":\"2026-08-27T01:00:28+00:00\",\"dateModified\":\"2026-08-27T01:00:28+00:00\",\"author\":{\"@id\":\"https:\/\/www.wsisp.com\/helps\/#\/schema\/person\/358e386c577a3ab51c4493330a20ad41\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.wsisp.com\/helps\/95993.html#breadcrumb\"},\"inLanguage\":\"zh-Hans\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.wsisp.com\/helps\/95993.html\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.wsisp.com\/helps\/95993.html#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"\u9996\u9875\",\"item\":\"https:\/\/www.wsisp.com\/helps\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"\u3010\u591a\u8f6e\u5bf9\u8bdd\u8bba\u6587\u5bfc\u8bfb\uff08\u516b\uff09\u3011\u591a\u8f6e\u5bf9\u8bdd\u6b63\u5728\u4ece\u201c\u4e0a\u4e0b\u6587\u8bb0\u5fc6\u201d\u8d70\u5411\u201c\u6301\u7eed\u4ea4\u4e92\u667a\u80fd\u201d\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.wsisp.com\/helps\/#website\",\"url\":\"https:\/\/www.wsisp.com\/helps\/\",\"name\":\"\u7f51\u7855\u4e92\u8054\u5e2e\u52a9\u4e2d\u5fc3\",\"description\":\"\u9999\u6e2f\u670d\u52a1\u5668_\u9999\u6e2f\u4e91\u670d\u52a1\u5668\u8d44\u8baf_\u670d\u52a1\u5668\u5e2e\u52a9\u6587\u6863_\u670d\u52a1\u5668\u6559\u7a0b\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.wsisp.com\/helps\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"zh-Hans\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.wsisp.com\/helps\/#\/schema\/person\/358e386c577a3ab51c4493330a20ad41\",\"name\":\"admin\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"zh-Hans\",\"@id\":\"https:\/\/www.wsisp.com\/helps\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/gravatar.wp-china-yes.net\/avatar\/?s=96&d=mystery\",\"contentUrl\":\"https:\/\/gravatar.wp-china-yes.net\/avatar\/?s=96&d=mystery\",\"caption\":\"admin\"},\"sameAs\":[\"http:\/\/wp.wsisp.com\"],\"url\":\"https:\/\/www.wsisp.com\/helps\/author\/admin\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"\u3010\u591a\u8f6e\u5bf9\u8bdd\u8bba\u6587\u5bfc\u8bfb\uff08\u516b\uff09\u3011\u591a\u8f6e\u5bf9\u8bdd\u6b63\u5728\u4ece\u201c\u4e0a\u4e0b\u6587\u8bb0\u5fc6\u201d\u8d70\u5411\u201c\u6301\u7eed\u4ea4\u4e92\u667a\u80fd\u201d - \u7f51\u7855\u4e92\u8054\u5e2e\u52a9\u4e2d\u5fc3","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.wsisp.com\/helps\/95993.html","og_locale":"zh_CN","og_type":"article","og_title":"\u3010\u591a\u8f6e\u5bf9\u8bdd\u8bba\u6587\u5bfc\u8bfb\uff08\u516b\uff09\u3011\u591a\u8f6e\u5bf9\u8bdd\u6b63\u5728\u4ece\u201c\u4e0a\u4e0b\u6587\u8bb0\u5fc6\u201d\u8d70\u5411\u201c\u6301\u7eed\u4ea4\u4e92\u667a\u80fd\u201d - \u7f51\u7855\u4e92\u8054\u5e2e\u52a9\u4e2d\u5fc3","og_description":"\u8bba\u6587\u65b9\u5411&#xff1a;Multi-Turn Dialogue \/ Agent \/ Memory \/ RL \/ Human Simulator \/ Evaluation \u9605\u8bfb\u8bba\u6587&#xff1a;6\u7bc7 \u6838\u5fc3\u5206\u6790\u6846\u67b6&#xff1a;\u89e3\u51b3\u7684\u95ee\u9898 \u2192 \u89e3\u51b3\u65b9\u6cd5 \u2192 \u4e0e\u5176\u5b83\u65b9\u6cd5\u7684\u533a\u522b \u2192 \u5b9e\u9a8c\u9a8c\u8bc1\u8def\u7ebf 0. \u4e3a\u4ec0\u4e48\u8981\u628a\u8fd9 6 \u7bc7\u8bba\u6587\u653e\u5728\u4e00\u8d77\u770b&#xff1f; \u8fc7\u53bb\u7684\u5927\u8bed\u8a00\u6a21\u578b\u591a\u8f6e\u5bf9\u8bdd\u7814\u7a76&#xff0c;\u4e00\u4e2a\u975e\u5e38\u5178\u578b\u7684\u601d\u8def\u662f&#xff1a; User\u2193 Conversation Hi","og_url":"https:\/\/www.wsisp.com\/helps\/95993.html","og_site_name":"\u7f51\u7855\u4e92\u8054\u5e2e\u52a9\u4e2d\u5fc3","article_published_time":"2026-08-27T01:00:28+00:00","author":"admin","twitter_card":"summary_large_image","twitter_misc":{"\u4f5c\u8005":"admin","\u9884\u8ba1\u9605\u8bfb\u65f6\u95f4":"11 \u5206"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.wsisp.com\/helps\/95993.html","url":"https:\/\/www.wsisp.com\/helps\/95993.html","name":"\u3010\u591a\u8f6e\u5bf9\u8bdd\u8bba\u6587\u5bfc\u8bfb\uff08\u516b\uff09\u3011\u591a\u8f6e\u5bf9\u8bdd\u6b63\u5728\u4ece\u201c\u4e0a\u4e0b\u6587\u8bb0\u5fc6\u201d\u8d70\u5411\u201c\u6301\u7eed\u4ea4\u4e92\u667a\u80fd\u201d - \u7f51\u7855\u4e92\u8054\u5e2e\u52a9\u4e2d\u5fc3","isPartOf":{"@id":"https:\/\/www.wsisp.com\/helps\/#website"},"datePublished":"2026-08-27T01:00:28+00:00","dateModified":"2026-08-27T01:00:28+00:00","author":{"@id":"https:\/\/www.wsisp.com\/helps\/#\/schema\/person\/358e386c577a3ab51c4493330a20ad41"},"breadcrumb":{"@id":"https:\/\/www.wsisp.com\/helps\/95993.html#breadcrumb"},"inLanguage":"zh-Hans","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.wsisp.com\/helps\/95993.html"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.wsisp.com\/helps\/95993.html#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"\u9996\u9875","item":"https:\/\/www.wsisp.com\/helps"},{"@type":"ListItem","position":2,"name":"\u3010\u591a\u8f6e\u5bf9\u8bdd\u8bba\u6587\u5bfc\u8bfb\uff08\u516b\uff09\u3011\u591a\u8f6e\u5bf9\u8bdd\u6b63\u5728\u4ece\u201c\u4e0a\u4e0b\u6587\u8bb0\u5fc6\u201d\u8d70\u5411\u201c\u6301\u7eed\u4ea4\u4e92\u667a\u80fd\u201d"}]},{"@type":"WebSite","@id":"https:\/\/www.wsisp.com\/helps\/#website","url":"https:\/\/www.wsisp.com\/helps\/","name":"\u7f51\u7855\u4e92\u8054\u5e2e\u52a9\u4e2d\u5fc3","description":"\u9999\u6e2f\u670d\u52a1\u5668_\u9999\u6e2f\u4e91\u670d\u52a1\u5668\u8d44\u8baf_\u670d\u52a1\u5668\u5e2e\u52a9\u6587\u6863_\u670d\u52a1\u5668\u6559\u7a0b","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.wsisp.com\/helps\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"zh-Hans"},{"@type":"Person","@id":"https:\/\/www.wsisp.com\/helps\/#\/schema\/person\/358e386c577a3ab51c4493330a20ad41","name":"admin","image":{"@type":"ImageObject","inLanguage":"zh-Hans","@id":"https:\/\/www.wsisp.com\/helps\/#\/schema\/person\/image\/","url":"https:\/\/gravatar.wp-china-yes.net\/avatar\/?s=96&d=mystery","contentUrl":"https:\/\/gravatar.wp-china-yes.net\/avatar\/?s=96&d=mystery","caption":"admin"},"sameAs":["http:\/\/wp.wsisp.com"],"url":"https:\/\/www.wsisp.com\/helps\/author\/admin"}]}},"_links":{"self":[{"href":"https:\/\/www.wsisp.com\/helps\/wp-json\/wp\/v2\/posts\/95993","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.wsisp.com\/helps\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.wsisp.com\/helps\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.wsisp.com\/helps\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.wsisp.com\/helps\/wp-json\/wp\/v2\/comments?post=95993"}],"version-history":[{"count":0,"href":"https:\/\/www.wsisp.com\/helps\/wp-json\/wp\/v2\/posts\/95993\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.wsisp.com\/helps\/wp-json\/wp\/v2\/media?parent=95993"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.wsisp.com\/helps\/wp-json\/wp\/v2\/categories?post=95993"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.wsisp.com\/helps\/wp-json\/wp\/v2\/tags?post=95993"},{"taxonomy":"topic","embeddable":true,"href":"https:\/\/www.wsisp.com\/helps\/wp-json\/wp\/v2\/topic?post=95993"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}