{"id":34998,"date":"2025-05-01T17:35:57","date_gmt":"2025-05-01T09:35:57","guid":{"rendered":"https:\/\/www.wsisp.com\/helps\/34998.html"},"modified":"2025-05-01T17:35:57","modified_gmt":"2025-05-01T09:35:57","slug":"atlas-800-9000%e6%9c%8d%e5%8a%a1%e5%99%a8-910b-%e4%b8%8a%e9%83%a8%e7%bd%b2%e5%a4%a7%e6%a8%a1%e5%9e%8b%ef%bc%8c%e4%bb%a5%e5%8f%8a%e6%b5%8b%e8%af%95","status":"publish","type":"post","link":"https:\/\/www.wsisp.com\/helps\/34998.html","title":{"rendered":"Atlas 800 9000\u670d\u52a1\u5668 910B \u4e0a\u90e8\u7f72\u5927\u6a21\u578b\uff0c\u4ee5\u53ca\u6d4b\u8bd5"},"content":{"rendered":"<\/p>\n<h2>1.\u67e5\u770b\u9a71\u52a8,\u5e76\u8fdb\u884c\u66f4\u65b0<\/h2>\n<p>npu-smi info <\/p>\n<p><img loading=\"lazy\" decoding=\"async\" alt=\"\" height=\"764\" src=\"https:\/\/www.wsisp.com\/helps\/wp-content\/uploads\/2025\/05\/20250501093551-681340771bbe5.png\" width=\"865\" \/><\/p>\n<p>\u5347\u7ea7\u6700\u65b0\u7684\u9a71\u52a8\u4e0e\u56fa\u4ef6&#xff0c;\u524d\u5f80\u5b98\u7f51\u4e0b\u8f7d\u6700\u65b0\u7684 \u9a71\u52a8\u4e0e\u56fa\u4ef6\u00a0\u793e\u533a\u7248-\u56fa\u4ef6\u4e0e\u9a71\u52a8-\u6607\u817e\u793e\u533a<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" alt=\"\" height=\"603\" src=\"https:\/\/www.wsisp.com\/helps\/wp-content\/uploads\/2025\/05\/20250501093551-68134077546a9.png\" width=\"1518\" \/><\/p>\n<p>\u6ce8\u610f\u4ea7\u54c1\u7cfb\u5217\u548c\u4ea7\u54c1\u578b\u53f7\u4e0d\u8981\u9009\u9519&#xff0c;\u8fd9\u8fb9\u6211\u4eec\u4e0b\u8f7d .run\u7684\u7248\u672c<\/p>\n<p>cd \/home\/HwHiAiUser<br \/>\nwget https:\/\/ascend-repo.obs.cn-east-2.myhuaweicloud.com\/Ascend%20HDK\/Ascend%20HDK%2023.0.2.1\/Ascend-hdk-910-npu-driver_23.0.2_linux-aarch64.run<br \/>\nwget https:\/\/ascend-repo.obs.cn-east-2.myhuaweicloud.com\/Ascend%20HDK\/Ascend%20HDK%2023.0.2.1\/Ascend-hdk-910-npu-firmware_7.1.0.4.220.run<br \/>\nchmod 777 Ascend-hdk-910-npu-driver_23.0.2_linux-aarch64.run<br \/>\nchmod 777 Ascend-hdk-910-npu-firmware_7.1.0.4.220.run<br \/>\nsudo .\/Ascend-hdk-910-npu-driver_23.0.2_linux-aarch64.run &#8211;full &#8211;force<br \/>\nsudo .\/Ascend-hdk-910-npu-firmware_7.1.0.4.220.run &#8211;full &#8211;force <\/p>\n<p>\u00a0\u7136\u540e\u6211\u4eec\u91cd\u542f\u4e00\u4e0b\u670d\u52a1\u5668 \u00a0<\/p>\n<p>sudo reboot <\/p>\n<h2>2.\u4e0b\u8f7d modelscpoe &#xff0c;\u6307\u5b9a\u7248\u672c1.18.0<\/h2>\n<p>pip install modelscope&#061;&#061;1.18.0 <\/p>\n<h2>3. \u4e0b\u8f7d\u6a21\u578b\u6743\u91cd<\/h2>\n<p>\u00a0(\u5982\u679c\u60f3\u8981\u8dd1\u5176\u4ed6\u6a21\u578b&#xff0c;\u53ef\u4ee5\u53bb\u9b54\u5854\u793e\u533a\u6309\u7167\u6a21\u578b\u4e0b\u8f7d\u7684\u6307\u5f15\u4e0b\u8f7d\u9b54\u642d\u793e\u533a)\u00a0<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" alt=\"\" height=\"804\" src=\"https:\/\/www.wsisp.com\/helps\/wp-content\/uploads\/2025\/05\/20250501093551-6813407791077.png\" width=\"1864\" \/><\/p>\n<p>\u00a0\u5177\u4f53\u65b9\u5f0f\u5c31\u662f\u590d\u5236\u5176\u4e2d\u7684SDK\u4e0b\u8f7d\u7684\u5185\u5bb9\u5230 download.py\u6587\u4ef6\u4e2d&#xff0c;\u5e76python \u4e0b\u8f7d\u5b83<\/p>\n<p>cd \/home\/HwHiAiUser<br \/>\nvim download.py<br \/>\ncat download.py <\/p>\n<p>#\u6a21\u578b\u4e0b\u8f7d from modelscope import snapshot_download model_dir &#061; snapshot_download(&#039;Qwen\/Qwen2-7B-Instruct&#039;,cache_dir&#061;&#034;\/home\/HwHiAiUser\/&#034;)<\/p>\n<p>##\u6dfb\u52a0cachedir \u7684\u8def\u5f84\u4e3a\u5f53\u524d\u76ee\u5f55<\/p>\n<p>python3 download.py <\/p>\n<p>\u53ef\u80fd\u4f1a\u6709\u4e00\u70b9\u5361\u987f&#xff0c;\u4f46\u662f\u6700\u7ec8\u6211\u4eec\u4f1a\u4e0b\u8f7d\u6210\u529f\u7684<\/p>\n<h2>4.\u6784\u5efamindie\u955c\u50cf\u5bb9\u5668<\/h2>\n<p>cd \/home\/HwHiAiUser <\/p>\n<p>4.1.\u4e0b\u8f7ddocker<\/p>\n<p>yum install docker<\/p>\n<p>4.2.\u66f4\u65b0docker\u6e90<\/p>\n<p>vim \/etc\/docker\/daemon.json <\/p>\n<p>{ &#034;insecure-registries&#034;: [&#034;https:\/\/swr.cn-east-317.qdrgznjszx.com&#034;], &#034;registry-mirrors&#034;: [&#034;https:\/\/docker.mirrors.ustc.edu.cn&#034;] }<\/p>\n<p>systemctl restart docker.service <\/p>\n<p>\u00a04.3 \u62c9\u53d6\u955c\u50cf<\/p>\n<p>docker pull swr.cn-east-317.qdrgznjszx.com\/sxj731533730\/mindie:atlas_800_9000 <\/p>\n<p>4.4 \u521b\u5efa\u955c\u50cf<\/p>\n<p>vim docker_run.sh <\/p>\n<p>#!\/bin\/bash docker_images&#061;swr.cn-east-317.qdrgznjszx.com\/sxj731533730\/mindie:atlas_800_9000 model_dir&#061;\/home\/HwHiAiUser #\u6839\u636e\u5b9e\u9645\u60c5\u51b5\u4fee\u6539\u6302\u8f7d\u76ee\u5f55 docker run -it &#8211;name qdaicc &#8211;ipc&#061;host &#8211;net&#061;host \\\\ \u00a0 \u00a0 \u00a0 \u00a0 &#8211;device&#061;\/dev\/davinci3 \\\\ \u00a0 \u00a0 \u00a0 \u00a0 &#8211;device&#061;\/dev\/davinci4 \\\\ \u00a0 \u00a0 \u00a0 \u00a0 &#8211;device&#061;\/dev\/davinci5 \\\\ \u00a0 \u00a0 \u00a0 \u00a0 &#8211;device&#061;\/dev\/davinci6 \\\\ \u00a0 \u00a0 \u00a0 \u00a0 &#8211;device&#061;\/dev\/davinci7 \\\\ \u00a0 \u00a0 \u00a0 \u00a0 &#8211;device&#061;\/dev\/davinci_manager \\\\ \u00a0 \u00a0 \u00a0 \u00a0 &#8211;device&#061;\/dev\/devmm_svm \\\\ \u00a0 \u00a0 \u00a0 \u00a0 &#8211;device&#061;\/dev\/hisi_hdc \\\\ \u00a0 \u00a0 \u00a0 \u00a0 -v \/usr\/local\/dcmi:\/usr\/local\/dcmi \\\\ \u00a0 \u00a0 \u00a0 \u00a0 -v \/usr\/local\/bin\/npu-smi:\/usr\/local\/bin\/npu-smi \\\\ \u00a0 \u00a0 \u00a0 \u00a0 -v \/usr\/local\/Ascend\/driver\/lib64\/common:\/usr\/local\/Ascend\/driver\/lib64\/common \\\\ \u00a0 \u00a0 \u00a0 \u00a0 -v \/usr\/local\/Ascend\/driver\/lib64\/driver:\/usr\/local\/Ascend\/driver\/lib64\/driver \\\\ \u00a0 \u00a0 \u00a0 \u00a0 -v \/etc\/ascend_install.info:\/etc\/ascend_install.info \\\\ \u00a0 \u00a0 \u00a0 \u00a0 -v \/etc\/vnpu.cfg:\/etc\/vnpu.cfg \\\\ \u00a0 \u00a0 \u00a0 \u00a0 -v \/usr\/local\/Ascend\/driver\/version.info:\/usr\/local\/Ascend\/driver\/version.info \\\\ \u00a0 \u00a0 \u00a0 \u00a0 -v ${model_dir}:${model_dir} \\\\ \u00a0 \u00a0 \u00a0 \u00a0 -v \u00a0\/var\/log\/npu:\/usr\/slog ${docker_images} \\\\ \u00a0 \u00a0 \u00a0 \u00a0 \/bin\/bash\u00a0<\/p>\n<p>bash docker_run.sh<br \/>\nexit <\/p>\n<h2>5. \u62c9\u8d77\u5927\u6a21\u578b\u670d\u52a1<\/h2>\n<p>\u8fdb\u5165mindie\u5bb9\u5668&#xff0c;\u627e\u5230\u5b83\u7684container_id ,\u8fd9\u8fb9\u5047\u8bbe\u4e3axxxxxxx<\/p>\n<p>docker ps -a<br \/>\ndocker exec -it xxxxxxx \/bin\/bash <\/p>\n<h3>5.1 \u4fee\u6539\u6a21\u578b\u7684\u914d\u7f6e\u6587\u4ef6<\/h3>\n<p>\u6211\u4eec\u6765\u5230\u6a21\u578b\u7684\u4e0b\u8f7d\u8def\u5f84\u4e0b&#xff0c;\u8981\u4fee\u6539\u7684\u662f\u4e0b\u9762\u7684\u8fd9\u4e2aconfig\u6587\u4ef6&#xff0c;\u4e0d\u540c\u6a21\u578b\u7684\u8def\u5f84\u4e0d\u540c\u4f46\u662f\u8fd9\u4e2aconfig\u6587\u4ef6\u90fd\u4f1a\u5b58\u5728<\/p>\n<p>cd \/home\/HwHiAiUser\/Qwen\/Qwen2-7B<br \/>\nvim config.json <\/p>\n<p>\u5c06\u5176\u4e2d\u7684 btype \u6539\u4e3a float16<\/p>\n<h3>\u00a05.2 \u5728mindie\u4e0a\u914d\u7f6e\u6a21\u578b\u7684\u76f8\u5173\u4fe1\u606f<\/h3>\n<p>\u67e5\u770b\u672c\u673a\u7684ip\u5730\u5740&#xff0c;\u6211\u4eec\u5173\u6ce8198.168\u5f00\u5934\u7684\u8fd9\u4e2aip\u00a0<\/p>\n<p>ifconfig <\/p>\n<p><img loading=\"lazy\" decoding=\"async\" alt=\"\" height=\"687\" src=\"https:\/\/www.wsisp.com\/helps\/wp-content\/uploads\/2025\/05\/20250501093552-6813407821d93.png\" width=\"1230\" \/><\/p>\n<p>cd \/usr\/local\/Ascend\/mindie\/latest\/mindie-service<br \/>\nvim conf\/config.json <\/p>\n<p>\u00a0\u4fee\u6539\u4ee5\u4e0b\u53c2\u6570&#xff08;\u6839\u636e\u81ea\u5df1\u7684\u60c5\u51b5\u8fdb\u884c\u66f4\u6539&#xff09;<\/p>\n<p>&#034;ipAddress&#034; : &#034;192.168.2.85&#034; \/\/ \u6539\u4e3a\u81ea\u5df1\u672c\u673a\u7684ip\u5730\u5740 &#034;managementIpAddress&#034; :\u00a0&#034;192.168.2.85&#034;<\/p>\n<p>&#034;port&#034; : &#034;1025&#034; \/\/ mindie\u670d\u52a1\u5bf9\u5916\u8bbf\u95ee\u7684\u7aef\u53e3<\/p>\n<p>&#034;httpsEnabled&#034; : false &#034;npuDeviceIds&#034; : [[0,1,2,3]], \/\/ \u4f7f\u7528\u7684npu_id<\/p>\n<p>&#034;truncation&#034; : true<\/p>\n<p>&#034;modelName&#034; : &#034;Qwen2-7B&#034; \/\/ \u6a21\u578b\u540d\u79f0 &#034;modelWeightPath&#034; : &#034;\/home\/HwHiAiUser\/Qwen\/Qwen2-7B&#034; \/\/ \u5b58\u653e\u6a21\u578b\u7684\u8def\u5f84\u540d\u79f0 &#034;worldSize&#034; : 4\u00a0\/\/ \u4f7f\u7528\u7684npu\u6570\u91cf &#034;maxInputTokenLen&#034; : 4096<\/p>\n<p>&#034;maxIterTimes&#034; : 4096<\/p>\n<p>{<br \/>\n    &#034;Version&#034; : &#034;1.0.0&#034;,<br \/>\n    &#034;LogConfig&#034; :<br \/>\n    {<br \/>\n        &#034;logLevel&#034; : &#034;Info&#034;,<br \/>\n        &#034;logFileSize&#034; : 20,<br \/>\n        &#034;logFileNum&#034; : 20,<br \/>\n        &#034;logPath&#034; : &#034;logs\/mindie-server.log&#034;<br \/>\n    },<\/p>\n<p>    &#034;ServerConfig&#034; :<br \/>\n    {<br \/>\n        &#034;ipAddress&#034; : &#034;192.168.2.85&#034;,<br \/>\n        &#034;managementIpAddress&#034; : &#034;192.168.2.85&#034;,<br \/>\n        &#034;port&#034; : 1025,<br \/>\n        &#034;managementPort&#034; : 1026,<br \/>\n        &#034;metricsPort&#034; : 1027,<br \/>\n        &#034;allowAllZeroIpListening&#034; : false,<br \/>\n        &#034;maxLinkNum&#034; : 1000,<br \/>\n        &#034;httpsEnabled&#034; : false,<br \/>\n        &#034;fullTextEnabled&#034; : false,<br \/>\n        &#034;tlsCaPath&#034; : &#034;security\/ca\/&#034;,<br \/>\n        &#034;tlsCaFile&#034; : [&#034;ca.pem&#034;],<br \/>\n        &#034;tlsCert&#034; : &#034;security\/certs\/server.pem&#034;,<br \/>\n        &#034;tlsPk&#034; : &#034;security\/keys\/server.key.pem&#034;,<br \/>\n        &#034;tlsPkPwd&#034; : &#034;security\/pass\/key_pwd.txt&#034;,<br \/>\n        &#034;tlsCrlPath&#034; : &#034;security\/certs\/&#034;,<br \/>\n        &#034;tlsCrlFiles&#034; : [&#034;server_crl.pem&#034;],<br \/>\n        &#034;managementTlsCaFile&#034; : [&#034;management_ca.pem&#034;],<br \/>\n        &#034;managementTlsCert&#034; : &#034;security\/certs\/management\/server.pem&#034;,<br \/>\n        &#034;managementTlsPk&#034; : &#034;security\/keys\/management\/server.key.pem&#034;,<br \/>\n        &#034;managementTlsPkPwd&#034; : &#034;security\/pass\/management\/key_pwd.txt&#034;,<br \/>\n        &#034;managementTlsCrlPath&#034; : &#034;security\/management\/certs\/&#034;,<br \/>\n        &#034;managementTlsCrlFiles&#034; : [&#034;server_crl.pem&#034;],<br \/>\n        &#034;kmcKsfMaster&#034; : &#034;tools\/pmt\/master\/ksfa&#034;,<br \/>\n        &#034;kmcKsfStandby&#034; : &#034;tools\/pmt\/standby\/ksfb&#034;,<br \/>\n        &#034;inferMode&#034; : &#034;standard&#034;,<br \/>\n        &#034;interCommTLSEnabled&#034; : true,<br \/>\n        &#034;interCommPort&#034; : 1121,<br \/>\n        &#034;interCommTlsCaPath&#034; : &#034;security\/grpc\/ca\/&#034;,<br \/>\n        &#034;interCommTlsCaFiles&#034; : [&#034;ca.pem&#034;],<br \/>\n        &#034;interCommTlsCert&#034; : &#034;security\/grpc\/certs\/server.pem&#034;,<br \/>\n        &#034;interCommPk&#034; : &#034;security\/grpc\/keys\/server.key.pem&#034;,<br \/>\n        &#034;interCommPkPwd&#034; : &#034;security\/grpc\/pass\/key_pwd.txt&#034;,<br \/>\n        &#034;interCommTlsCrlPath&#034; : &#034;security\/grpc\/certs\/&#034;,<br \/>\n        &#034;interCommTlsCrlFiles&#034; : [&#034;server_crl.pem&#034;],<br \/>\n        &#034;openAiSupport&#034; : &#034;vllm&#034;<br \/>\n    },<\/p>\n<p>    &#034;BackendConfig&#034; : {<br \/>\n        &#034;backendName&#034; : &#034;mindieservice_llm_engine&#034;,<br \/>\n        &#034;modelInstanceNumber&#034; : 1,<br \/>\n        &#034;npuDeviceIds&#034; : [[0,1,2,3]],<br \/>\n        &#034;tokenizerProcessNumber&#034; : 8,<br \/>\n        &#034;multiNodesInferEnabled&#034; : false,<br \/>\n        &#034;multiNodesInferPort&#034; : 1120,<br \/>\n        &#034;interNodeTLSEnabled&#034; : true,<br \/>\n        &#034;interNodeTlsCaPath&#034; : &#034;security\/grpc\/ca\/&#034;,<br \/>\n        &#034;interNodeTlsCaFiles&#034; : [&#034;ca.pem&#034;],<br \/>\n        &#034;interNodeTlsCert&#034; : &#034;security\/grpc\/certs\/server.pem&#034;,<br \/>\n        &#034;interNodeTlsPk&#034; : &#034;security\/grpc\/keys\/server.key.pem&#034;,<br \/>\n        &#034;interNodeTlsPkPwd&#034; : &#034;security\/grpc\/pass\/mindie_server_key_pwd.txt&#034;,<br \/>\n        &#034;interNodeTlsCrlPath&#034; : &#034;security\/grpc\/certs\/&#034;,<br \/>\n        &#034;interNodeTlsCrlFiles&#034; : [&#034;server_crl.pem&#034;],<br \/>\n        &#034;interNodeKmcKsfMaster&#034; : &#034;tools\/pmt\/master\/ksfa&#034;,<br \/>\n        &#034;interNodeKmcKsfStandby&#034; : &#034;tools\/pmt\/standby\/ksfb&#034;,<br \/>\n        &#034;ModelDeployConfig&#034; :<br \/>\n        {<br \/>\n            &#034;maxSeqLen&#034; : 2560,<br \/>\n            &#034;maxInputTokenLen&#034; : 4096,<br \/>\n            &#034;truncation&#034; : true,<br \/>\n            &#034;ModelConfig&#034; : [<br \/>\n                {<br \/>\n                    &#034;modelInstanceType&#034; : &#034;Standard&#034;,<br \/>\n                    &#034;modelName&#034; : &#034;Qwen2-7B&#034;,<br \/>\n                    &#034;modelWeightPath&#034; : &#034;\/home\/HwHiAiUser\/Qwen\/Qwen2-7B&#034;,<br \/>\n                    &#034;worldSize&#034; : 4,<br \/>\n                    &#034;cpuMemSize&#034; : 5,<br \/>\n                    &#034;npuMemSize&#034; : -1,<br \/>\n                    &#034;backendType&#034; : &#034;atb&#034;,<br \/>\n                    &#034;trustRemoteCode&#034; : false<br \/>\n                }<br \/>\n            ]<br \/>\n        },<\/p>\n<p>        &#034;ScheduleConfig&#034; :<br \/>\n        {<br \/>\n            &#034;templateType&#034; : &#034;Standard&#034;,<br \/>\n            &#034;templateName&#034; : &#034;Standard_LLM&#034;,<br \/>\n            &#034;cacheBlockSize&#034; : 128,<\/p>\n<p>            &#034;maxPrefillBatchSize&#034; : 50,<br \/>\n            &#034;maxPrefillTokens&#034; : 8192,<br \/>\n            &#034;prefillTimeMsPerReq&#034; : 150,<br \/>\n            &#034;prefillPolicyType&#034; : 0,<\/p>\n<p>            &#034;decodeTimeMsPerReq&#034; : 50,<br \/>\n            &#034;decodePolicyType&#034; : 0,<\/p>\n<p>            &#034;maxBatchSize&#034; : 200,<br \/>\n            &#034;maxIterTimes&#034; : 4096,<br \/>\n            &#034;maxPreemptCount&#034; : 0,<br \/>\n            &#034;supportSelectBatch&#034; : false,<br \/>\n            &#034;maxQueueDelayMicroseconds&#034; : 5000<br \/>\n        }<br \/>\n    }<br \/>\n} <\/p>\n<h3>\u00a05.3 \u542f\u52a8\u5927\u6a21\u578b\u670d\u52a1<\/h3>\n<p>chmod -R 750 \/home\/HwHiAiUser\/Qwen\/Qwen2-7B<br \/>\ncd \/usr\/local\/Ascend\/mindie\/latest\/mindie-service<br \/>\n.\/bin\/mindieservice_daemon <\/p>\n<h3>5.4 \u8bb0\u5f55\u5927\u6a21\u578b\u542f\u52a8\u6210\u529f\u7684\u65e5\u5fd7<\/h3>\n<p><img loading=\"lazy\" decoding=\"async\" alt=\"\" height=\"1231\" src=\"https:\/\/www.wsisp.com\/helps\/wp-content\/uploads\/2025\/05\/20250501093552-681340786d43f.png\" width=\"1973\" \/><\/p>\n<h2>6. \u5927\u6a21\u578b\u63d0\u95ee\u6d4b\u8bd5<\/h2>\n<p>\u91cd\u65b0\u542f\u52a8\u4e00\u4e2a\u7ec8\u7aef&#xff0c;\u5e76\u8f93\u5165\u4ee5\u4e0b\u6307\u4ee4\u67e5\u770b\u662f\u5426\u540e\u53f0\u5728\u6b63\u5e38\u8fd0\u4f5c\u5927\u6a21\u578b<\/p>\n<p>npu-smi info <\/p>\n<p><img loading=\"lazy\" decoding=\"async\" alt=\"\" height=\"1396\" src=\"https:\/\/www.wsisp.com\/helps\/wp-content\/uploads\/2025\/05\/20250501093553-6813407957b53.png\" width=\"1584\" \/>\u00a0\u63d0\u95ee\u76f8\u5173\u7684\u95ee\u9898&#xff0c;\u6ce8\u610f\u8fd9\u8fb9\u7684ip\u548c\u7aef\u53e3<\/p>\n<p>curl -H &#034;Accept: application\/json&#034; -H &#034;Content-type: application\/json&#034; -X POST -d &#039;{<br \/>\n    &#034;inputs&#034;: &#034;\u505c\u8f66\u8bc6\u522b\u7cfb\u7edf\u7684\u4e3b\u8981\u8bc6\u522b\u5bf9\u8c61&#034;,<br \/>\n    &#034;parameters&#034;: {<br \/>\n        &#034;decoder_input_details&#034;: true,<br \/>\n        &#034;details&#034;: true,<br \/>\n        &#034;do_sample&#034;: true,<br \/>\n        &#034;max_new_tokens&#034;: 50,<br \/>\n        &#034;repetition_penalty&#034;: 1.03,<br \/>\n        &#034;return_full_text&#034;: false,<br \/>\n        &#034;seed&#034;: null,<br \/>\n        &#034;temperature&#034;: 0.5,<br \/>\n        &#034;top_k&#034;: 10,<br \/>\n        &#034;top_p&#034;: 0.95,<br \/>\n        &#034;truncate&#034;: null,<br \/>\n        &#034;typical_p&#034;: 0.5,<br \/>\n        &#034;watermark&#034;: false<br \/>\n    }<br \/>\n}&#039; http:\/\/192.168.2.85:1025\/generate<\/p>\n<p>\u6d4b\u8bd5\u7ed3\u679c,\u6ce8\u610f\u683c\u5f0f&#xff01;&#xff01;&#xff01;<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" alt=\"\" height=\"1227\" src=\"https:\/\/www.wsisp.com\/helps\/wp-content\/uploads\/2025\/05\/20250501093554-6813407a43d91.png\" width=\"2545\" \/><\/p>\n<h2>7.\u8fdb\u884c\u538b\u529b\u6d4b\u8bd5(\u6027\u80fd\u6d4b\u8bd5)<\/h2>\n<p>\u786e\u4fdd\u5927\u6a21\u578b\u5df2\u7ecf\u5728\u540e\u53f0\u8dd1\u8d77\u6765\u4e86&#xff0c;\u6211\u4eec\u8fd9\u91c7\u53d6\u7684\u65b9\u5f0f\u662f\u538b\u529b\u6d4b\u8bd5benchmark ,\u5177\u4f53\u53ef\u770b\u4ee5\u4e0b\u914d\u7f6eMindIE Benchmark-MindIE Benchmark-MindIE Service\u5f00\u53d1\u6307\u5357-\u670d\u52a1\u5316\u96c6\u6210\u90e8\u7f72-MindIE1.0.RC2\u5f00\u53d1\u6587\u6863-\u6607\u817e\u793e\u533a 7.1 \u8fdb\u5165\u5bb9\u5668<\/p>\n<p>docker exec -it xxxxxx \/bin\/bash <\/p>\n<p>7.2\u00a0\u521b\u5efa\u538b\u529b\u6d4b\u8bd5\u914d\u7f6e\u6587\u4ef6<\/p>\n<p>cd \/usr\/local\/Ascend\/atb-models\/tests\/modeltest\/<br \/>\nvim synthetic_config.json <\/p>\n<p style=\"margin-left:0;margin-right:0;text-align:left\">{ \u00a0 \u00a0 &#034;Input&#034;:{ \u00a0 \u00a0 \u00a0 \u00a0 \u00a0&#034;Method&#034;: &#034;uniform&#034;, \u00a0 \u00a0 \u00a0 \u00a0 \u00a0&#034;Params&#034;: {&#034;MinValue&#034;: 512, &#034;MaxValue&#034;: 512 } \u00a0 \u00a0}, \u00a0 \u00a0 &#034;Output&#034;: { \u00a0 \u00a0 \u00a0 \u00a0 \u00a0&#034;Method&#034;: &#034;gaussian&#034;, \u00a0 \u00a0 \u00a0 \u00a0 \u00a0&#034;Params&#034;: {&#034;Mean&#034;: 100, &#034;Var&#034;: 200, &#034;MinValue&#034;: 512, &#034;MaxValue&#034;: 512 } \u00a0 \u00a0}, \u00a0 \u00a0 &#034;RequestCount&#034;: 16 }<\/p>\n<p>\u00a0\u7b80\u5355\u8bf4\u660e\u4e00\u4e0b\u4e0a\u9762\u53c2\u6570\u7684\u542b\u4e49:\u8f93\u5165\u7684tokens\u662f512&#xff0c;\u8f93\u51fa\u7684\u662ftokens\u662f512&#xff0c;\u540c\u65f616\u4e2a\u5e76\u53d1\u8bf7\u6c42<\/p>\n<p>\u00a07.3 \u4fee\u6539\u6587\u4ef6\u6743\u9650<\/p>\n<p>chmod 640 synthetic_config.json <\/p>\n<p>\u00a07.4 \u8bbe\u7f6e\u7ed3\u679c\u5728\u63a7\u5236\u754c\u9762<\/p>\n<p>export MINDIE_LOG_TO_STDOUT&#061;&#034;benchmark:1; client:1&#034; <\/p>\n<p>7.5 \u6d4b\u8bd5\u6307\u4ee4<\/p>\n<p>\u4e0b\u9762\u662f\u6307\u4ee4\u8be6\u89e3<\/p>\n<p style=\"margin-left:0;margin-right:0;text-align:justify\"><span style=\"background-color:#d8d8d8\"><span style=\"color:black\">benchmark \\\\<\/span><\/span><\/p>\n<p style=\"margin-left:0;margin-right:0;text-align:justify\"><span style=\"background-color:#d8d8d8\"><span style=\"color:black\">&#8211;DatasetType &#034;synthetic&#034; \\\\ # <\/span><span style=\"color:black\">\u6570\u636e\u96c6\u7c7b\u578b<\/span><\/span><\/p>\n<p style=\"margin-left:0;margin-right:0;text-align:justify\"><span style=\"background-color:#d8d8d8\"><span style=\"color:black\">&#8211;ModelName Qwen2-7B \\\\ # \u6a21\u578b\u540d\u79f0<\/span><\/span><\/p>\n<p style=\"margin-left:0;margin-right:0;text-align:justify\"><span style=\"background-color:#d8d8d8\"><span style=\"color:black\">&#8211;ModelPath &#034;\/home\/HwHiAiUser\/Qwen\/Qwen2-7B&#034; \\\\ # \u6a21\u578b\u4f4d\u7f6e<\/span><\/span><\/p>\n<p style=\"margin-left:0;margin-right:0;text-align:justify\"><span style=\"background-color:#d8d8d8\"><span style=\"color:black\">&#8211;TestType vllm_client \\\\ # <\/span><span style=\"color:black\">\u6d4b\u8bd5\u5ba2\u6237\u7aef\u7c7b\u578b<\/span><\/span><\/p>\n<p style=\"margin-left:0;margin-right:0;text-align:justify\"><span style=\"background-color:#d8d8d8\"><span style=\"color:black\">&#8211;Http http:\/\/ 192.168.2.85:1025 \\\\ #\u63a8\u7406\u670d\u52a1<\/span><span style=\"color:black\">API<\/span><span style=\"color:black\">\u5730\u5740<\/span><\/span><\/p>\n<p style=\"margin-left:0;margin-right:0;text-align:justify\"><span style=\"background-color:#d8d8d8\"><span style=\"color:black\">&#8211;ManagementHttp http:\/\/ 192.168.2.85:1026 \\\\ # \u7ba1\u7406\u63a5\u53e3\u5730\u5740<\/span><\/span><\/p>\n<p style=\"margin-left:0;margin-right:0;text-align:justify\"><span style=\"background-color:#d8d8d8\"><span style=\"color:black\">&#8211;Concurrency 16 \\\\ # <\/span><span style=\"color:black\">\u9ad8\u5e76\u53d1\u538b\u529b<\/span><\/span><\/p>\n<p style=\"margin-left:0;margin-right:0;text-align:justify\"><span style=\"background-color:#d8d8d8\"><span style=\"color:black\">&#8211;MaxOutputLen 512 \\\\\u00a0 # <\/span><span style=\"color:black\">\u751f\u6210\u957f\u6587\u672c<\/span><\/span><\/p>\n<p style=\"margin-left:0;margin-right:0;text-align:justify\"><span style=\"background-color:#d8d8d8\"><span style=\"color:black\">&#8211;TaskKind stream \\\\ # <\/span><span style=\"color:black\">\u6d41\u5f0f\u8bf7\u6c42<\/span><\/span><\/p>\n<p style=\"margin-left:0;margin-right:0;text-align:justify\"><span style=\"background-color:#d8d8d8\"><span style=\"color:black\">&#8211;Tokenizer True \\\\ # <\/span><span style=\"color:black\">\u662f\u5426\u542f\u7528\u5206\u8bcd\u5668<\/span><\/span><\/p>\n<p style=\"margin-left:0;margin-right:0;text-align:justify\"><span style=\"background-color:#d8d8d8\"><span style=\"color:black\">&#8211;SyntheticConfigPath .\/synthetic_config.json # <\/span><span style=\"color:black\">\u63a7\u5236\u8f93\u5165\u8f93\u51fa\u6570\u636e\u5206\u5e03<\/span><\/span><\/p>\n<p>benchmark &#8211;DatasetType &#034;synthetic&#034; &#8211;ModelName Qwen2-7B &#8211;ModelPath &#034;\/home\/HwHiAiUser\/Qwen\/Qwen2-7B&#034; &#8211;TestType vllm_client &#8211;Http http:\/\/192.168.2.85:1025 &#8211;ManagementHttp http:\/\/192.168.2.85:1026 &#8211;Concurrency 16 &#8211;MaxOutputLen 512 &#8211;TaskKind stream &#8211;Tokenizer True &#8211;SyntheticConfigPath .\/synthetic_config.json <\/p>\n<p>7.6 \u7ed3\u679c\u5206\u6790<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" alt=\"\" height=\"1174\" src=\"https:\/\/www.wsisp.com\/helps\/wp-content\/uploads\/2025\/05\/20250501093555-6813407b89cd3.png\" width=\"2405\" \/><\/p>\n<p>\u6211\u4eec\u4e3b\u8981\u662f\u5173\u5fc3 GenerateSpeedPerClient \u8fd9\u4e2a\u53c2\u6570&#xff0c;\u8fd9\u4e2a\u53c2\u6570\u53ef\u4ee5\u6e05\u6670\u7684\u8bf4\u660e\u5f53\u524dgpu\u7684\u63a8\u7406\u901f\u5ea6&#xff08;7.738tokens\/s \u8bf4\u6162\u4e0d\u6162&#xff0c;\u8bf4\u5feb\u4e0d\u5feb \u54c8\u54c8&#xff09;<\/p>\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u6d4b\u8bd5\u6570\u636e\u89e3\u91ca<\/p>\n<table border=\"1\" cellspacing=\"0\">\n<tbody>\n<tr>\n<td style=\"border-color:black;vertical-align:top;width:85.2pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u6307\u6807<\/p>\n<\/td>\n<td style=\"border-color:black;vertical-align:top;width:40.7pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u5355\u4f4d<\/p>\n<\/td>\n<td style=\"border-color:black;vertical-align:top;width:163.0pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u8bf4\u660e<\/p>\n<\/td>\n<td style=\"border-color:black;vertical-align:top;width:134.7pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\n<\/td>\n<\/tr>\n<tr>\n<td style=\"border-color:black;vertical-align:top;width:85.2pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">FirstTokenTime<\/p>\n<\/td>\n<td style=\"vertical-align:top;width:40.7pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u6beb\u79d2<\/p>\n<\/td>\n<td style=\"vertical-align:top;width:163.0pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u9996 Token \u5ef6\u8fdf&#xff1a;\u4ece\u8bf7\u6c42\u53d1\u9001\u5230\u6536\u5230\u7b2c\u4e00\u4e2a\u8f93\u51fa Token \u7684\u65f6\u95f4&#xff08;\u542b\u7f51\u7edc&#043;\u670d\u52a1\u7aef\u5904\u7406&#xff09;&#xff08;\u53cd\u6620\u7528\u6237\u4f53\u9a8c\u7684\u54cd\u5e94\u901f\u5ea6&#xff09;<\/p>\n<\/td>\n<td style=\"vertical-align:top;width:134.7pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u9ad8\u5e76\u53d1\u4e0b\u9996 Token \u5ef6\u8fdf\u8f83\u9ad8<\/p>\n<\/td>\n<\/tr>\n<tr>\n<td style=\"border-color:black;vertical-align:top;width:85.2pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">DecodeTime<\/p>\n<\/td>\n<td style=\"vertical-align:top;width:40.7pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u6beb\u79d2<\/p>\n<\/td>\n<td style=\"vertical-align:top;width:163.0pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u5355 Token \u89e3\u7801\u5ef6\u8fdf&#xff1a;\u6bcf\u4e2a\u8f93\u51fa Token \u7684\u89e3\u7801\u8017\u65f6&#xff08;\u6a21\u578b\u63a8\u7406\u6838\u5fc3\u65f6\u95f4&#xff09;<\/p>\n<\/td>\n<td style=\"vertical-align:top;width:134.7pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u9ad8\u5e76\u53d1\u5bfc\u81f4\u67d0\u4e9b\u8bf7\u6c42\u6392\u961f\u65f6\u95f4\u6fc0\u589e<\/p>\n<\/td>\n<\/tr>\n<tr>\n<td style=\"border-color:black;vertical-align:top;width:85.2pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">LastDecodeTime<\/p>\n<\/td>\n<td style=\"vertical-align:top;width:40.7pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u6beb\u79d2<\/p>\n<\/td>\n<td style=\"vertical-align:top;width:163.0pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u6700\u540e\u4e00\u4e2a Token \u89e3\u7801\u5ef6\u8fdf&#xff1a;\u751f\u6210\u7ed3\u675f\u524d\u7684\u6700\u7ec8\u89e3\u7801\u8017\u65f6<\/p>\n<\/td>\n<td style=\"vertical-align:top;width:134.7pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u5982\u679c\u8f83\u9996 Token \u7565\u9ad8&#xff0c;\u53ef\u80fd\u56e0\u4e0a\u4e0b\u6587\u589e\u957f\u5bfc\u81f4\u8ba1\u7b97\u91cf\u589e\u52a0<\/p>\n<\/td>\n<\/tr>\n<tr>\n<td style=\"border-color:black;vertical-align:top;width:85.2pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">GenerateTime<\/p>\n<\/td>\n<td style=\"vertical-align:top;width:40.7pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u6beb\u79d2<\/p>\n<\/td>\n<td style=\"vertical-align:top;width:163.0pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u603b\u751f\u6210\u65f6\u95f4**&#xff1a;\u4ece\u8bf7\u6c42\u5f00\u59cb\u5230\u5b8c\u6574\u8f93\u51fa\u751f\u6210\u7684\u603b\u8017\u65f6<\/p>\n<\/td>\n<td style=\"vertical-align:top;width:134.7pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u4e0e &#096;MaxOutputLen&#096; \u5339\u914d&#xff0c;\u6027\u80fd\u548c\u6548\u679c\u8f83\u4e3a\u7406\u60f3<\/p>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">Token\u7edf\u8ba1<\/p>\n<table border=\"1\" cellspacing=\"0\">\n<tbody>\n<tr>\n<td style=\"border-color:black;vertical-align:top;width:107.15pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u6307\u6807<\/p>\n<\/td>\n<td style=\"border-color:black;vertical-align:top;width:32.95pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u5355\u4f4d<\/p>\n<\/td>\n<td style=\"border-color:black;vertical-align:top;width:148.8pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u8bf4\u660e<\/p>\n<\/td>\n<td style=\"border-color:black;vertical-align:top;width:137.2pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\n<\/td>\n<\/tr>\n<tr>\n<td style=\"border-color:black;vertical-align:top;width:107.15pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">InputTokens<\/p>\n<\/td>\n<td style=\"vertical-align:top;width:32.95pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u4e2a<\/p>\n<\/td>\n<td style=\"vertical-align:top;width:148.8pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u8f93\u5165 Token \u6570\u91cf<\/p>\n<\/td>\n<td style=\"vertical-align:top;width:137.2pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u56fa\u5b9a\u4e3a512&#xff08;\u7531 &#096;synthetic_config.json&#096; \u63a7\u5236&#xff09;\u3002<\/p>\n<\/td>\n<\/tr>\n<tr>\n<td style=\"border-color:black;vertical-align:top;width:107.15pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">GeneratedTokens<\/p>\n<\/td>\n<td style=\"vertical-align:top;width:32.95pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u4e2a<\/p>\n<\/td>\n<td style=\"vertical-align:top;width:148.8pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u8f93\u51fa Token \u6570\u91cf<\/p>\n<\/td>\n<td style=\"vertical-align:top;width:137.2pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u56fa\u5b9a\u4e3a512&#xff08;\u53d7 &#096;&#8211;MaxOutputLen 512&#096; \u9650\u5236&#xff09;<\/p>\n<\/td>\n<\/tr>\n<tr>\n<td style=\"border-color:black;vertical-align:top;width:107.15pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">GeneratedTokenSpeed<\/p>\n<\/td>\n<td style=\"vertical-align:top;width:32.95pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u4e2a<\/p>\n<\/td>\n<td style=\"vertical-align:top;width:148.8pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u6bcf\u79d2\u751f\u6210\u7684 Token \u6570&#xff08;\u6574\u4f53\u541e\u5410\u91cf&#xff09;<\/p>\n<\/td>\n<td style=\"vertical-align:top;width:137.2pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u8bf4\u660e\u6a21\u578b\u5e76\u884c\u5904\u7406\u80fd\u529b<\/p>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u5176\u5b83\u6307\u6807<\/p>\n<table border=\"1\" cellspacing=\"0\">\n<tbody>\n<tr>\n<td style=\"border-color:black;vertical-align:top;width:107.15pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u6307\u6807<\/p>\n<\/td>\n<td style=\"border-color:black;vertical-align:top;width:80.6pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u5355\u4f4d<\/p>\n<\/td>\n<td style=\"border-color:black;vertical-align:top;width:112.55pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u8bf4\u660e<\/p>\n<\/td>\n<td style=\"border-color:black;vertical-align:top;width:125.8pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\n<\/td>\n<\/tr>\n<tr>\n<td style=\"border-color:black;vertical-align:top;width:107.15pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">Tokenizer<\/p>\n<\/td>\n<td style=\"vertical-align:top;width:80.6pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u6beb\u79d2<\/p>\n<\/td>\n<td style=\"vertical-align:top;width:112.55pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u8f93\u5165\u5206\u8bcd\u8017\u65f6<\/p>\n<\/td>\n<td style=\"vertical-align:top;width:125.8pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u5982\u679c\u4e3a0&#xff0c;\u53ef\u80fd\u672a\u542f\u7528\u6216\u672a\u8bb0\u5f55\u5206\u8bcd\u6b65\u9aa4<\/p>\n<\/td>\n<\/tr>\n<tr>\n<td style=\"border-color:black;vertical-align:top;width:107.15pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">Detokenizer<\/p>\n<\/td>\n<td style=\"vertical-align:top;width:80.6pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u6beb\u79d2<\/p>\n<\/td>\n<td style=\"vertical-align:top;width:112.55pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u8f93\u51fa\u53cd\u5206\u8bcd\u8017\u65f6<\/p>\n<\/td>\n<td style=\"vertical-align:top;width:125.8pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u53cd\u5e8f\u5217\u5316\u5f00\u9500\u65f6\u95f4<\/p>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u901a\u7528\u6307\u6807<\/p>\n<table border=\"1\" cellspacing=\"0\">\n<tbody>\n<tr>\n<td style=\"border-color:black;vertical-align:top;width:115.4pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u6307\u6807<\/p>\n<\/td>\n<td style=\"border-color:black;vertical-align:top;width:109.55pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u8bf4\u660e<\/p>\n<\/td>\n<td style=\"border-color:black;vertical-align:top;width:198.65pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\n<\/td>\n<\/tr>\n<tr>\n<td style=\"border-color:black;vertical-align:top;width:115.4pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">TimeElapsed<\/p>\n<\/td>\n<td style=\"vertical-align:top;width:109.55pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u603b\u6d4b\u8bd5\u8017\u65f6<\/p>\n<\/td>\n<td style=\"vertical-align:top;width:198.65pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u6d4b\u8bd5\u8fd0\u884c\u65f6\u95f4<\/p>\n<\/td>\n<\/tr>\n<tr>\n<td style=\"border-color:black;vertical-align:top;width:115.4pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">Concurrency<\/p>\n<\/td>\n<td style=\"vertical-align:top;width:109.55pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u5e76\u53d1\u8bf7\u6c42\u6570<\/p>\n<\/td>\n<td style=\"vertical-align:top;width:198.65pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u53cd\u5e8f\u5217\u5316\u5f00\u9500\u65f6\u95f4<\/p>\n<\/td>\n<\/tr>\n<tr>\n<td style=\"border-color:black;vertical-align:top;width:115.4pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">Throughput<\/p>\n<\/td>\n<td style=\"vertical-align:top;width:109.55pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u8bf7\u6c42\u541e\u5410\u91cf<\/p>\n<\/td>\n<td style=\"vertical-align:top;width:198.65pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u541e\u5410\u91cf&#xff0c;\u53d7\u9650\u4e8e\u6a21\u578b\u751f\u6210\u901f\u5ea6<\/p>\n<\/td>\n<\/tr>\n<tr>\n<td style=\"border-color:black;vertical-align:top;width:115.4pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">GenerateSpeed<\/p>\n<\/td>\n<td style=\"vertical-align:top;width:109.55pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u5168\u5c40 Token \u751f\u6210\u901f\u5ea6<\/p>\n<\/td>\n<td style=\"vertical-align:top;width:198.65pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u6240\u6709\u8bf7\u6c42\u7684 Token \u603b\u548c\u9664\u4ee5\u603b\u65f6\u95f4<\/p>\n<\/td>\n<\/tr>\n<tr>\n<td style=\"border-color:black;vertical-align:top;width:115.4pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">GenerateSpeedPerClient<\/p>\n<\/td>\n<td style=\"vertical-align:top;width:109.55pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u5355\u5ba2\u6237\u7aef Token \u901f\u5ea6<\/p>\n<\/td>\n<td style=\"vertical-align:top;width:198.65pt\">\n<p style=\"margin-left:0;margin-right:0;text-align:justify\">\u6bcf\u4e2a\u5e76\u53d1\u8bf7\u6c42\u7684\u5e73\u5747\u901f\u5ea6<\/p>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<h2>8. \u8fdb\u884c\u7cbe\u5ea6\u6d4b\u8bd5<\/h2>\n<p>\u786e\u4fdd\u5df2\u7ecf\u4e0a\u4f20data.tar\u5df2\u7ecf\u4e0a\u4f20\u5230\u670d\u52a1\u5668<\/p>\n<p>8.1 \u8fdb\u5165\u5bb9\u5668<\/p>\n<p>docker exec -it xxxxxx \/bin\/bash <\/p>\n<p>8.2 \u5c06\u6587\u4ef6\u89e3\u538b\u5230\u6307\u5b9a\u76ee\u5f55\u4e0b\u00a0<\/p>\n<p>cd \/usr\/local\/Ascend\/atb-models\/tests\/modeltest<br \/>\nmkdir data<br \/>\ncd data<br \/>\ncp \/home\/HwHiAiUser\/data.tar .<br \/>\ntar -xvf data.tar<br \/>\nrm -rf data.tar <\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u6587\u7ae0\u6d4f\u89c8\u9605\u8bfb788\u6b21\uff0c\u70b9\u8d5e11\u6b21\uff0c\u6536\u85cf16\u6b21\u3002\u5982\u679c\u9a71\u52a8\u4e0d\u662f23.0\u7684\u9a71\u52a8\uff0c\u90a3\u4e48\u5c31\u9700\u8981\u66f4\u65b0\u9a71\u52a8\u524d\u5f80\u5b98\u7f51\u4e0b\u8f7d\u6700\u65b0\u7684 \u9a71\u52a8\u4e0e\u56fa\u4ef6\u6ce8\u610f\u4ea7\u54c1\u7cfb\u5217\u548c\u4ea7\u54c1\u578b\u53f7\u4e0d\u8981\u9009\u9519\uff0c\u8fd9\u8fb9\u6211\u4eec\u4e0b\u8f7d .run\u7684\u7248\u672c\u7136\u540e\u6211\u4eec\u91cd\u542f\u4e00\u4e0b\u670d\u52a1\u5668\u3002<\/p>\n","protected":false},"author":2,"featured_media":34990,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[43,44],"topic":[],"class_list":["post-34998","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-server","tag-43","tag-44"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v20.3 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Atlas 800 9000\u670d\u52a1\u5668 910B \u4e0a\u90e8\u7f72\u5927\u6a21\u578b\uff0c\u4ee5\u53ca\u6d4b\u8bd5 - \u7f51\u7855\u4e92\u8054\u5e2e\u52a9\u4e2d\u5fc3<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.wsisp.com\/helps\/34998.html\" \/>\n<meta property=\"og:locale\" content=\"zh_CN\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Atlas 800 9000\u670d\u52a1\u5668 910B \u4e0a\u90e8\u7f72\u5927\u6a21\u578b\uff0c\u4ee5\u53ca\u6d4b\u8bd5 - \u7f51\u7855\u4e92\u8054\u5e2e\u52a9\u4e2d\u5fc3\" \/>\n<meta property=\"og:description\" content=\"\u6587\u7ae0\u6d4f\u89c8\u9605\u8bfb788\u6b21\uff0c\u70b9\u8d5e11\u6b21\uff0c\u6536\u85cf16\u6b21\u3002\u5982\u679c\u9a71\u52a8\u4e0d\u662f23.0\u7684\u9a71\u52a8\uff0c\u90a3\u4e48\u5c31\u9700\u8981\u66f4\u65b0\u9a71\u52a8\u524d\u5f80\u5b98\u7f51\u4e0b\u8f7d\u6700\u65b0\u7684 \u9a71\u52a8\u4e0e\u56fa\u4ef6\u6ce8\u610f\u4ea7\u54c1\u7cfb\u5217\u548c\u4ea7\u54c1\u578b\u53f7\u4e0d\u8981\u9009\u9519\uff0c\u8fd9\u8fb9\u6211\u4eec\u4e0b\u8f7d .run\u7684\u7248\u672c\u7136\u540e\u6211\u4eec\u91cd\u542f\u4e00\u4e0b\u670d\u52a1\u5668\u3002\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.wsisp.com\/helps\/34998.html\" \/>\n<meta property=\"og:site_name\" content=\"\u7f51\u7855\u4e92\u8054\u5e2e\u52a9\u4e2d\u5fc3\" \/>\n<meta property=\"article:published_time\" content=\"2025-05-01T09:35:57+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.wsisp.com\/helps\/wp-content\/uploads\/2025\/05\/20250501093551-681340771bbe5.png\" \/>\n<meta name=\"author\" content=\"admin\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"\u4f5c\u8005\" \/>\n\t<meta name=\"twitter:data1\" content=\"admin\" \/>\n\t<meta name=\"twitter:label2\" content=\"\u9884\u8ba1\u9605\u8bfb\u65f6\u95f4\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 \u5206\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.wsisp.com\/helps\/34998.html\",\"url\":\"https:\/\/www.wsisp.com\/helps\/34998.html\",\"name\":\"Atlas 800 9000\u670d\u52a1\u5668 910B \u4e0a\u90e8\u7f72\u5927\u6a21\u578b\uff0c\u4ee5\u53ca\u6d4b\u8bd5 - \u7f51\u7855\u4e92\u8054\u5e2e\u52a9\u4e2d\u5fc3\",\"isPartOf\":{\"@id\":\"https:\/\/www.wsisp.com\/helps\/#website\"},\"datePublished\":\"2025-05-01T09:35:57+00:00\",\"dateModified\":\"2025-05-01T09:35:57+00:00\",\"author\":{\"@id\":\"https:\/\/www.wsisp.com\/helps\/#\/schema\/person\/358e386c577a3ab51c4493330a20ad41\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.wsisp.com\/helps\/34998.html#breadcrumb\"},\"inLanguage\":\"zh-Hans\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.wsisp.com\/helps\/34998.html\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.wsisp.com\/helps\/34998.html#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"\u9996\u9875\",\"item\":\"https:\/\/www.wsisp.com\/helps\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Atlas 800 9000\u670d\u52a1\u5668 910B \u4e0a\u90e8\u7f72\u5927\u6a21\u578b\uff0c\u4ee5\u53ca\u6d4b\u8bd5\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.wsisp.com\/helps\/#website\",\"url\":\"https:\/\/www.wsisp.com\/helps\/\",\"name\":\"\u7f51\u7855\u4e92\u8054\u5e2e\u52a9\u4e2d\u5fc3\",\"description\":\"\u9999\u6e2f\u670d\u52a1\u5668_\u9999\u6e2f\u4e91\u670d\u52a1\u5668\u8d44\u8baf_\u670d\u52a1\u5668\u5e2e\u52a9\u6587\u6863_\u670d\u52a1\u5668\u6559\u7a0b\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.wsisp.com\/helps\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"zh-Hans\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.wsisp.com\/helps\/#\/schema\/person\/358e386c577a3ab51c4493330a20ad41\",\"name\":\"admin\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"zh-Hans\",\"@id\":\"https:\/\/www.wsisp.com\/helps\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/gravatar.wp-china-yes.net\/avatar\/?s=96&d=mystery\",\"contentUrl\":\"https:\/\/gravatar.wp-china-yes.net\/avatar\/?s=96&d=mystery\",\"caption\":\"admin\"},\"sameAs\":[\"http:\/\/wp.wsisp.com\"],\"url\":\"https:\/\/www.wsisp.com\/helps\/author\/admin\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Atlas 800 9000\u670d\u52a1\u5668 910B \u4e0a\u90e8\u7f72\u5927\u6a21\u578b\uff0c\u4ee5\u53ca\u6d4b\u8bd5 - \u7f51\u7855\u4e92\u8054\u5e2e\u52a9\u4e2d\u5fc3","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.wsisp.com\/helps\/34998.html","og_locale":"zh_CN","og_type":"article","og_title":"Atlas 800 9000\u670d\u52a1\u5668 910B \u4e0a\u90e8\u7f72\u5927\u6a21\u578b\uff0c\u4ee5\u53ca\u6d4b\u8bd5 - \u7f51\u7855\u4e92\u8054\u5e2e\u52a9\u4e2d\u5fc3","og_description":"\u6587\u7ae0\u6d4f\u89c8\u9605\u8bfb788\u6b21\uff0c\u70b9\u8d5e11\u6b21\uff0c\u6536\u85cf16\u6b21\u3002\u5982\u679c\u9a71\u52a8\u4e0d\u662f23.0\u7684\u9a71\u52a8\uff0c\u90a3\u4e48\u5c31\u9700\u8981\u66f4\u65b0\u9a71\u52a8\u524d\u5f80\u5b98\u7f51\u4e0b\u8f7d\u6700\u65b0\u7684 \u9a71\u52a8\u4e0e\u56fa\u4ef6\u6ce8\u610f\u4ea7\u54c1\u7cfb\u5217\u548c\u4ea7\u54c1\u578b\u53f7\u4e0d\u8981\u9009\u9519\uff0c\u8fd9\u8fb9\u6211\u4eec\u4e0b\u8f7d .run\u7684\u7248\u672c\u7136\u540e\u6211\u4eec\u91cd\u542f\u4e00\u4e0b\u670d\u52a1\u5668\u3002","og_url":"https:\/\/www.wsisp.com\/helps\/34998.html","og_site_name":"\u7f51\u7855\u4e92\u8054\u5e2e\u52a9\u4e2d\u5fc3","article_published_time":"2025-05-01T09:35:57+00:00","og_image":[{"url":"https:\/\/www.wsisp.com\/helps\/wp-content\/uploads\/2025\/05\/20250501093551-681340771bbe5.png"}],"author":"admin","twitter_card":"summary_large_image","twitter_misc":{"\u4f5c\u8005":"admin","\u9884\u8ba1\u9605\u8bfb\u65f6\u95f4":"5 \u5206"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.wsisp.com\/helps\/34998.html","url":"https:\/\/www.wsisp.com\/helps\/34998.html","name":"Atlas 800 9000\u670d\u52a1\u5668 910B \u4e0a\u90e8\u7f72\u5927\u6a21\u578b\uff0c\u4ee5\u53ca\u6d4b\u8bd5 - \u7f51\u7855\u4e92\u8054\u5e2e\u52a9\u4e2d\u5fc3","isPartOf":{"@id":"https:\/\/www.wsisp.com\/helps\/#website"},"datePublished":"2025-05-01T09:35:57+00:00","dateModified":"2025-05-01T09:35:57+00:00","author":{"@id":"https:\/\/www.wsisp.com\/helps\/#\/schema\/person\/358e386c577a3ab51c4493330a20ad41"},"breadcrumb":{"@id":"https:\/\/www.wsisp.com\/helps\/34998.html#breadcrumb"},"inLanguage":"zh-Hans","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.wsisp.com\/helps\/34998.html"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.wsisp.com\/helps\/34998.html#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"\u9996\u9875","item":"https:\/\/www.wsisp.com\/helps"},{"@type":"ListItem","position":2,"name":"Atlas 800 9000\u670d\u52a1\u5668 910B \u4e0a\u90e8\u7f72\u5927\u6a21\u578b\uff0c\u4ee5\u53ca\u6d4b\u8bd5"}]},{"@type":"WebSite","@id":"https:\/\/www.wsisp.com\/helps\/#website","url":"https:\/\/www.wsisp.com\/helps\/","name":"\u7f51\u7855\u4e92\u8054\u5e2e\u52a9\u4e2d\u5fc3","description":"\u9999\u6e2f\u670d\u52a1\u5668_\u9999\u6e2f\u4e91\u670d\u52a1\u5668\u8d44\u8baf_\u670d\u52a1\u5668\u5e2e\u52a9\u6587\u6863_\u670d\u52a1\u5668\u6559\u7a0b","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.wsisp.com\/helps\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"zh-Hans"},{"@type":"Person","@id":"https:\/\/www.wsisp.com\/helps\/#\/schema\/person\/358e386c577a3ab51c4493330a20ad41","name":"admin","image":{"@type":"ImageObject","inLanguage":"zh-Hans","@id":"https:\/\/www.wsisp.com\/helps\/#\/schema\/person\/image\/","url":"https:\/\/gravatar.wp-china-yes.net\/avatar\/?s=96&d=mystery","contentUrl":"https:\/\/gravatar.wp-china-yes.net\/avatar\/?s=96&d=mystery","caption":"admin"},"sameAs":["http:\/\/wp.wsisp.com"],"url":"https:\/\/www.wsisp.com\/helps\/author\/admin"}]}},"_links":{"self":[{"href":"https:\/\/www.wsisp.com\/helps\/wp-json\/wp\/v2\/posts\/34998","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.wsisp.com\/helps\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.wsisp.com\/helps\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.wsisp.com\/helps\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.wsisp.com\/helps\/wp-json\/wp\/v2\/comments?post=34998"}],"version-history":[{"count":0,"href":"https:\/\/www.wsisp.com\/helps\/wp-json\/wp\/v2\/posts\/34998\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.wsisp.com\/helps\/wp-json\/wp\/v2\/media\/34990"}],"wp:attachment":[{"href":"https:\/\/www.wsisp.com\/helps\/wp-json\/wp\/v2\/media?parent=34998"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.wsisp.com\/helps\/wp-json\/wp\/v2\/categories?post=34998"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.wsisp.com\/helps\/wp-json\/wp\/v2\/tags?post=34998"},{"taxonomy":"topic","embeddable":true,"href":"https:\/\/www.wsisp.com\/helps\/wp-json\/wp\/v2\/topic?post=34998"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}