{"id":103579,"date":"2026-09-11T01:49:10","date_gmt":"2026-09-10T17:49:10","guid":{"rendered":"https:\/\/www.wsisp.com\/helps\/103579.html"},"modified":"2026-09-11T01:49:10","modified_gmt":"2026-09-10T17:49:10","slug":"%e9%80%90%e5%85%83%e7%b4%a0%e7%ae%97%e5%ad%90%e9%93%be%e8%9e%8d%e5%90%88","status":"publish","type":"post","link":"https:\/\/www.wsisp.com\/helps\/103579.html","title":{"rendered":"\u9010\u5143\u7d20\u7b97\u5b50\u94fe\u878d\u5408"},"content":{"rendered":"

\u6982\u8ff0<\/h2>\n

\u5982\u679c\u4e00\u4e32\u7b97\u5b50\u90fd\u662f"\u9010\u5143\u7d20"\u7684（\u5bf9\u6bcf\u4e2a\u5143\u7d20\u72ec\u7acb\u505a\u540c\u6837\u7684\u8fd0\u7b97），\u90a3\u4e48\u53ef\u4ee5\u628a\u5b83\u4eec\u5408\u5e76\u5230\u4e00\u4e2a\u5faa\u73af\u91cc，\u6bcf\u4e2a\u5143\u7d20\u4ece\u5934\u5230\u5c3e\u7b97\u5b8c，\u4e2d\u95f4\u7ed3\u679c\u53ea\u6d3b\u5728\u5bc4\u5b58\u5668\u91cc\u3002<\/p>\n

\u5f62\u5982\u00a0y = max(0.1, tanh(x)) * 2 + 1\u00a0\u7684\u9010\u5143\u7d20\u94fe（\u6fc0\u6d3b\u3001\u5f52\u4e00\u5316\u3001\u6b8b\u5dee\u52a0\u3001\u7f29\u653e\u2026\u2026）<\/p>\n

\n

\u5148\u7406\u89e3\u4ec0\u4e48\u662f"\u9010\u5143\u7d20\u7b97\u5b50"<\/h2>\n

\u9010\u5143\u7d20\u7b97\u5b50（Elementwise Operator）：\u5bf9\u5f20\u91cf\u91cc\u7684\u6bcf\u4e2a\u5143\u7d20\u72ec\u7acb\u505a\u540c\u6837\u7684\u8fd0\u7b97，\u8f93\u51fa\u5f62\u72b6\u548c\u8f93\u5165\u5f62\u72b6\u76f8\u540c，\u4e14\u8f93\u51fa\u5750\u6807 = \u8f93\u5165\u5750\u6807\u3002<\/p>\n

\u6bd4\u5982：<\/p>\n\n\u7b97\u5b50\u516c\u5f0f\u8f93\u5165\u8f93\u51fa<\/tr>\n\n\n\n\n\n
tanh<\/td>\ny[i]=tanh\u2061(x[i])y[i] = \\\\tanh(x[i])<\/span><\/span>y<\/span>[<\/span>i<\/span>]<\/span><\/span>=<\/span><\/span><\/span><\/span>tanh<\/span>(<\/span>x<\/span>[<\/span>i<\/span>])<\/span><\/span><\/span><\/span><\/span><\/td>\nx[0],x[1],\u2026x[0], x[1], \\\\dots<\/span><\/span>x<\/span>[<\/span>0<\/span>]<\/span>,<\/span><\/span>x<\/span>[<\/span>1<\/span>]<\/span>,<\/span><\/span>\u2026<\/span><\/span><\/span><\/span><\/span><\/td>\ny[0],y[1],\u2026y[0], y[1], \\\\dots<\/span><\/span>y<\/span>[<\/span>0<\/span>]<\/span>,<\/span><\/span>y<\/span>[<\/span>1<\/span>]<\/span>,<\/span><\/span>\u2026<\/span><\/span><\/span><\/span><\/span><\/td>\n<\/tr>\n
\u7f29\u653e<\/td>\ny[i]=x[i]\u00d72y[i] = x[i] \\\\times 2<\/span><\/span>y<\/span>[<\/span>i<\/span>]<\/span><\/span>=<\/span><\/span><\/span><\/span>x<\/span>[<\/span>i<\/span>]<\/span><\/span>\u00d7<\/span><\/span><\/span><\/span>2<\/span><\/span><\/span><\/span><\/span><\/td>\n\u540c\u4e0a<\/td>\n\u540c\u4e0a<\/td>\n<\/tr>\n
\u5e73\u79fb<\/td>\ny[i]=x[i]+1y[i] = x[i] + 1<\/span><\/span>y<\/span>[<\/span>i<\/span>]<\/span><\/span>=<\/span><\/span><\/span><\/span>x<\/span>[<\/span>i<\/span>]<\/span><\/span>+<\/span><\/span><\/span><\/span>1<\/span><\/span><\/span><\/span><\/span><\/td>\n\u540c\u4e0a<\/td>\n\u540c\u4e0a<\/td>\n<\/tr>\n
max<\/td>\ny[i]=max\u2061(x[i],0.1)y[i] = \\\\max(x[i], 0.1)<\/span><\/span>y<\/span>[<\/span>i<\/span>]<\/span><\/span>=<\/span><\/span><\/span><\/span>max<\/span>(<\/span>x<\/span>[<\/span>i<\/span>]<\/span>,<\/span><\/span>0.1<\/span>)<\/span><\/span><\/span><\/span><\/span><\/td>\n\u540c\u4e0a<\/td>\n\u540c\u4e0a<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

\u5173\u952e\u7279\u5f81：\u7b2c i \u4e2a\u8f93\u51fa\u5143\u7d20\u53ea\u4f9d\u8d56\u7b2c i \u4e2a\u8f93\u5165\u5143\u7d20，\u4e0d\u4f9d\u8d56\u5176\u4ed6\u4f4d\u7f6e\u7684\u5143\u7d20\u3002<\/p>\n

\u8fd9\u5c31\u662f"\u9010\u5143\u7d20"\u7684\u542b\u4e49<\/p>\n

\n

\u95ee\u9898\u5728\u54ea\u91cc？<\/h2>\n

\u5047\u8bbe\u6709\u4e00\u4e2a 5 \u4e2a\u7b97\u5b50\u7684\u94fe：<\/p>\n

y = max(0.1, tanh(x) * 2 + 1)<\/p>\n

\u5b83\u62c6\u6210 5 \u4e2a\u7b97\u5b50：<\/p>\n

t1 = tanh(x) # \u2460 \u53cc\u66f2\u6b63\u5207
\nt2 = t1 * 2 # \u2461 \u7f29\u653e
\nt3 = t2 + 1 # \u2462 \u5e73\u79fb
\nt4 = max(t3, 0.1) # \u2463 \u4e0b\u9650\u622a\u65ad
\ny = t4 # \u2464 \u8d4b\u503c（\u53ef\u80fd\u8fd8\u6709\u66f4\u591a）<\/p>\n

\u5982\u679c\u6bcf\u4e2a\u7b97\u5b50\u5355\u72ec\u8dd1\u4e00\u4e2a kernel：<\/p>\n

kernel1: \u8bfb x[N]，\u5199 t1[N] \u2192 DRAM \u6d41\u91cf：\u8bfb N + \u5199 N
\nkernel2: \u8bfb t1[N]，\u5199 t2[N] \u2192 DRAM \u6d41\u91cf：\u8bfb N + \u5199 N
\nkernel3: \u8bfb t2[N]，\u5199 t3[N] \u2192 DRAM \u6d41\u91cf：\u8bfb N + \u5199 N
\nkernel4: \u8bfb t3[N]，\u5199 t4[N] \u2192 DRAM \u6d41\u91cf：\u8bfb N + \u5199 N
\nkernel5: \u8bfb t4[N]，\u5199 y[N] \u2192 DRAM \u6d41\u91cf：\u8bfb N + \u5199 N<\/p>\n

\u5047\u8bbe\u6bcf\u4e2a\u5f20\u91cf\u5927\u5c0f\u662f S \u5b57\u8282（N \u4e2a\u5143\u7d20，\u6bcf\u4e2a\u5143\u7d20\u82e5\u5e72\u5b57\u8282），\u90a3\u4e48\u4e0d\u878d\u5408\u7684\u603b DRAM \u6d41\u91cf\u662f：
\n5\u00d7(2S)=10S
\n5\u00d7(2S)=10S
\n<\/span><\/span>5<\/span><\/span>\u00d7<\/span><\/span><\/span><\/span>(<\/span>2<\/span>S<\/span>)<\/span><\/span>=<\/span><\/span><\/span><\/span>10<\/span>S<\/span><\/span><\/span><\/span><\/span><\/span><\/p>\n

\u5373：\u6bcf\u4e2a\u4e2d\u95f4\u5f20\u91cf\u90fd\u8981\u88ab\u5199\u4e00\u6b21\u3001\u8bfb\u4e00\u6b21，\u5171 5 \u5bf9\u8bfb\u5199\u3002<\/p>\n

\n

\u5177\u4f53\u6570\u503c\u4f8b\u5b50<\/h2>\n

\u4e3a\u4e86\u7b80\u5355，\u5047\u8bbe：<\/p>\n

    \n
  • \u5f20\u91cf\u5927\u5c0f N = 4（4 \u4e2a\u5143\u7d20）<\/li>\n
  • \u8f93\u5165 x =\u00a0[0.5, 1.0, -0.5, 2.0]<\/li>\n
  • \u6bcf\u4e2a\u5143\u7d20\u662f f32（4 \u5b57\u8282），\u6240\u4ee5 S = 4\u00d74 = 16 \u5b57\u8282<\/li>\n<\/ul>\n

    \u6b65\u9aa4 1：\u4e0d\u878d\u5408，\u9010\u4e2a\u7b97\u5b50\u7b97<\/h3>\n

    t1 = tanh(x)<\/h4>\n

    tanh\u2061(0.5)=0.462,tanh\u2061(1.0)=0.762,tanh\u2061(\u22120.5)=\u22120.462,tanh\u2061(2.0)=0.964
    \n\\\\tanh(0.5) = 0.462, \\\\quad \\\\tanh(1.0) = 0.762, \\\\quad \\\\tanh(-0.5) = -0.462, \\\\quad \\\\tanh(2.0) = 0.964
    \n<\/span><\/span>tanh<\/span>(<\/span>0.5<\/span>)<\/span><\/span>=<\/span><\/span><\/span><\/span>0.462<\/span>,<\/span><\/span><\/span>tanh<\/span>(<\/span>1.0<\/span>)<\/span><\/span>=<\/span><\/span><\/span><\/span>0.762<\/span>,<\/span><\/span><\/span>tanh<\/span>(<\/span>\u2212<\/span>0.5<\/span>)<\/span><\/span>=<\/span><\/span><\/span><\/span>\u2212<\/span>0.462<\/span>,<\/span><\/span><\/span>tanh<\/span>(<\/span>2.0<\/span>)<\/span><\/span>=<\/span><\/span><\/span><\/span>0.964<\/span><\/span><\/span><\/span><\/span><\/span><\/p>\n

    t1=[0.462,0.762,\u22120.462,0.964]
    \nt1 = [0.462, 0.762, -0.462, 0.964]
    \n<\/span><\/span>t<\/span>1<\/span><\/span>=<\/span><\/span><\/span><\/span>[<\/span>0.462<\/span>,<\/span><\/span>0.762<\/span>,<\/span><\/span>\u2212<\/span>0.462<\/span>,<\/span><\/span>0.964<\/span>]<\/span><\/span><\/span><\/span><\/span><\/span><\/p>\n

    t2 = t1 \u00d7 2<\/h4>\n

    t2=[0.924,1.524,\u22120.924,1.928]
    \nt2 = [0.924, 1.524, -0.924, 1.928]
    \n<\/span><\/span>t<\/span>2<\/span><\/span>=<\/span><\/span><\/span><\/span>[<\/span>0.924<\/span>,<\/span><\/span>1.524<\/span>,<\/span><\/span>\u2212<\/span>0.924<\/span>,<\/span><\/span>1.928<\/span>]<\/span><\/span><\/span><\/span><\/span><\/span><\/p>\n

    t3 = t2 + 1<\/h4>\n

    t2=[1.924,2.524,0.076,2.928]
    \nt2 = [1.924,2.524,0.076,2.928]
    \n<\/span><\/span>t<\/span>2<\/span><\/span>=<\/span><\/span><\/span><\/span>[<\/span>1.924<\/span>,<\/span><\/span>2.524<\/span>,<\/span><\/span>0.076<\/span>,<\/span><\/span>2.928<\/span>]<\/span><\/span><\/span><\/span><\/span><\/span><\/p>\n

    t4 = max(t3, 0.1)<\/h4>\n

    t4=[1.924,2.524,0.1,2.928]
    \nt4=[1.924,2.524,0.1,2.928]
    \n<\/span><\/span>t<\/span>4<\/span><\/span>=<\/span><\/span><\/span><\/span>[<\/span>1.924<\/span>,<\/span><\/span>2.524<\/span>,<\/span><\/span>0.1<\/span>,<\/span><\/span>2.928<\/span>]<\/span><\/span><\/span><\/span><\/span><\/span><\/p>\n

    y = t4<\/h4>\n

    y=[1.924,2.524,0.1,2.928]
    \ny=[1.924,2.524,0.1,2.928]
    \n<\/span><\/span>y<\/span><\/span>=<\/span><\/span><\/span><\/span>[<\/span>1.924<\/span>,<\/span><\/span>2.524<\/span>,<\/span><\/span>0.1<\/span>,<\/span><\/span>2.928<\/span>]<\/span><\/span><\/span><\/span><\/span><\/span><\/p>\n

    \u4e0d\u878d\u5408\u7684\u6700\u7ec8\u7ed3\u679c：[1.924, 2.524, 0.1, 2.928]<\/p>\n

    DRAM \u6d41\u91cf：<\/p>\n\n\u7b97\u5b50\u8bfb\u5199<\/tr>\n\n\n\n\n\n\n
    tanh<\/td>\n16 B (x)<\/td>\n16 B (t1)<\/td>\n<\/tr>\n
    \u00d72<\/td>\n16 B (t1)<\/td>\n16 B (t2)<\/td>\n<\/tr>\n
    +1<\/td>\n16 B (t2)<\/td>\n16 B (t3)<\/td>\n<\/tr>\n
    max<\/td>\n16 B (t3)<\/td>\n16 B (t4)<\/td>\n<\/tr>\n
    \u8d4b\u503c<\/td>\n16 B (t4)<\/td>\n16 B (y)<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

    \u6b65\u9aa4 2：\u878d\u5408\u540e，\u4e00\u4e2a kernel \u7b97\u5b8c<\/h3>\n

    \u878d\u5408\u540e\u7684 kernel \u53ea\u6709\u4e00\u4e2a\u5faa\u73af，\u904d\u5386\u6240\u6709\u5143\u7d20：<\/p>\n

    for i in 0..N:
    \n t1 = tanh(x[i])
    \n t2 = t1 * 2
    \n t3 = t2 + 1
    \n y[i] = max(t3, 0.1)<\/p>\n

    \u5bf9\u4e8e i=0：x[0]=0.5<\/p>\n

      \n
    • t1 = tanh(0.5) = 0.462<\/li>\n
    • t2 = 0.462 \u00d7 2 = 0.924<\/li>\n
    • t3 = 0.924 + 1 = 1.924<\/li>\n
    • y[0] = max(1.924, 0.1) = 1.924<\/li>\n<\/ul>\n

      \u5bf9\u4e8e i=1：x[1]=1.0<\/p>\n

        \n
      • t1 = tanh(1.0) = 0.762<\/li>\n
      • t2 = 0.762 \u00d7 2 = 1.524<\/li>\n
      • t3 = 1.524 + 1 = 2.524<\/li>\n
      • y[1] = max(2.524, 0.1) = 2.524<\/li>\n<\/ul>\n

        \u5bf9\u4e8e i=2：x[2]=-0.5<\/p>\n

          \n
        • t1 = tanh(-0.5) = -0.462<\/li>\n
        • t2 = -0.462 \u00d7 2 = -0.924<\/li>\n
        • t3 = -0.924 + 1 = 0.076<\/li>\n
        • y[2] = max(0.076, 0.1) = 0.1<\/li>\n<\/ul>\n

          \u5bf9\u4e8e i=3：x[3]=2.0<\/p>\n

            \n
          • t1 = tanh(2.0) = 0.964<\/li>\n
          • t2 = 0.964 \u00d7 2 = 1.928<\/li>\n
          • t3 = 1.928 + 1 = 2.928<\/li>\n
          • y[3] = max(2.928, 0.1) = 2.928<\/li>\n<\/ul>\n

            \u878d\u5408\u540e\u7684\u6700\u7ec8\u7ed3\u679c：[1.924, 2.524, 0.1, 2.928]\u00a0\u2705 \u4e0e\u4e0d\u878d\u5408\u5b8c\u5168\u4e00\u81f4\u3002<\/p>\n

            DRAM \u6d41\u91cf：<\/p>\n\n\u64cd\u4f5c\u8bfb\u5199<\/tr>\n\n\n
            \u878d\u5408 kernel<\/td>\n16 B (x)<\/td>\n16 B (y)<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

            \u603b\u8ba1：32 \u5b57\u8282（2S = 2\u00d716 = 32）\u3002<\/p>\n

            \n

            \u878d\u5408\u524d\u540e\u5bf9\u6bd4<\/h2>\n\n\u7ef4\u5ea6\u4e0d\u878d\u5408\u878d\u5408\u540e<\/tr>\n\n\n\n\n\n\n
            Kernel \u6570\u91cf<\/td>\n5 \u4e2a<\/td>\n1 \u4e2a<\/td>\n<\/tr>\n
            DRAM \u6d41\u91cf<\/td>\n10S = 160 B<\/td>\n2S = 32 B<\/td>\n<\/tr>\n
            \u4e2d\u95f4\u5f20\u91cf t1~t4<\/td>\n\u90fd\u5199\u56de DRAM，\u518d\u8bfb\u51fa\u6765<\/td>\n\u53ea\u6d3b\u5728\u5bc4\u5b58\u5668\u91cc<\/td>\n<\/tr>\n
            Kernel \u542f\u52a8\u5f00\u9500<\/td>\n5 \u6b21<\/td>\n1 \u6b21<\/td>\n<\/tr>\n
            \u6700\u7ec8\u7ed3\u679c<\/td>\n\u76f8\u540c<\/td>\n\u76f8\u540c<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

            \u6d41\u91cf\u51cf\u5c11\u5230\u539f\u6765\u7684 1\/5\u3002\u5982\u679c\u94fe\u4e0a\u6709 50 \u4e2a\u9010\u5143\u7d20\u7b97\u5b50，\u6d41\u91cf\u51cf\u5c11\u5230 1\/50\u3002<\/p>\n

            \n

            \u4e3a\u4ec0\u4e48\u9010\u5143\u7d20\u94fe\u53ef\u4ee5"\u767d\u9001"\u5730\u878d\u5408？<\/h2>\n

            \u5173\u952e\u539f\u56e0：\u8f93\u51fa\u5750\u6807 = \u8f93\u5165\u5750\u6807（\u6052\u7b49\u6620\u5c04）\u3002<\/p>\n

              \n
            • \u5bf9\u4e8e\u7b2c i \u4e2a\u8f93\u51fa\u5143\u7d20\u00a0y[i]，\u5b83\u53ea\u4f9d\u8d56\u00a0x[i]，\u4e0d\u9700\u8981\u8bbf\u95ee\u00a0x\u00a0\u7684\u5176\u4ed6\u4f4d\u7f6e\u3002<\/li>\n
            • \u6240\u4ee5\u4e00\u4e2a\u5faa\u73af\u904d\u5386 i \u4ece 0 \u5230 N-1，\u6bcf\u4e2a i \u72ec\u7acb\u5730\u628a\u6574\u6761\u94fe\u7b97\u5b8c，\u4e0d\u5b58\u5728\u5750\u6807\u6362\u7b97\u8d1f\u62c5\u3002<\/li>\n<\/ul>\n

              \u5bf9\u6bd4\u5377\u79ef：\u5377\u79ef\u7684\u8f93\u51fa\u00a0(n, co, ho, wo)\u00a0\u9700\u8981\u8bbf\u95ee\u8f93\u5165\u7684\u7a97\u53e3\u00a0(n, ci, ho * s+kh, wo * s+kw)，\u6d89\u53ca stride\u3001padding \u7b49\u590d\u6742\u5750\u6807\u6620\u5c04\u3002\u6240\u4ee5\u5377\u79ef\u878d\u5408\u7684\u7d22\u5f15\u63a8\u5bfc\u66f4\u96be，\u800c\u9010\u5143\u7d20\u94fe\u878d\u5408\u662f"\u6700\u7b80\u5355\u3001\u6700\u5b89\u5168"\u7684\u878d\u5408\u3002<\/p>\n

              \n

              \u4ec0\u4e48\u60c5\u51b5\u4e0b\u4e0d\u80fd\u878d\u5408？<\/h2>\n

              \u9010\u5143\u7d20\u94fe\u878d\u5408\u7684\u524d\u63d0\u662f：<\/p>\n

              \u6240\u6709\u7b97\u5b50\u90fd\u662f\u9010\u5143\u7d20\u7684：\u4e0d\u80fd\u6709\u00a0reduce（\u5982\u00a0sum\u3001mean）\u3001reshape\u3001transpose\u3001matmul\u00a0\u7b49\u8de8\u5143\u7d20\u64cd\u4f5c\u3002<\/p>\n

              \u6ca1\u6709\u526f\u4f5c\u7528：\u4e0d\u80fd\u6709\u00a0print\u3001\u6587\u4ef6\u5199\u5165\u3001\u968f\u673a\u6570\u751f\u6210（\u6bcf\u6b21\u7ed3\u679c\u4e0d\u540c）\u3002<\/p>\n

              \u6ca1\u6709\u5206\u652f\u6539\u53d8\u5f62\u72b6：\u4e0d\u80fd\u6709\u00a0if\u00a0\u5bfc\u81f4\u8f93\u51fa\u5f62\u72b6\u53d8\u5316\u3002<\/p>\n

              \u5982\u679c\u94fe\u4e2d\u6df7\u5165\u4e86\u4e00\u4e2a\u975e\u9010\u5143\u7d20\u7b97\u5b50（\u6bd4\u5982\u4e2d\u95f4\u5939\u4e86\u4e00\u4e2a\u00a0softmax），\u878d\u5408\u5c31\u4f1a\u88ab\u6253\u65ad，\u9700\u8981\u5206\u6bb5\u5904\u7406\u3002<\/p>\n

              \n

              \u603b\u7ed3<\/h2>\n

              \u9010\u5143\u7d20\u7b97\u5b50\u94fe\u878d\u5408：\u56e0\u4e3a\u6bcf\u4e2a\u8f93\u51fa\u5143\u7d20\u53ea\u4f9d\u8d56\u5bf9\u5e94\u7684\u8f93\u5165\u5143\u7d20（\u6052\u7b49\u5750\u6807\u6620\u5c04），\u6240\u4ee5\u53ef\u4ee5\u628a\u6574\u6761\u94fe\u585e\u8fdb\u4e00\u4e2a\u5faa\u73af，\u6bcf\u4e2a\u5143\u7d20\u4ece\u5934\u7b97\u5230\u5c3e，\u4e2d\u95f4\u7ed3\u679c\u53ea\u6d3b\u5728\u5bc4\u5b58\u5668\u91cc\u3002<\/p>\n

              DRAM \u6d41\u91cf\u4ece\u00a02 \u00d7 \u7b97\u5b50\u6570 \u00d7 S\u00a0\u964d\u5230\u00a02S（\u53ea\u8bfb\u8f93\u5165\u4e00\u6b21\u3001\u5199\u8f93\u51fa\u4e00\u6b21），\u662f\u6700\u7b80\u5355\u3001\u6536\u76ca\u6700\u76f4\u63a5\u7684\u878d\u5408\u6a21\u5f0f\u3002<\/p>\n

              \u8fd9\u4e5f\u662f\u4e3a\u4ec0\u4e48\u6fc0\u6d3b\u51fd\u6570\u3001\u7f29\u653e\u5e73\u79fb\u3001\u9010\u5143\u7d20\u52a0\u7b49\u7b97\u5b50\u5728\u51e0\u4e4e\u6240\u6709\u63a8\u7406\u5f15\u64ce\u91cc\u90fd\u662f"\u514d\u8d39"\u878d\u5408\u7684\u3002<\/p>\n","protected":false},"excerpt":{"rendered":"

              \u6982\u8ff0
              \n\u5982\u679c\u4e00\u4e32\u7b97\u5b50\u90fd\u662f\\”\u9010\u5143\u7d20\\”\u7684（\u5bf9\u6bcf\u4e2a\u5143\u7d20\u72ec\u7acb\u505a\u540c\u6837\u7684\u8fd0\u7b97），\u90a3\u4e48\u53ef\u4ee5\u628a\u5b83\u4eec\u5408\u5e76\u5230\u4e00\u4e2a\u5faa\u73af\u91cc，\u6bcf\u4e2a\u5143\u7d20\u4ece\u5934\u5230\u5c3e\u7b97\u5b8c，\u4e2d\u95f4\u7ed3\u679c\u53ea\u6d3b\u5728\u5bc4\u5b58\u5668\u91cc\u3002
              \n\u5f62\u5982\u00a0y max(0.1, tanh(x)) * 2 1\u00a0\u7684\u9010\u5143\u7d20\u94fe（\u6fc0\u6d3b\u3001\u5f52\u4e00\u5316\u3001\u6b8b\u5dee\u52a0\u3001\u7f29\u653e\u2026\u2026）\u5148\u7406\u89e3\u4ec0\u4e48\u662f\\”\u9010\u5143\u7d20\u7b97\u5b50\\”
              \n\u9010\u5143\u7d20\u7b97\u5b50（Elementwise Operator）：\u5bf9\u5f20<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[99,43,78],"topic":[],"class_list":["post-103579","post","type-post","status-publish","format-standard","hentry","category-server","tag-java","tag-43","tag-78"],"yoast_head":"\n\u9010\u5143\u7d20\u7b97\u5b50\u94fe\u878d\u5408 - \u7f51\u7855\u4e92\u8054\u5e2e\u52a9\u4e2d\u5fc3<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.wsisp.com\/helps\/103579.html\" \/>\n<meta property=\"og:locale\" content=\"zh_CN\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"\u9010\u5143\u7d20\u7b97\u5b50\u94fe\u878d\u5408 - \u7f51\u7855\u4e92\u8054\u5e2e\u52a9\u4e2d\u5fc3\" \/>\n<meta property=\"og:description\" content=\"\u6982\u8ff0 \u5982\u679c\u4e00\u4e32\u7b97\u5b50\u90fd\u662f"\u9010\u5143\u7d20"\u7684（\u5bf9\u6bcf\u4e2a\u5143\u7d20\u72ec\u7acb\u505a\u540c\u6837\u7684\u8fd0\u7b97），\u90a3\u4e48\u53ef\u4ee5\u628a\u5b83\u4eec\u5408\u5e76\u5230\u4e00\u4e2a\u5faa\u73af\u91cc，\u6bcf\u4e2a\u5143\u7d20\u4ece\u5934\u5230\u5c3e\u7b97\u5b8c，\u4e2d\u95f4\u7ed3\u679c\u53ea\u6d3b\u5728\u5bc4\u5b58\u5668\u91cc\u3002 \u5f62\u5982\u00a0y max(0.1, tanh(x)) * 2 1\u00a0\u7684\u9010\u5143\u7d20\u94fe（\u6fc0\u6d3b\u3001\u5f52\u4e00\u5316\u3001\u6b8b\u5dee\u52a0\u3001\u7f29\u653e\u2026\u2026）\u5148\u7406\u89e3\u4ec0\u4e48\u662f"\u9010\u5143\u7d20\u7b97\u5b50" \u9010\u5143\u7d20\u7b97\u5b50（Elementwise Operator）：\u5bf9\u5f20\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.wsisp.com\/helps\/103579.html\" \/>\n<meta property=\"og:site_name\" content=\"\u7f51\u7855\u4e92\u8054\u5e2e\u52a9\u4e2d\u5fc3\" \/>\n<meta property=\"article:published_time\" content=\"2026-09-10T17:49:10+00:00\" \/>\n<meta name=\"author\" content=\"admin\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"\u4f5c\u8005\" \/>\n\t<meta name=\"twitter:data1\" content=\"admin\" \/>\n\t<meta name=\"twitter:label2\" content=\"\u9884\u8ba1\u9605\u8bfb\u65f6\u95f4\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 \u5206\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.wsisp.com\/helps\/103579.html\",\"url\":\"https:\/\/www.wsisp.com\/helps\/103579.html\",\"name\":\"\u9010\u5143\u7d20\u7b97\u5b50\u94fe\u878d\u5408 - \u7f51\u7855\u4e92\u8054\u5e2e\u52a9\u4e2d\u5fc3\",\"isPartOf\":{\"@id\":\"https:\/\/www.wsisp.com\/helps\/#website\"},\"datePublished\":\"2026-09-10T17:49:10+00:00\",\"dateModified\":\"2026-09-10T17:49:10+00:00\",\"author\":{\"@id\":\"https:\/\/www.wsisp.com\/helps\/#\/schema\/person\/358e386c577a3ab51c4493330a20ad41\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.wsisp.com\/helps\/103579.html#breadcrumb\"},\"inLanguage\":\"zh-Hans\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.wsisp.com\/helps\/103579.html\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.wsisp.com\/helps\/103579.html#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"\u9996\u9875\",\"item\":\"https:\/\/www.wsisp.com\/helps\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"\u9010\u5143\u7d20\u7b97\u5b50\u94fe\u878d\u5408\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.wsisp.com\/helps\/#website\",\"url\":\"https:\/\/www.wsisp.com\/helps\/\",\"name\":\"\u7f51\u7855\u4e92\u8054\u5e2e\u52a9\u4e2d\u5fc3\",\"description\":\"\u9999\u6e2f\u670d\u52a1\u5668_\u9999\u6e2f\u4e91\u670d\u52a1\u5668\u8d44\u8baf_\u670d\u52a1\u5668\u5e2e\u52a9\u6587\u6863_\u670d\u52a1\u5668\u6559\u7a0b\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.wsisp.com\/helps\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"zh-Hans\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.wsisp.com\/helps\/#\/schema\/person\/358e386c577a3ab51c4493330a20ad41\",\"name\":\"admin\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"zh-Hans\",\"@id\":\"https:\/\/www.wsisp.com\/helps\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/gravatar.wp-china-yes.net\/avatar\/?s=96&d=mystery\",\"contentUrl\":\"https:\/\/gravatar.wp-china-yes.net\/avatar\/?s=96&d=mystery\",\"caption\":\"admin\"},\"sameAs\":[\"http:\/\/wp.wsisp.com\"],\"url\":\"https:\/\/www.wsisp.com\/helps\/author\/admin\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"\u9010\u5143\u7d20\u7b97\u5b50\u94fe\u878d\u5408 - \u7f51\u7855\u4e92\u8054\u5e2e\u52a9\u4e2d\u5fc3","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.wsisp.com\/helps\/103579.html","og_locale":"zh_CN","og_type":"article","og_title":"\u9010\u5143\u7d20\u7b97\u5b50\u94fe\u878d\u5408 - \u7f51\u7855\u4e92\u8054\u5e2e\u52a9\u4e2d\u5fc3","og_description":"\u6982\u8ff0 \u5982\u679c\u4e00\u4e32\u7b97\u5b50\u90fd\u662f\"\u9010\u5143\u7d20\"\u7684（\u5bf9\u6bcf\u4e2a\u5143\u7d20\u72ec\u7acb\u505a\u540c\u6837\u7684\u8fd0\u7b97），\u90a3\u4e48\u53ef\u4ee5\u628a\u5b83\u4eec\u5408\u5e76\u5230\u4e00\u4e2a\u5faa\u73af\u91cc，\u6bcf\u4e2a\u5143\u7d20\u4ece\u5934\u5230\u5c3e\u7b97\u5b8c，\u4e2d\u95f4\u7ed3\u679c\u53ea\u6d3b\u5728\u5bc4\u5b58\u5668\u91cc\u3002 \u5f62\u5982\u00a0y max(0.1, tanh(x)) * 2 1\u00a0\u7684\u9010\u5143\u7d20\u94fe（\u6fc0\u6d3b\u3001\u5f52\u4e00\u5316\u3001\u6b8b\u5dee\u52a0\u3001\u7f29\u653e\u2026\u2026）\u5148\u7406\u89e3\u4ec0\u4e48\u662f\"\u9010\u5143\u7d20\u7b97\u5b50\" \u9010\u5143\u7d20\u7b97\u5b50（Elementwise Operator）：\u5bf9\u5f20","og_url":"https:\/\/www.wsisp.com\/helps\/103579.html","og_site_name":"\u7f51\u7855\u4e92\u8054\u5e2e\u52a9\u4e2d\u5fc3","article_published_time":"2026-09-10T17:49:10+00:00","author":"admin","twitter_card":"summary_large_image","twitter_misc":{"\u4f5c\u8005":"admin","\u9884\u8ba1\u9605\u8bfb\u65f6\u95f4":"2 \u5206"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.wsisp.com\/helps\/103579.html","url":"https:\/\/www.wsisp.com\/helps\/103579.html","name":"\u9010\u5143\u7d20\u7b97\u5b50\u94fe\u878d\u5408 - \u7f51\u7855\u4e92\u8054\u5e2e\u52a9\u4e2d\u5fc3","isPartOf":{"@id":"https:\/\/www.wsisp.com\/helps\/#website"},"datePublished":"2026-09-10T17:49:10+00:00","dateModified":"2026-09-10T17:49:10+00:00","author":{"@id":"https:\/\/www.wsisp.com\/helps\/#\/schema\/person\/358e386c577a3ab51c4493330a20ad41"},"breadcrumb":{"@id":"https:\/\/www.wsisp.com\/helps\/103579.html#breadcrumb"},"inLanguage":"zh-Hans","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.wsisp.com\/helps\/103579.html"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.wsisp.com\/helps\/103579.html#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"\u9996\u9875","item":"https:\/\/www.wsisp.com\/helps"},{"@type":"ListItem","position":2,"name":"\u9010\u5143\u7d20\u7b97\u5b50\u94fe\u878d\u5408"}]},{"@type":"WebSite","@id":"https:\/\/www.wsisp.com\/helps\/#website","url":"https:\/\/www.wsisp.com\/helps\/","name":"\u7f51\u7855\u4e92\u8054\u5e2e\u52a9\u4e2d\u5fc3","description":"\u9999\u6e2f\u670d\u52a1\u5668_\u9999\u6e2f\u4e91\u670d\u52a1\u5668\u8d44\u8baf_\u670d\u52a1\u5668\u5e2e\u52a9\u6587\u6863_\u670d\u52a1\u5668\u6559\u7a0b","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.wsisp.com\/helps\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"zh-Hans"},{"@type":"Person","@id":"https:\/\/www.wsisp.com\/helps\/#\/schema\/person\/358e386c577a3ab51c4493330a20ad41","name":"admin","image":{"@type":"ImageObject","inLanguage":"zh-Hans","@id":"https:\/\/www.wsisp.com\/helps\/#\/schema\/person\/image\/","url":"https:\/\/gravatar.wp-china-yes.net\/avatar\/?s=96&d=mystery","contentUrl":"https:\/\/gravatar.wp-china-yes.net\/avatar\/?s=96&d=mystery","caption":"admin"},"sameAs":["http:\/\/wp.wsisp.com"],"url":"https:\/\/www.wsisp.com\/helps\/author\/admin"}]}},"_links":{"self":[{"href":"https:\/\/www.wsisp.com\/helps\/wp-json\/wp\/v2\/posts\/103579","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.wsisp.com\/helps\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.wsisp.com\/helps\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.wsisp.com\/helps\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.wsisp.com\/helps\/wp-json\/wp\/v2\/comments?post=103579"}],"version-history":[{"count":0,"href":"https:\/\/www.wsisp.com\/helps\/wp-json\/wp\/v2\/posts\/103579\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.wsisp.com\/helps\/wp-json\/wp\/v2\/media?parent=103579"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.wsisp.com\/helps\/wp-json\/wp\/v2\/categories?post=103579"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.wsisp.com\/helps\/wp-json\/wp\/v2\/tags?post=103579"},{"taxonomy":"topic","embeddable":true,"href":"https:\/\/www.wsisp.com\/helps\/wp-json\/wp\/v2\/topic?post=103579"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}