Blog

O le a le NPU?

2024-08-13 16:29:49

I aso nei ua vave ona tupu lalolagi fa'aola AI, o le manaʻoga mo le faʻavavevave, sili atu ona lelei faʻatusatusaga ua faʻatupuina ai faʻapitoa faʻapitoa e pei o le Vaega o Fa'agaio'iga Neural (NPU). E le pei o tu ma aga PPU pe GPU, o se NPU ua faʻamoemoeina-fausia e faʻavave faʻamatalaga aʻoaʻoga masini, aemaise lava mo feso'ota'iga neural loloto fa'aaogaina i totonu va'aiga komepiuta, faiga fa'anatura gagana, ma iloa leo.

An NPU o se ituaiga o AI fa'avavevave lea e tu'uina atu le fa'atinoga maualuga, fa'agasolo maualalo mo galuega e mana'omia fa'atatauga tutusa ma galuega tensor. O lo'o fa'apipi'iina nei masini fa'atino i le tele o fa'avae—mai telefonipoto ma IoT masini ia faiga tau taavale ma atina'e komepiuta pito—faamalosia i luga ole masini AI fa'atasi ai ma le fa'aaogaina o le eletise.

Aisea e Taua ai NPU:

Fa'aleleia le fa'atinoga o taimi moni mo AI galuega mamafa
Fa'aitiitia le fa'aaogaina o le malosi faʻatusatusa i fofo faʻavae GPU
Faʻaitiitia le faʻalagolago i faʻamatalaga ao, fa'aleleia le fa'alilolilo o fa'amatalaga ma le fa'agata
Scalability mo masini fa'akomepiuta ma faiga fa'apipi'i

O le tulai mai o pito AI ma le faateleina o Talosaga e fa'amalosia ai le AI fa'amana'omia le malamalama po'o le a le NPU ma pe fa'afefea ona ese mai isi vaega fa'agaioiga. I lenei tusiga, matou te suʻesuʻeina le tusiata fale, fa'aoga tulaga, ma le taua o le NPU i le lautele lautele o faʻamatalaga atamai.

O le a le NPU? Ose Va'aiga Fa'apitoa

A Vaega o Fa'agaio'iga Neural (NPU) o se microprocessor tuuto ua fuafuaina faapitoa e taulimaina atamai fa'apitoa (AI) galuega mamafa, aemaise lava i latou e aofia ai a'oa'oga loloto ma neural network inference. E le pei o le fa'amoemoe lautele PPU po'o fa'ata'ita'i fa'atusa GPU, NPUs e sili ona lelei mo le faʻaogaina o le matematika e mana fa'ata'ita'iga a'oa'oga masini, pei o le fa'atelega matrix, convolutions, ma faiga tensor.

Uiga Autu ole NPU:

Faʻamoemoe-fausia mo faʻamatalaga AI, ae le o aoaoga
Fa'ataunu'u galuega tutusa lelei
Fa'atonuina mo maualalo-latency, maualuga-throughput galuega mamafa
Fa'agaoioi ma taua tele fa'aititia le eletise nai lo GPU

A o PPU e fetaui lelei mo fa'asologa fa'asologa ma GPU sili i galuega faatino ma taaloga, NPUs ua fa'atulagaina e fa'avavevave ai galuega e pei o:

Su'eina o mea
Fa'ailoga mata
Suiga leo-i-tusi
Iloiloga atamai meapueata

Ituaiga Processor	Matafaioi Muamua	Malosi	Malosiaga Lelei	AI Talafeagai
PPU	Galuega lautele	Faigata	Maulalo	Fa'atapula'a
GPU	Ata, AI	Maua maualuga	Alafua	Malosi mo toleniga
NPU	AI fa'ailoga	AI-silisiliina	Maualuga	Sili mo mata AI

A'o fa'apipi'i AI ile tele o masini—mai telefonipoto ia alamanuia IoT—le NPU tulaga ese e sili lelei ma fuaina processor mo le fa'aagaioia o ata fa'apitoa i le pito, e aunoa ma le faʻalagolago i le faʻaogaina pea o ao.

E faʻafefea ona galue se NPU?

A Vaega o Fa'agaio'iga Neural (NPU) ua inisinia e faatino Galuega fa'ailoga AI ma le saoasaoa tulaga ese ma le lelei. E le pei o faiga masani, NPU o loʻo faʻaogaina fa'asologa o fa'amaumauga fa'avae tensor, fa'atinoina o se aofaiga tele o fa'agaioiga matrix i se tulaga tutusa—e taua mo le tamoe faaonaponei fa'ata'ita'iga a'oa'oga loloto pei o le CNNs (Convolutional Neural Networks) ma RNNs (Feso'ota'iga Neural Recurrent).

Autu Galuega Fa'avae:

Fa'atusa: NPU fa'atino tele gaioiga i le taimi e tasi, matua fa'aitiitia taimi fa'agaioiga mo galuega fa'apei fa'avasegaga ata ma iloa tautala.
Fa'akomepiuta-fa'atopetope fa'atatau tensor: Fausia i totonu tensor cores mataalia taulima tetele fa'atelega matrix.
Fa'atatauga maualalo-sa'o: Tele NPU faʻaaogaina INT8 pe FP16 fa'asologa sa'o e maua ai se paleni i le va sa'o ma malosi malosi.
Faiga paipa: Galuega e pei o aumai fa'amatalaga, faiga mamafa, ma activation computing o lo'o fa'atinoina i se fa'asologa o paipa e fa'ateleina ai le gaosiga.

Fa'afaigofie le Fa'asologa o Fa'amatalaga:

Fa'amatalaga tu'u (fa'ata'ita'iga, se ata po'o se fa'ailo leo) o lo'o mua'i fa'agaioiina.
Fa'amatalaga ulufale i le NPU's tensor engine mo neural computation.
O le fa'ata'ita'iga mamafa ma fa'aituau taʻitaʻia le faʻamatalaga.
O fa'ai'uga e tu'uina atu i le taimi moni, e masani lava e aunoa ma se fesoasoani ao.

E ala i le tuufaatasia fa'atinoga maualalo, mamanu lelei-malosi, ma fa'amaoni AI fa'atatau, NPU e mafai ai e masini ona tamoʻe faʻataʻitaʻiga AI lavelave i le lotoifale. O lenei mea e taua tele ai i latou komepiuta pito, masini atamai, ma alamanuia AI talosaga o fea faiga fa'ai'uga i taimi tonu e faitio.

Fa'amanuiaga Autu o NPU

O le vaetamaina o Unite Fa'agaioiina Neural (NPUs) ua toe suia le faʻapipiʻiina o AI fa'ailoga i mea uma e lua masini pito ma siosiomaga ao. NPU e maua ai se fa'ata'otoga fa'apitoa fa'apitoa e mafai ai ona fa'atupuina ma fa'asili le malosi o le malosi nai lo tu ma aga masani PPU ma GPU fofo pe a faatino fa'ata'ita'iga a'oa'oga loloto.

Fa'amanuiaga sili o le fa'aaogaina o NPU:

Fa'atinoga Maualuga mo AI Inferences
NPUs ua faʻamoemoeina-fausia mo AI galuega mamafa, fa'ataunu'u fa'agaioiga neural network fa'atasi ai ma le saoasaoa sili atu ma le laititi maualalo. Latou te fa'agasolo fa'atusatusaga tensor fa'atasi lelei, tu'uina atu fa'amatalaga taimi moni i fa'aoga pei o su'esu'eina mea, vaevaega ata, ma iloa tautala.
Malosiaga Lelei
O NPU e faʻaaogaina le malosi tele nai lo GPU, faʻafetai ia latou fa'atatau maualalo-sa'o (fa'ata'ita'iga, INT8, FP16) ma fa'ata'ita'iga lelei. O lenei mea latou te fetaui lelei mo feaveai AI ma IoT masini o fea ola maa ma tapula'a vevela e faitio.
I luga ole masini AI Gafatia
E ala i le mafai fa'alotoifale, NPU faʻaitiitia le manaʻomia mo le gaosiga o ao, faʻaleleia fa'amatalaga patino, taimi tali, ma feso'ota'iga bandwidth lelei.
Fuafuaga Ma'oti ma Fa'asalaina
NPUs e mafai ona tuʻufaʻatasia i totonu System-on-Chip (SoC) mamanu, faʻatagaina tagata gaosi oloa e faʻapipiʻi AI fa'avavevave i masini fa'apitoa e pei o telefonipoto, mea e mafai ona ofuina, faitotoa pito, ma faiga tuto'atasi.

Laupapa Fa'atusatusa: NPU vs. GPU ma le PPU

Fa'aaliga	NPU	GPU	PPU
Faamoemoega	AI fa'ailoga	Ata, lautele AI	Fa'akomepiuta fa'amoemoe lautele
Malosiaga Lelei	⭐⭐⭐⭐⭐	⭐⭐	⭐
Taimi (Taimi moni)	Maulalo	Alafua	Maualuga
Galuega Fa'atusa AI	Lelei	Lelei tele	Fa'atapula'a
Tulaga Fa'aoga Lelei	Edge AI, Mobile AI	AI aoaoga, ata	Pulea manatu, galuega OS

E ala i le tuʻufaʻatasia o NPU i fofo faʻaputuga ole AI, e mafai e pisinisi ona tatalaina le faʻaogaina o masini aʻoaʻoga maualuga i tau faʻagaioiga maualalo, ma avea ai NPU ma faʻavae o meafaigaluega AI e sosoo ai.

NPU vs. PPU, GPU, ma TPU: O se Su'esu'ega Fa'atusatusa

E pei ona manaʻomia fa'ai'uga AI taimi moni fa'atupula'ia i masini-mai telefoni feavea'i ma ta'avale tuto'atasi e o'o atu i robotics fa'apisinisi-ua fa'ateteleina le felafolafoa'iga po'o fea le gaosiga e sili ona taulimaina nei galuega. A o PPU, GPU, TPU, ma NPUs mafai uma ona faatino a'oa'oga masini galuega, latou optimized mo faamoemoega eseese. O le malamalama i nei eseesega e taua tele pe a filifilia meafaigaluega mo AI talosaga, aemaise i le pito.

PPU (Vaega Tutotonugalemu)

O le PPU o lo'o tumau pea le gaosiga sili ona lelei. E fa'atautaia le tele o galuega fa'akomepiuta fa'amoemoe lautele, e aofia ai galuega faatino faiga, pulega I/O, ma fa'asologa fa'asologa. E ui e mafai e PPU ona faʻatino faʻapitoa AI faʻamatalaga, latou te le o faʻamalosia mo le faiga tutusa e mana'omia e neural networks.

GPU (Vaega o Fa'asologa o Ata)

Muamua na atiina ae mo le tuuina atu o ata ma vitio, le GPU ua fa'amaonia le aoga tele mo galuega tutusa, e fa'atatau i mea uma e lua AI aoaoga ma fa'ai'uga. GPU sili atu i totonu siosiomaga nofoaga autu o faamatalaga, pe a faʻaitiitia le faʻaogaina o le eletise ma avanoa.

TPU (Tensor Processing Unit)

Atiina e Google, le TPU ua fa'atulagaina mo tensor computation i galuega a AI. E tu'uina atu a'oa'oga mamana ma fa'atinoga fa'atusa ae o lo'o maua muamua i totonu atina'e ao pe meafaigaluega fa'apitoa tau atina'e.

NPU (Vaega Fa'agaio'iga Neural)

Fuafua mai i lalo mo AI fa'ailoga, o le NPU ofo mai fa'atinoga le fa'atusaina ile watt. O lea ua fa'apipi'i lautele i totonu System-on-Chip (SoC) mamanu i luga o telefonipoto, AI mata masini, ma masini tutoʻatasi.

Fa'asologa Fa'atusa

Fa'aaliga	PPU	GPU	TPU	NPU
Fuafuaina Mo	Fa'amoemoe lautele	Ata & AI	Tensor Ops	AI Fa'ailoga
A'oa'oga AI	Mativa	Lelei	Lelei tele	Fa'atapula'a
AI Fa'ailoga	Fa'atapula'a	Lelei	Lelei	Lelei
Malosiaga Lelei	Maulalo	Alafua	Maulalo	Maualuga
Fa'ato'a (Tu'u Galuega)	Maualuga	Alafua	Maulalo	Maualalo tele
Feavea'i/IoT Talafeagai	Mativa	Mativa	Fa'atapula'a	Lelei
Lagolago Fa'avae	Lautele	Lautele	Vaiti (Google)	Fa'atauva'a (ese'ese)

Avea'i Autu:

GPU e sili atu mo AI faʻataʻitaʻiga aʻoaʻoga ma fa'akomepiuta ao.
TPU e fa'aogatotonu i ao ma sili ona lelei i totonu o le Google AI fa'anatura.
PPU o tagata lautele, e le lelei mo le aʻoaʻoina loloto.
NPUs o le filifiliga e alu i ai mo i luga ole masini AI, ofoina atu le paleni sili o le saoasaoa, lelei, ma le maualalo o le mana mo galuega fa'atatau.

Aʻo faʻaauau pea ona agai atu AI i le pito, o le NPU o loʻo tu i fafo o le fofo sili ona aoga umi mo taimi moni, a'oa'oga masini fa'apipi'i.

O fea e fa'aoga ai NPU? Talosaga Autu

Unite Fa'agaioiina Neural (NPUs) ua avea nei ma vaega faavae i le tele o vaega Fa'atekonolosi fa'atautaia AI, aemaise lava i latou e manaʻomia fa'ailoga i luga ole masini, maualalo le fa'aogaina o le eletise, ma tali atu i le taimi moni. A'o fa'aauau pea ona tu'ufa'atasia alamanuia atamai faafoliga i totonu oa latou galuega, o loʻo faʻaaogaina NPU i mea uma e lua tagata fa'atau eletise ma faiga tau alamanuia.

1. Telefoniteletele ma Meafaigaluega Feavea'i

Fa'aonaponei telefonipoto o lo'o fa'apipi'iina i NPU e fa'aola ai le malosi AI foliga pei o le:

Fa'ailoga mata (fa'ata'ita'iga, fa'amaoni biometric)
Fa'aleleia ata ma su'esu'eina mea i meapueata
Fesoasoani leo ma fa'aliliuga gagana
Mea moni fa'aopoopo (AR) rendering i le taimi moni

Ta'imua chipsets feavea'i pei Apple's A-series Neural Engine, Qualcomm Snapdragon, ma Huawei's Kirin SoC tu'ufa'atasia NPUs mo lelei fa'asologa AI.

2. Edge Computing ma IoT

I le lalolagi o pito AI, NPUs mafai meapueata atamai, masini e mafai ona ofuina, ma fale masini fale e taufetuli faigata fa'ata'ita'iga a'oa'oga masini i le lotoifale. O lenei mea e faʻaitiitia ai le faʻalagolago i 'auʻaunaga ao ma faʻamautinoa vave faia o faaiuga, e o'o lava i si'osi'omaga e fa'atapula'aina feso'ota'iga.

3. Taavale ma Robotics

NPU ua faʻateleina faʻapipiʻiina i totonu ta'avale tuto'atasi ma faiga fa'akomepiuta faia:

Fusi fa'alogo
Su'esu'ega laina
Fa'ailoga tagata savali
faiga fa'atonu leo

E ala i le faʻaogaina saʻo i luga o le taʻavale poʻo le robot, NPUs mautinoa fa'agaioiga taimi moni fa'atasi ai ma sina fa'aletonu.

4. Alamanuia ma Soifua Maloloina AI

O loʻo faʻaaogaina foi NPU i totonu falegaosi masini, tausiga vavalo, ma ata fa'afoma'i. I totonu gaosiga atamai, NPUs mafai AI va'aiga faiga e iloa ai faaletonu, fa'avasega meafaitino, ma mata'itu fa'agaioiga fa'aauau e aunoa ma le mana'omia o feso'ota'iga ao maualuga-bandwidth.

Tele NPU Fa'atau Meafaigaluega ma Ecosystems

Le tuputupu ae o AI i le pito ua mafua ai tupe teu faafaigaluega i atina'e meafaigaluega NPU e kamupani tekonolosi tetele. O lo'o fa'atulagaina e nei tagata fa'atau le laufanua o fa'apipi'i AI e ala i le ofoina atu o fa'amoemoega fofo fa'atatau mo vave fa'ai'uga, malosi malosi, ma tu'ufa'atasiga fetu'una'i. E tofu fa'ailoga ma ona lava NPU fausaga, filifili meafaigaluega, ma lagolago fa'anatura.

1. Apple – Neural Engine

Apple's Neural Engine, fa'atasi i totonu o lona A-series ma M-series chips, fa'aola ai galuega fa'atino AI i iPhones, iPads, ma Macs. E momoli atu:

Taimi moni iloa foliga
I luga o le masini Siri faiga
Fa'aleleia ata ma ata vitio

2. Huawei - Da Vinci Architecture

Huawei's A'e NPUs ma Da Vinci fausaga e totonugalemu i lona Kirin SoCs ma AI atina'e:

Fa'atele AI fa'ai'uga i masini feaveai
Fa'asoa i totonu nofoaga autu o faamatalaga mo pisinisi AI
Lagolago MindSpore AI fa'avae

3. Qualcomm - Hexagon DSP ma AI Engine

Qualcomm's Hexagon DSP + AI Inisinia o loʻo faʻapipiʻiina i luga ole Snapdragon platforms, ofoina:

AI fa'avavevave mo polokalama Android
Lelei fa'agaioiga i luga ole masini
Fegalegaleai ma TensorFlow Lite ma ONNX

4. Google – Edge TPU

O le TPU pito, vaega ole Google's Amu tulaga, ua fa'atulagaina mo IoT ma le faʻaogaina o pito:

Fa'atonuina mo TensorFlow Lite
Fa'ai'uga ole malosi ole malosi ole AI
Fa'aliga fa'apitoa mo masini atamai ma faitotoa

5. NVIDIA - NVDLA ma Jetson Platform

NVIDIA's NVDLA (Deep Learning Accelerator) ma Jetson faasologa tu'uina atu fa'akomepiuta AI maualuga:

Fa'aaogaina i robotics, drones, ma masini tuto'atasi
Lagolago ESEESE, TensorRT, ma DeepStream SDK

Lu'i ma Tapula'a o NPU

A o Unite Fa'agaioiina Neural (NPUs) ofoina atu tulaga lelei i AI fa'atinoga fa'atusa, malosi malosi, ma komepiuta pito, e leai ni tapulaa. E tatau i tagata atiaʻe ma faʻalapotopotoga tuʻufaʻatasia ona mafaufau i ni luʻitau faʻapitoa ma faʻatinoga pe a faʻaaogaina NPU i totonu AI-faʻaogaina masini.

1. Fa'asoa Fa'avaa

O se tasi o pa puipui autu e faatapulaa le lagolago mo AI fa'avae. E le pei o GPU, lea e lagolagoina le lautele o tulaga faʻavae e pei o TensorFlow, PyTorch, ma ONNX, NPU e masani ona manaʻomia filifili meafaigaluega masani po'o SDK fa'apitoa. E mafai ona taʻitaʻia lenei mea i:

Ta'amilosaga tau atina'e umi
Faigata i fa'ata'ita'iga liua ma fa'asilisiliina
Fa'atino fa'aletonu i fa'atauga meafaigaluega

2. Fa'ata'ita'i-Na'o Mafai

Ole tele ole NPU e fa'apitoa mo fa'ai'uga, e leai aoaoga. O lona uiga:

AI fa'ata'ita'iga e tatau ona a'oa'oina GPU poʻo TPU
So'o se toe fa'aa'oa'oga po'o se fa'alelei e mana'omia ai atina'e mai fafo
Fa'aitiitiga fetuutuunai i a'oa'oga i luga ole masini

3. Fa'agata Fa'atasiga Meafaigaluega

Tu'ufa'atasia o NPU i totonu o faiga fa'apipi'i po'o System-on-Chip (SoC) mamanu e aofia ai fefaʻatauaʻiga:

Fa'atapula'a eria Silicon
Fuafuaga fa'avevela
E ono feteenai ma I/O o iai ma le bandwidth memory

Le Lumanai o NPUs ma AI Meafaigaluega

E pei o le manaoga mo fa'ai'uga AI taimi moni o loʻo faʻaauau pea ona tupu i luga o alamanuia, le lumanaʻi o Unite Fa'agaioiina Neural (NPUs) e fa'amoemoe e totonugalemu i le fa'aleleia o AI meafaigaluega. O nei masini faʻapitoa faʻapitoa ua amata ona sili atu le mamana, faʻapipiʻi, ma le malosi-faʻatonuina i latou o se vaega autu o le isi augatupulaga o mata AI masini, masini atamai, ma faiga tuto'atasi.

Fa'asolo a'e Fa'atupuina o le NPU

Malosi SoC Integration
NPUs ua faʻateleina faʻatasi i totonu System-on-Chip (SoC) mamanu faʻatasi ma PPU, GPU, ma ISP. O lenei fausaga tu'ufa'atasi e mafai ai ona vave fa'asologa o fa'amaumauga paipa, fa'aitiitia le leo, ma fa'aitiitia le lavelave o le faiga.
Lagolago mo le Heterogenous Computing
O NPU i le lumanaʻi o le a sili atu ona galulue faʻatasi ma isi AI faʻavavevave, tufatufaina atu galuega i le isi itu PPU, GPU, ma TPU mo le faatinoga sili ona lelei.
Fa'aleleia le Fa'asoa Fa'aava
O loʻo fausia e le au faʻatau le lagolago mo faʻasalalauga faʻapitoa AI pei o ONNX, TensorFlow Lite, ma PyTorch Mobile, faaitiitia le a'oa'oga a'oa'oga ma fa'amalosia le fa'atinoina o fa'asalalauga fa'asalalau.
Fa'alauteleina i tua atu o masini fa'atau
NPUs o le a faia se sao sili atu i fa'ainisinia fa'apisinisi, soifua maloloina atamai, pito robotics, fa'ato'aga AI, ma faiga mata'itu, o fea maualalo-malosi, maualuga-saosaoa inference e faitio.

I se lalolagi ua agai i luma atamai i soo se mea, NPU o le a le gata ina faʻavaveina AI ae faʻateleina foi avanoa, gafataulimaina, ma saogalemu. O la latou matafaioi i le fausiaina isi-gen fa'apipi'i faiga, mai Meapue fa'amalosi AI ia tulaga tau folauga tuto'atasi, o loo faamamafaina ai le faatupulaia o le taua o fa'ailoga fa'akomepiuta fa'apitoa i le vaitaimi o AI.