Leave Your Message
NPU ke Eng?
Blog

NPU ke Eng?

2024-08-13 16:29:49


Mehleng ea kajeno e fetohang ka potlako Lefatše le tsamaisoang ke AI, tlhokahalo ea khomphutha e potlakileng, e sebetsang haholoanyane e hlahisitse li-processor tse khethehileng joalo ka Neural Processing Unit (NPU). Ho fapana le setso Li-CPU kapa GPUs, NPU e etselitsoe ho potlakisa tlhahiso ea ho ithuta ka mochine, haholo-holo bakeng sa marang-rang a tebileng a neural sebelisoa ka pono ea k'homphieutha, ts'ebetso ea puo ea tlhaho, le temoho ya lentswe.


An NPU ke mofuta oa AI accelerator e fanang ka ts'ebetso e phahameng, ts'ebetso e tlase ea latency bakeng sa mesebetsi e hlokang parallel computation le ts'ebetso ea tensor. Li-processor tsena joale li kentsoe ka har'a li-platform tse fapaneng - ho tloha li-smartphone le Lisebelisoa tsa IoT ho tsamaiso ea likoloi le mahlale a khomphutha- nolofalletsa ka sesebelisoa sa AI ka tšebeliso e fokolang ea matla.

Hobaneng ha li-NPU li le Bohlokoa:

  • Ts'ebetso e ntlafalitsoeng ea nako ea nnete bakeng sa mesebetsi e mengata ea AI

  • Tšebeliso e tlase ea matla ha e bapisoa le litharollo tse thehiloeng ho GPU

  • Ho fokotsa ho itšetleha ka maikutlo a maru, ho ntlafatsa boinotši ba data le latency

  • Scalability bakeng sa lisebelisoa tse kopaneng le litsamaiso tse kentsoeng


Ho phahama ha moeli oa AI le ho ata ha Lisebelisoa tse matla tsa AI etsa hore ho be bohlokoa ho utloisisa hore na NPU ke eng le hore na e fapana joang le likarolo tse ling tsa ts'ebetso. Sehloohong sena, re hlahloba lintlha tsa meaho, lisebelisoa tsa tšebeliso, le boleng ba maano a li-NPU maemong a pharaletseng a khomphutha e bohlale.

NPU ke eng? Kakaretso ea Theknoloji

A Neural Processing Unit (NPU) ke microprocessor e inehetseng e etselitsoeng ka ho khetheha ho sebetsana le eona Artificial Intelligence (AI) mesebetsi e mengata, haholo-holo e amang thuto e tebileng le tlhahiso ea neural network. Ho fapana le sepheo se akaretsang Li-CPU kapa tse shebaneng le litšoantšo GPUs, li-NPU li ntlafalitsoe bakeng sa ts'ebetso ea lipalo e matla mekhoa ea ho ithuta mochine, joalo ka matrix a atisa, convolutions, le ts'ebetso ea tensor.


Litšobotsi tsa mantlha tsa NPU:

  • Morero o etselitsoeng tlhahiso ea AI, eseng koetliso

  • Phethahatsa ts'ebetso e ts'oanang ka bokgabane

  • Optimised bakeng sa boemo bo tlase, bo phahameng meroalo ya mosebetsi

  • E sebetsa ka matla haholo tšebeliso e tlase ea matla ho feta GPUs


Leha ho le joalo Li-CPU li loketse logic e latellanang le GPUs ipabola mesebetsing ea ho fana le ho bapala, Li-NPU li etselitsoe ho potlakisa mesebetsi e kang:

  • Ho lemoha ntho

  • Ho lemoha sefahleho

  • Phetolelo ea lentsoe ho ea ho mongolo

  • Litlhahlobo tse bohlale tsa khamera


Mofuta oa processor Karolo ea mantlha Matla Matla a Matla AI Ho lekana
CPU Mesebetsi e akaretsang E fapaneng Tlase Moedi
GPU Grafiken, AI Phano e phahameng Mahareng E matla bakeng sa koetliso
NPU Tlhaloso ea AI AI e ntlafalitsoeng Phahameng E ntle ka ho fetisisa bakeng sa AI
Ha AI e ntse e kenella ka har'a lisebelisoa tse ngata-ho tloha li-smartphone ho IoT ea indasteri-ea NPU e hlahelletseng ka ho fetisisa e sebetsang hantle ebile e ka qhekelloa processor bakeng sa ho nolofalletsa likarolo tse bohlale ka kotloloho ho bohale, ntle le ho itšetleha ka ho fihlella leru kamehla.


NPU e sebetsa Joang?

A Neural Processing Unit (NPU) e etselitsoe ho sebetsa Mesebetsi ea tlhahiso ea AI ka lebelo le bokgabane bo ikhethang. Ho fapana le li-processor tsa setso, li-NPU li sebetsa lits'ebetso tsa data tse thehiloeng ho tensor, ho phethahatsa bongata bo boholo ba ts'ebetso ea matrix ka ho ts'oana - ea bohlokoa bakeng sa ho tsamaisa sejoale-joale mehlala e tebileng ea ho ithuta joalo ka CNNs (Convolutional Neural Networks) le RNNs (Recurrent Neural Networks).


Melao-motheo ea ho sebetsa:

  • Ho bapisa: Li-NPU lia sebetsa mesebetsi e mengata ka nako e le 'ngoe, e fokotsa haholo nako ea ho sebetsa bakeng sa mesebetsi e kang tlhophiso ea litšoantšo le temoho ya puo.

  • Har'a komporo ea tensor e potlakisitsoeng ke Hardware: E hahiloeng tensor cores sebetsana hantle le boholo matrix a atisa.

  • Arithmetic e nepahetseng e tlase: Li-NPU tse ngata li sebelisa INT8 kapa FP16 nepahalo lifomate ho otla ho leka-lekana pakeng tsa nepahalo le matla a matla.

  • Mehaho ea lipeipi: Mesebetsi e kang ho lata data, ho lokisa boima, le kemiso ya tshebetso li etsoa ka tatellano ea liphaephe ho eketsa phallo.


Phallo e Nolofalitsoeng ea Maikutlo:

  1. Kenya data (mohlala, setšoantšo kapa lets'oao la molumo) e sebetsoa pele.

  2. Lintlha li kena ho Enjine ea tensor ea NPU bakeng sa khomphutha ea methapo.

  3. Ea mohlala boima le leeme tataisa tlhaloso.

  4. Liphetho li fanoa ka nako ea nnete, hangata ntle le thuso ea maru.

Ka ho kopanya phethahatso e tlase-tlase, moralo o baballang matla, le logic e inehetseng ea AI, li-NPU li nolofalletsa lisebelisoa ho sebetsa mefuta e rarahaneng ea AI sebakeng sa heno. Sena se etsa hore e be tsa bohlokoa haholo khomphutha ea moeli, lisebelisoa tse bohlale, le lisebelisoa tsa AI tsa indasteri moo ho etsa liqeto ka nako ea sebele e bohlokoa.


Melemo ea Bohlokoa ea li-NPU

Ho amoheloa ha Neural Processing Units (NPUs) e fetotse phetiso ea Tlhaloso ea AI ka bobeli lisebelisoa tsa moeli le libaka tsa maru. Li-NPU li fana ka a kaho e khethehileng ea ho sebetsa e nolofalletsang ts'ebetso e kholo le phaello ea matla ho feta ea khale CPU le GPU tharollo ha ho etsoa mehlala e tebileng ea ho ithuta.


Melemo e kaholimo ea ho sebelisa li-NPU:

  • Ts'ebetso e phahameng ea AI Inference
    Li-NPU li etselitsoe morero Mesebetsi ea AI, ho phethahatsa ts'ebetso ea neural network ka lebelo le leholo le latency e tlase. Ba sebetsa lipalo tse tšoanang tsa tensor ka katleho, ho fana ka lintlha tsa nako ea nnete lits'ebetsong tse kang ho lemoha ntho, karohano ea litšoantšo, le temoho ya puo.

  • Matla a Matla
    Li-NPU li sebelisa matla a fokolang haholo ho feta li-GPU, ka lebaka la tsona lipalo tse tlase tse nepahetseng (mohlala, INT8, FP16) le meaho e ntlafalitsoeng. Sena se ba etsa ba loketseng bakeng sa mobile AI le Lisebelisoa tsa IoT moo bophelo ba betri le meeli ea mocheso li bohlokoa.

  • On-Sesebediswa AI bokgoni
    Ka ho nolofalletsa maikutlo a lehae, li-NPU li fokotsa tlhoko ea ts'ebetso ea leru, ho ntlafatsa lekunutu la data, nako ea karabo, le matla a marang-rang a marang-rang.

  • Compact and Scalable Design
    Li-NPU li ka kopanngoa ho System-on-Chip (SoC) meralo, e lumellang bahlahisi ho kenella Li-accelerator tsa AI ho kena lisebelisoa tse kopanetsoeng joalo ka li-smartphone, tse aparoang, liheke tse mathoko, le mekhoa e ikemetseng.


Lethathamo la Papiso: NPU vs. GPU le CPU

Sebopeho NPU GPU CPU
Morero Tlhaloso ea AI Graphics, kakaretso AI Khomphutha ea sepheo se akaretsang
Matla a Matla ⭐⭐⭐⭐⭐ ⭐⭐
Latency (Nako ea Sebele) Tlase Mahareng Phahameng
Meroalo e tšoanang ea AI E kgabane Hantle haholo Moedi
Molemo ka ho Fetisisa Nyeoe Edge AI, Mobile AI Koetliso ea AI, litšoantšo Laola logic, mesebetsi ea OS

Ka ho kenyelletsa li-NPU ho litharollo tsa likhomphutha tsa AI, likhoebo li ka notlolla mohopolo oa ho ithuta oa mochini o potlakileng haholo ka litšenyehelo tse tlase tsa ts'ebetso, ho etsa hore li-NPU e be motheo oa lisebelisoa tsa AI tsa moloko o latelang.

NPU vs. CPU, GPU, le TPU: Tlhahlobo ea Papiso

Joalo ka tlhokahalo ea tlhahiso ea nako ea sebele ea AI e hola ho pholletsa le lisebelisoa - ho tloha ho li-smartphones le likoloi tse ikemetseng ho isa ho liroboto tsa indasteri - phehisano ea hore na ke processor e sebetsanang hantle le mesebetsi ena e matlafala. Leha ho le joalo Li-CPU, GPUs, TPUs, le Li-NPU tsohle li ka etsoa ho ithuta ka mochini mesebetsi, li optimized bakeng sa merero e fapaneng haholo. Ho utloisisa liphapang tsena ke habohlokoa ha u khetha hardware bakeng sa Lisebelisoa tsa AI, haholo-holo ho bohale.

CPU (Central Processing Unit)

The CPU e ntse e le processor e sebetsang ka ho fetisisa. E sebetsana le mefuta e mengata ea mesebetsi ea komporo ea sepheo se akaretsang, ho kenyeletsoa mesebetsi ea sistimi e sebetsang, Tsamaiso ea I/O, le sequential logic. Le ha li-CPU li khona ho etsa tlhahiso ea AI ka botekgeniki, ha lia ntlafatsoa bakeng sa ts'ebetso e ts'oanang seo marang-rang a neural a se hlokang.

GPU (Yuniti ya Tshebetso ya Graphics)

Qalong e ntlafalitsoe bakeng sa ho fana ka litšoantšo le video, the GPU e ipakile e sebetsa haholo bakeng sa ts'ebetso e ts'oanang, ho etsa hore e tšoanelehe bakeng sa bobeli Koetliso ea AI le kakanyo. Li-GPU li sebetsa hantle libaka tsa setsi sa data, moo tšebeliso ea matla le sebaka li fokolang haholo.


TPU (Tensor Processing Unit)

E ntlafalitsoe ke Google, the TPU e etselitsoe tensor computation mesebetsing ea AI. E fana ka koetliso e matla le ts'ebetso ea ts'ebetso empa e fumaneha haholo ho lisebelisoa tsa maru kapa hardware ea boemo ba khoebo.


NPU (Neural Processing Unit)

E etselitsoe ho tloha fatše bakeng sa Tlhaloso ea AI, the NPU e fana ka ts'ebetso e ke keng ea bapisoa ka watt. Hona joale e kenyelelitsoe ka ho pharaletseng System-on-Chip (SoC) e rala li-smartphones, lisebelisoa tsa AI, le mechini e ikemetseng.

Tafole ea Papiso ea processor

Sebopeho CPU GPU TPU NPU
E etselitsoe Sepheo-kakaretso Graphics & AI Tensor Ops Tlhaloso ea AI
Koetliso ea AI Mafutsana E kgabane Hantle haholo Moedi
Tlhaloso ea AI Moedi E ntle E kgabane E kgabane
Matla a Matla Tlase Mahareng Tlase Phahameng
Latency (Edge Tasks) Phahameng Mahareng Tlase Tlase Haholo
Mobile/IoT Suitability Mafutsana Mafutsana Moedi E kgabane
Tšehetso ea Moralo E pharaletseng E pharaletseng Narrow (Google) E itekanetseng (e a fapana)

Lintlha tsa bohlokoa:

  • GPUs ba ratoang bakeng sa Koetliso ea mohlala oa AI le cloud computing.

  • TPUs ke cloud-centric le molemo ka ho fetisisa ka hare ho Google AI ecosystem.

  • Li-CPU ke batho ba akaretsang, ha ba lokele ho ithuta ka botebo.

  • Li-NPU ke khetho ea ho ea ka sesebelisoa sa AI, ho fana ka tekanyo e ntle ka ho fetisisa ea lebelo, katleho, le matla a tlaase bakeng sa lits'ebetso tsa ts'ebetso.

Ha AI e ntse e tsoela pele ho fallela ho bohale, NPU e hlahella e le tharollo ea nako e telele e sebetsang ka ho fetisisa bakeng sa nako ea sebele, ho ithuta mochine o kentsoeng.



Li-NPU li sebelisoa Hokae? Lisebelisoa tsa Bohlokoa

Neural Processing Units (NPUs) hona joale ke karolo ea motheo mefuteng e mengata ea Theknoloji e tsamaisoang ke AI, haholo-holo tse hlokang tlhahiso-leseling ea sesebelisoa, tšebeliso e tlase ea matla, le karabelo ya nako ya sebele. Ha liindasteri li ntse li tsoela pele ho kopanya bohlale ba maiketsetso mekhoeng ea bona ea tšebetso, li-NPU li ntse li amoheloa ka bobeli lisebelisoa tsa elektronike tsa bareki le litsamaiso tsa indasteri.


1. Li-smartphone le lisebelisoa tsa mohala

Ea kajeno li-smartphone li na le li-NPU tse hatelang pele ka matla Likarolo tsa AI joalo ka:

  • Ho lemoha sefahleho (mohlala, netefatso ea biometric)

  • Ntlafatso ea lifoto le ho lemoha ntho lits'ebetsong tsa khamera

  • Bathusi ba lentsoe le phetolelo ea puo

  • Augmented reality (AR) ho fana ka nako ea sebele

Li-chipsets tsa mobile tse etellang pele joalo ka Apple's A-Series Neural Engine, Qualcomm Snapdragon, le Kirin SoC ea Huawei kopanya li-NPU bakeng sa katleho ts'ebetso ea morao-rao ea AI.


2. Edge Computing le IoT

Lefats'eng la moeli oa AI, li-NPU lia thusa lik'hamera tse bohlale, lisebelisoa tse aparoang, le home automation hubs ho matha ka thata mekhoa ea ho ithuta mochine sebakeng sa heno. Sena se fokotsa ho itšetleha ka li-server tsa leru mme se tiisa kapele ho etsa liqeto, esita le libakeng tse nang le khokahanyo e fokolang.


3. Likoloi le Liroboto

Li-NPU li ntse li kenngoa ka bongata likoloi tse ikemetseng le tsamaiso ea liroboto ho sebetsa:

  • Motsoako oa sensor

  • Ho lemoha tsela

  • Tsebiso ya batsamaya ka maoto

  • Litsamaiso tsa taelo ea lentsoe

Ka ho tsamaisa maikutlo ka kotloloho koloing kapa robotong, li-NPU li netefatsa ts'ebetso ea nako ea sebele ka latency e fokolang.


4. Indasteri le tlhokomelo ea bophelo bo botle AI

Li-NPU li boetse li sebelisoa ho boiketsetso ba feme, tlhokomelo e boletsoeng esale pele, le setšoantšo sa bongaka. Ho tlhahiso e bohlale, li-NPU lia thusa Sistimi ea pono ea AI ho hlwaya mefokolo, ho hlopha lisebelisoa, le ho beha leihlo ts'ebetso e tsoelang pele ntle le tlhoko ea likhokahano tsa leru tse phahameng tsa bandwidth.


Barekisi ba Kakaretso ba NPU Hardware le Ecosystems

Kholo ea AI qetellong e lebisitse ho matsete a bohlokoa ho NPU ea ntlafatso ea lisebelisoa ka lik'hamphani tse kholo tsa theknoloji. Barekisi bana ba bopa sebopeho sa naha sa AI e kentsoeng ka ho fana ka litharollo tse entsoeng ka morero tse ntlafalitsoeng bakeng sa lebelo la ho nahana, matla a matla, le kopanyo ho tenyetseha. Mofuta o mong le o mong o na le oa oona Mehaho ea NPU, ketane ea lisebelisoa, le tšehetso ea tikoloho.


1. Apple - Neural Engine

Ea Apple Neural Engine, e kopantsoeng le eona A-series le M-series chips, e matlafatsa mesebetsi e tsoetseng pele ea AI ho iPhones, iPads, le Mac. E fana ka:

  • Hona joale temoho ya sefahleho

  • Ts'ebetso ea Siri ka sesebelisoa

  • Lintlafatso tse bohlale tsa lifoto le livideo


2. Huawei - Da Vinci Architecture

Ea Huawei Ho nyoloha li-NPU le Mehaho ea Da Vinci li bohareng ba eona Kirin SoCs le Lisebelisoa tsa AI:

  • Tlhahiso e potlakileng ea AI ho lisebelisoa tsa mohala

  • Deployment in litsi tsa data bakeng sa khoebo ea AI

  • Tšehetsa MindSpore Moralo oa AI


3. Qualcomm - Hexagon DSP e nang le AI Engine

Qualcomm's Hexagon DSP + AI Engine e kentsoe sethaleng sa Snapdragon, e fanang ka:

  • Ho potlakisa AI bakeng sa lisebelisoa tsa Android

  • E sebetsang hantle ho sebetsa ka sesebelisoa

  • Ho lumellana le TensorFlow Lite le ONNX


4. Google - Edge TPU

The TPU ea moeli, karolo ea Google Sethala sa likorale, e etselitsoe IoT le li-deployments tsa moeli:

  • Optimised bakeng sa TensorFlow Lite

  • Tlhahiso ea matla a AI a tlase haholo

  • Compact form factor for li-sensor tse bohlale le dikgoro


5. NVIDIA - NVDLA le Jetson Platform

NVIDIA NVDLA (Deep Learning Accelerator) le Letoto la Jetson fana ka khomphutha ea AI e sebetsang hantle haholo:

  • E sebelisoa ho liroboto, lifofane, le mechine e ikemetseng

  • Tšehetsa FAPANENG, TensorRT, le DeepStream SDK


Mathata le Mefokolo ea li-NPU

Leha ho le joalo Neural Processing Units (NPUs) fana ka melemo e tsotehang ho Ts'ebetso ea tlhahiso ea AI, matla a matla, le khomphutha ea moeli, ha ba na meeli. Bahlahisi le bahokahanyi ba sistimi ba tlameha ho nahana ka liphephetso tse 'maloa tsa tekheniki le ts'ebetso ha ba amohela li-NPU ho Lisebelisoa tse nolofalitsoeng ke AI.


1. Ho lumellana ha Moralo

E 'ngoe ea litšitiso tsa bohlokoa ke tšehetso e fokolang bakeng sa Mekhoa ea AI. Ho fapana le li-GPU, tse tšehetsang mefuta e mengata ea liforomo tse kang TensorFlow, PyTorch, le ONNX, hangata li-NPU li hloka lithulusi tse tloaelehileng kapa li-SDK tsa thepa. Sena se ka lebisa ho:

  • Lipotoloho tse telele tsa ntlafatso

  • Bothata ba ho kena phetoho ea mohlala le ho ntlafatsa

  • Ts'ebetso e sa tsitsang ho barekisi ba hardware


2. Inference-Feela Bokhoni

Li-NPU tse ngata li etselitsoe feela kakanyo, ha ho joalo koetliso. Hona ho bolela:

  • Mefuta ea AI e tlameha ho koetlisoa ka eona Li-GPU kapa li-TPU

  • Boikoetliso bofe kapa bofe kapa tokiso e ntle e hloka lisebelisoa tsa kantle

  • Fokotsa ho feto-fetoha ha maemo ho ho ithuta ka sesebelisoa


3. Litšitiso tsa ho Kopanya Lisebelisoa

Ho kopanya li-NPU ho litsamaiso tse kentsoeng kapa System-on-Chip (SoC) meralo e kenyelletsa likhohlano:

  • Meeli ea sebaka sa silicon

  • Litšitiso tsa moralo oa mocheso

  • Likhohlano tse ka bang teng le e teng I/O le bandwidth memori



Bokamoso ba li-NPU le AI Hardware

Joalo ka tlhoko ea tlhahiso ea nako ea sebele ea AI tsoela pele ho hola ho pholletsa le liindasteri, bokamoso ba Neural Processing Units (NPUs) ho lebeletsoe hore e be bohareng ba ho iphetola ha lintho Lisebelisoa tsa AI. Li-processor tsena tse khethehileng li ntse li e-ba matla, li kopane, 'me li sebetsa hantle - li li beha e le karolo ea mantlha ea moloko o latelang oa lisebelisoa tsa AI tse haufi, li-sensor tse bohlale, le mekhoa e ikemetseng.


Mekhoa e Hlahang ea NPU ea Ntlafatso

  • Khokahano e tiileng ea SoC
    Li-NPU li ntse li eketseha ho kopanngoa ho System-on-Chip (SoC) meralo hammoho le li-CPU, li-GPU, le li-ISP. Mohaho ona o kopaneng o thusa kapele lipeipi tsa ts'ebetso ea data, e fokotsa latency, 'me e theola ho rarahana ha tsamaiso.

  • Tšehetso ea Heterogeneous Computing
    Li-NPU tsa nakong e tlang li tla sebetsa ka mokhoa o ts'oanelang le li-accelerator tse ling tsa AI, li aba meroalo ea mesebetsi hohle. Li-CPU, li-GPU, le li-TPU bakeng sa tshebetso e ntlafetseng.

  • Tšebelisano e Ntlafetseng ea Moralo
    Barekisi ba haha ​​​​ts'ehetso bakeng sa meralo ea mantlha ea AI joalo ka ONNX, TensorFlow Lite, le PyTorch Mobile, ho fokotsa mokhahlelo oa ho ithuta le ho khothaletsa phano ea lipolanete.

  • Katoloso e Ntle ho Lisebelisoa tsa Bareki
    Li-NPU li tla bapala karolo e kholo ho boiketsetso ba indasteri, tlhokomelo ea bophelo bo botle, liroboto tsa moeli, temo AI, le mekhoa ea ho beha leihlo, kae matla a tlase, maikutlo a lebelo le phahameng e bohlokoa.


Lefatsheng le lebileng bohlale bo hohle, li-NPU li ke ke tsa potlakisa AI feela empa hape li tla e etsa le ho feta fihlella, tsitsitseng, le sireletsehileng. Karolo ea bona ho bopeng litsamaiso tse kentsoeng tsa mofuta o latelang, ho tloha Lik'hamera tse tsamaisoang ke AI ho li-platform tsa ho tsamaea tse ikemetseng, e totobatsa bohlokoa bo ntseng bo eketseha ba meralo e ikhethileng ea komporo mehleng ea AI.


Lihlahisoa tse Amanang

LET'S TALK ABOUT YOUR PROJECTS

  • sinsmarttech@gmail.com
  • 3F, Block A, Future Research & Innovation Park, Yuhang District, Hangzhou, Zhejiang, China

Our experts will solve them in no time.