Blog

NPU ni iki?

2024-08-13 16:29:49

Muri iki gihe cyihuta cyane Isi itwarwa na AI, icyifuzo cyo kwihuta, gukora neza kubara byatanze umusaruro wihariye nka Ishami rishinzwe gutunganya imitsi (NPU). Bitandukanye na gakondo CPU cyangwa GPUs, NPU ni intego-yubatswe kugirango yihute imashini yiga imashini, cyane cyane kuri imiyoboro yimbitse ikoreshwa muri icyerekezo cya mudasobwa, gutunganya ururimi karemano, na kumenyekanisha amajwi.

An NPU ni Ubwoko bwa AI yihuta itanga imikorere-yo hejuru, itinda-gutinda kubikorwa bisaba kubara na ibikorwa bya tensor. Ubu abatunganya ubu bashizwemo muburyo butandukanye-kuva amaterefone na Ibikoresho bya IoT Kuri sisitemu yimodoka na ibikorwa remezo byo kubara—Gushoboza ku gikoresho AI hamwe no gukoresha ingufu nkeya.

Impamvu NPUs ifite akamaro:

Kuzamura imikorere-nyayo kubikorwa bya AI
Gukoresha ingufu nke ugereranije na GPU ishingiye kubisubizo
Kugabanya kwishingikiriza ku gicu, kunoza amakuru yihariye nubukererwe
Ubunini kubikoresho byoroheje hamwe na sisitemu yashyizwemo

Kuzamuka kwa inkingi ya AI n'ikwirakwizwa rya Porogaramu ikoreshwa na AI kora ni ngombwa kumva NPU icyo aricyo nuburyo itandukanye nibindi bice bitunganya. Muri iyi ngingo, turasesengura ubwubatsi, koresha imanza, nagaciro keza ka NPU murwego rwagutse rwo kubara ubwenge.

NPU ni iki? Incamake ya tekiniki

A. Ishami rishinzwe gutunganya imitsi (NPU) ni microprocessor yabugenewe yabugenewe kugirango ikore ubwenge bwa artile (AI) imizigo y'akazi, cyane cyane irimo kwiga byimbitse na imiyoboro y'urusobe. Bitandukanye n'intego rusange CPU cyangwa ibishushanyo-bishingiye GPUs, NPUs zitezimbere kubikorwa byimibare izo mbaraga imashini yiga imashini, nka kugwiza matrix, imyanzuro, na tensor.

Ibintu nyamukuru biranga NPU:

Intego-yubatswe kubitekerezo bya AI, ntabwo ari amahugurwa
Yica ibikorwa bisa neza
Byakoreshejwe neza ubukererwe buke, byinshi-byinjira akazi
Ikora hamwe kuburyo bugaragara gukoresha ingufu nke kuruta GPU

Mugihe CPU ni byiza kuri logique ikurikirana kandi GPUs indashyikirwa mu gutanga no gukina imikino, NPUs ziteganijwe kwihutisha imirimo nka:

Kumenya ibintu
Kumenyekana mu maso
Guhindura amajwi-ku-mwandiko
Isesengura rya kamera yubwenge

Ubwoko bwa Processor	Uruhare rwibanze	Imbaraga	Imbaraga	Ubushobozi bwa AI
CPU	Inshingano rusange	Binyuranye	Hasi	Ntarengwa
GPU	Igishushanyo, AI	Ibicuruzwa byinshi	Hagati	Mukomere mumahugurwa
NPU	Umwanzuro wa AI	AI-nziza	Hejuru	Ibyiza bya AI

Nkuko AI ihinduka mubikoresho byinshi-kuva amaterefone Kuri inganda IoT—By NPU igaragara nka byinshi ikora neza kandi nini gutunganya kugirango ushoboze ibintu byubwenge bitaziguye kuri inkombe, udashingiye kubicu bihoraho.

Nigute NPU ikora?

A. Ishami rishinzwe gutunganya imitsi (NPU) ni Byashizweho Kuri Gukora Ibikorwa bya AI n'umuvuduko udasanzwe kandi neza. Bitandukanye nabatunganya gakondo, NPUs ikora Imiterere-yamakuru, Gukora Umubare munini wa ibikorwa bya matrix mu buryo bubangikanye - ni ngombwa mu gukora ibigezweho icyitegererezo cyimbitse nka CNNs (Imiyoboro ya Neural Network) na RNNs (Imiyoboro ya Neural Isubiramo).

Amahame remezo y'akazi:

Kubangikanya: NPUs zirakora ibikorwa byinshi icyarimwe, kugabanya cyane igihe cyo gutunganya imirimo nka gutondekanya amashusho na kumenyekanisha imvugo.
Ibyuma-byihuta bya tensor kubara: Yubatswe ingirakamaro gukora neza-nini kugwiza matrix.
Imibare mike-yuzuye: NPU nyinshi zikoresha INT8 cyangwa FP16 Imiterere isobanutse kugirango ikubite hagati Ukuri na ingufu.
Kubaka neza: Inshingano nka kuzana amakuru, gutunganya ibiro, na kubara Byakorewe muburyo bukurikiranye kugirango byinjizwe neza.

Imyitozo yoroshye:

Ongera amakuru (urugero, ishusho cyangwa ibimenyetso byamajwi) byateguwe mbere.
Amakuru yinjira muri Moteri ya NPU Kubara.
Icyitegererezo uburemere no kubogama Kuyobora.
Ibisubizo bitangwa mugihe nyacyo, akenshi nta mfashanyo igicu.

Muguhuza kurangiza-gutinda, igishushanyo mbonera, na logique yihariye, NPUs ifasha ibikoresho gukora icyitegererezo cya AI mu karere. Ibi bituma baba ingenzi kuri Kubara, ibikoresho byubwenge, na inganda zikoreshwa mu nganda he gufata igihe nyacyo ni ngombwa.

Inyungu zingenzi za NPUs

Iyemezwa rya Ibice bitunganya imitsi (NPUs) yahinduye gahunda yo kohereza Umwanzuro wa AI muri byombi ibikoresho na ibidukikije. NPUs zitanga a imyubakire idasanzwe ibyo bituma imikorere igaragara ningufu zunguka kurenza gakondo CPU na GPU ibisubizo mugihe cyo gukora icyitegererezo cyimbitse.

Inyungu zo hejuru zo gukoresha NPUs:

Imikorere Yisumbuyeho ya AI
NPUs igamije intego Imirimo ya AI, kurangiza imikorere y'urusobe rw'imikorere hamwe n'umuvuduko mwinshi nubukererwe buke. Baratunganya Kubara Kubara neza, gutanga ubushishozi-nyabwo mubisabwa nka gutahura ikintu, Igice cy'ishusho, na kumenyekanisha imvugo.
Ingufu
NPU ikoresha imbaraga nke ugereranije na GPU, tubikesha imibare mike-yuzuye (urugero, INT8, FP16) hamwe nuburyo bwiza bwubatswe. Ibi bituma babaho neza mobile mobile AI na Ibikoresho bya IoT he ubuzima bwa bateri na imipaka yubushyuhe ni ngombwa.
Kuri-Igikoresho Ubushobozi bwa AI
Mugushoboza umwanzuro waho, NPUs igabanya ibikenerwa gutunganya ibicu, gutera imbere ubuzima bwite bwamakuru, igihe cyo gusubiza, na umuyoboro mugari.
Igishushanyo mbonera kandi kinini
NPUs irashobora kwinjizwa Sisitemu kuri Chip (SoC) ibishushanyo, byemerera ababikora gushira AI yihuta mubikoresho byoroheje nka amaterefone, kwambara, amarembo, na sisitemu yigenga.

Imbonerahamwe yo kugereranya: NPU na GPU na CPU

Ikiranga	NPU	GPU	CPU
Intego	Umwanzuro wa AI	Igishushanyo, rusange AI	Kubara-intego rusange
Imbaraga	⭐⭐⭐⭐⭐	⭐⭐	⭐
Ubukererwe (Igihe-nyacyo)	Hasi	Hagati	Hejuru
Iringaniza Imirimo ya AI	Cyiza	Nibyiza cyane	Ntarengwa
Gukoresha Urubanza	Impande AI, AI igendanwa	Amahugurwa ya AI, ibishushanyo	Kugenzura logique, imirimo ya OS

Muguhuza NPUs mubisubizo bya compte ya AI, ubucuruzi burashobora gufungura imashini yihuta yiga imashini hamwe nigiciro gito cyibikorwa, bigatuma NPU iba umusingi wibikoresho bya AI bizaza.

NPU na CPU, GPU, na TPU: Isesengura rigereranya

Nkibikenewe igihe nyacyo AI ikura mubikoresho-uhereye kuri terefone zigendanwa n'ibinyabiziga byigenga kugeza kuri robo-nganda-impaka zerekeye gutunganya neza iyo mirimo irakomera. Mugihe CPU, GPUs, TPU, na NPUs Byose Bikora kwiga imashini imirimo, itezimbere kubikorwa bitandukanye cyane. Gusobanukirwa itandukaniro nibyingenzi muguhitamo ibyuma bya Porogaramu ya AI, cyane cyane kuri inkombe.

CPU (Igice cyo Gutunganya Hagati)

Uwiteka CPU ikomeza gutunganywa cyane. Ikora ibintu byinshi byimirimo-rusange yo kubara, harimo imikorere ya sisitemu y'imikorere, Ubuyobozi bwa I / O., na ibitekerezo bikurikirana. Mugihe CPU ishobora gukora tekiniki ya AI, ntabwo itezimbere kuri gutunganya iyo miyoboro isaba.

GPU (Igice cyo gutunganya ibishushanyo)

Mu ntangiriro yatunganijwe mugutanga amashusho na videwo ,. GPU byagaragaye ko ari byiza cyane kuri ibikorwa bisa, gukora bikwiranye byombi Amahugurwa ya AI na umwanzuro. GPUs nziza cyane Ibidukikije hagati yamakuru, aho gukoresha ingufu n'umwanya bitagabanijwe.

TPU (Igice cyo gutunganya Tensor)

Byakozwe na Google ,. TPU ni kubara mubikorwa bya AI. Itanga imyitozo ikomeye nibikorwa byerekana ariko iboneka cyane muri ibikorwa remezo cyangwa ibikoresho-byo mu rwego rwo hejuru.

NPU (Igice cyo gutunganya Neural)

Byashizweho kuva hasi kugeza kuri Umwanzuro wa AI, i NPU itanga imikorere idasanzwe kuri watt. Ubu byashizwemo cyane Sisitemu kuri Chip (SoC) gushushanya kuri terefone zigendanwa, ibikoresho bya AI, hamwe na mashini yigenga.

Imbonerahamwe yo Kugereranya

Ikiranga	CPU	GPU	TPU	NPU
Byashizweho Kuri	Intego rusange	Igishushanyo & AI	Tensor Ops	Umwanzuro wa AI
Amahugurwa ya AI	Abakene	Cyiza	Nibyiza cyane	Ntarengwa
Umwanzuro wa AI	Ntarengwa	Nibyiza	Cyiza	Cyiza
Imbaraga	Hasi	Hagati	Hasi	Hejuru
Ubukererwe (Inshingano zo Kuruhande)	Hejuru	Hagati	Hasi	Hasi cyane
Igendanwa / IoT	Abakene	Abakene	Ntarengwa	Cyiza
Inkunga	Mugari	Mugari	Muri make (Google)	Guciriritse (biratandukanye)

Ibyingenzi:

GPUs Byahiswemo Kuri Amahugurwa yicyitegererezo na Kubara.
TPU ni igicu-cyiza kandi cyiza muri Google AI ecosystem.
CPU ni generaliste, ntabwo aribyiza byo kwiga byimbitse.
NPUs ni i-Kuri Kuri ku gikoresho AI, impirimbanyi nziza yumuvuduko, imikorere, nimbaraga nke kubisobanuro byakazi.

Nkuko AI ikomeje kwimukira kuri inkombe, NPU igaragara nkibisubizo bifatika byigihe kirekire kuri igihe-nyacyo, yashyizwemo imashini yiga.

NPU zikoreshwa he? Ibyingenzi

Ibice bitunganya imitsi (NPUs) ubu ni ibice fatizo mubice byinshi bya Tekinoroji ikoreshwa na AI, cyane cyane abasaba ku gikoresho, gukoresha ingufu nke, na igihe nyacyo cyo kwitabira. Nkuko inganda zikomeje kwishyira hamwe ubwenge bwubuhanga mubikorwa byabo, NPU zirimo gukurikizwa byombi ibikoresho bya elegitoroniki na sisitemu y'inganda.

1. Amaterefone n'ibikoresho bigendanwa

Ibigezweho amaterefone bafite ibikoresho bya NPU kugirango imbaraga ziteye imbere Ibiranga AI nka:

Kumenyekana mu maso (urugero, kwemeza biometrike)
Kongera amafoto na gutahura ikintu muri porogaramu za kamera
Abafasha b'ijwi na guhindura ururimi
Ukuri gushimishije (AR) gutanga mugihe nyacyo

Kuyobora chipets zigendanwa nka Imashini ya Apple ya A ya moteri ya Neural Moteri, Qualcomm Snapdragon, na Huinwei's Kirin SoC guhuza NPUs kugirango ikore neza gutunganya AI.

2. Kubara Impande na IoT

Mw'isi ya inkingi ya AI, NPU ishoboza kamera yubwenge, ibikoresho bishobora kwambara, na urugo rwimodoka Kuri Gukora imashini yiga imashini mu karere. Ibi bigabanya kwishingikiriza kuri seriveri yibicu kandi byemeza vuba gufata ibyemezo, ndetse no mubidukikije bifite aho bihurira.

3. Imodoka na robo

NPU ziragenda zoherezwa muri ibinyabiziga byigenga na sisitemu ya robo gutunganya:

Sensor fusion
Kumenya inzira
Kumenyekanisha abanyamaguru
Sisitemu yo gutegeka amajwi

Mugukoresha umwanzuro ku kinyabiziga cyangwa robot, NPUs iremeza gutunganya igihe nyacyo hamwe n'ubukererwe buke.

4. Inganda n’ubuvuzi AI

NPU nayo ikoreshwa muri uruganda rwikora, kubungabunga, na amashusho yubuvuzi. Muri gukora ubwenge, NPU ishoboza Sisitemu yo kureba AI kumenya inenge, gutondekanya ibikoresho, no gukurikirana ibikorwa ubudahwema bidakenewe umurongo mugari wa burebure.

Abacuruzi bakomeye ba NPU n'abacuruzi

Gukura kwa AI ku nkombe byatumye habaho ishoramari rikomeye muri Gutezimbere ibyuma bya NPU n'ibigo bikomeye by'ikoranabuhanga. Abacuruzi barimo gushushanya imiterere ya yashyizwemo AI mugutanga ibisubizo byubatswe byubatswe neza umuvuduko, ingufu, na guhuza ibikorwa. Buri kirango gifite icyacyo Ubwubatsi bwa NPU, ibikoresho, hamwe nubufasha bwibidukikije.

1. Apple - Moteri ya Neural

Apple Moteri ya Neural, Byinjijwemo A-Urutonde na M-Urutonde, imbaraga zitezimbere ibikorwa bya AI muri iPhone, iPad, na Mac. Itanga:

Igihe nyacyo kumenyekana mu maso
Ku gikoresho cya Siri gutunganya
Amafoto meza hamwe na videwo

2. Huawei - Da Vinci Ubwubatsi

Huawei Uzamuke NPU na Da Vinci ubwubatsi ni Hagati Kuri Kirin SoCs na Ibikorwa remezo bya AI:

Kwihutisha ibitekerezo bya AI muri ibikoresho bigendanwa
Kohereza muri ibigo ku kigo AI
Gushyigikira MindSpore Urwego rwa AI

3. Qualcomm - Hexagon DSP hamwe na moteri ya AI

Qualcomm's Hexagon DSP + Moteri ya AI yashyizwe muri platform ya Snapdragon, itanga:

Kwihuta kwa AI kuri porogaramu za Android
Bikora neza gutunganya ibikoresho
Guhuza na TensorFlow Lite na ONNX

4. Google - Edge TPU

Uwiteka Impande TPU, igice cya Google Ikibuga cya korali, ni IoT hamwe noherejwe:

Byakoreshejwe neza TensorFlow Lite
Ultra-low power AI umwanzuro
Impapuro zifatika zifatika kuri ibyuma byubwenge na amarembo

5. NVIDIA - NVDLA na Jetson Platform

NVIDIA NVDLA (Kwihutisha Kwiga Byimbitse) na Urukurikirane rwa Jetson gutanga imikorere ya AI ikora cyane:

Byakoreshejwe muri robotics, drone, na imashini yigenga
Gushyigikira BITANDUKANYE, TensorRT, na SDK

Inzitizi n'imbibi za NPUs

Mugihe Ibice bitunganya imitsi (NPUs) tanga inyungu zidasanzwe muri Imikorere ya AI, ingufu, na Kubara, ntabwo bafite imipaka. Abashinzwe iterambere hamwe na sisitemu ihuza abantu bagomba gutekereza kubibazo byinshi bya tekiniki nibikorwa mugihe bakiriye NPU muri Ibikoresho bifasha AI.

1. Guhuza ibikorwa

Imwe mu nzitizi zingenzi ni inkunga igarukira kuri Imiterere ya AI. Bitandukanye na GPUs, ishyigikira urwego runini rwa platform nka TensorFlow, PyTorch, na ONNX, NPUs akenshi irasaba ibikoresho byabigenewe cyangwa SDK yihariye. Ibi birashobora kuganisha kuri:

Inzira ndende yiterambere
Ingorane muri icyitegererezo cyo guhindura no gutezimbere
Imikorere idahuye n'abacuruzi b'ibyuma

2. Umwanzuro-Gusa Ubushobozi

NPU nyinshi zagenewe gusa umwanzuro, ntabwo amahugurwa. Ibi bivuze:

Moderi ya AI igomba guhugurwa kuri GPU cyangwa TPU
Imyitozo iyo ari yo yose cyangwa gutunganya neza bisaba ibikorwa remezo byo hanze
Kugabanya guhinduka muri Kwiga ku gikoresho

3. Inzitizi zo Kwinjiza Ibyuma

Kwinjiza NPU muri sisitemu yashyizwemo cyangwa Sisitemu kuri Chip (SoC) ibishushanyo birimo ubucuruzi:

Agace ka Silicon
Inzitizi zubushyuhe
Ibishobora kuvuguruzanya ihari I / O hamwe nububiko bwagutse

Kazoza ka NPUs hamwe nibikoresho bya AI

Nkibisabwa igihe nyacyo AI ikomeje gutera imbere mu nganda, ejo hazaza ha Ibice bitunganya imitsi (NPUs) byitezwe kuba ishingiro ryubwihindurize bwa Ibyuma bya AI. Izi ntungamubiri zihariye ziragenda zirushaho gukomera, guhuza, no gukoresha ingufu-kubishyira mubice byingenzi bigize ibisekuruza bizaza ibikoresho bya AI, ibyuma byubwenge, na sisitemu yigenga.

Inzira zigaragara mu iterambere rya NPU

Kwishyira hamwe kwa SoC
NPU ziragenda zinjizwa muri Sisitemu kuri Chip (SoC) ibishushanyo hamwe na CPU, GPUs, na ISP. Iyi nyubako ihuriweho ituma byihuse imiyoboro yo gutunganya amakuru, igabanya ubukererwe, kandi igabanya sisitemu igoye.
Inkunga ya Heterogeneous Mudasobwa
Kazoza NPUs izakora cyane hamwe nizindi yihuta ya AI, ikwirakwiza imizigo hirya no hino CPU, GPUs, na TPU kubikorwa byiza.
Kunoza imikorere yimikorere
Abacuruzi barimo kubaka inkunga kubikorwa rusange bya AI nka ONNX, TensorFlow Lite, na PyTorch Mobile, kugabanya abaterankunga biga umurongo no gushishikariza kohereza imipaka.
Kwaguka Kurenze Ibikoresho byabaguzi
NPUs izagira uruhare runini muri gutangiza inganda, ubuvuzi bwubwenge, robotics, ubuhinzi AI, na sisitemu yo kugenzura, aho imbaraga nke, kwihuta cyane ni ngombwa.

Mw'isi igana ubwenge bwa hose, NPU ntabwo izihutisha AI gusa ahubwo izanakora byinshi birashoboka, birambye, na umutekano. Uruhare rwabo mu gushiraho sisitemu ikurikira, Kuva Kamera ikoreshwa na AI Kuri imiyoboro yigenga yigenga, bishimangira akamaro ko kwiyongera kwa indangarubuga yihariye yububiko mugihe cya AI.