Dhammaan ereyada

Miiraha Aqoonta (Knowledge Distillation)

Tababarida moodel ardey (student) oo yar si uu u ku dayo moodel macallin (teacher) oo weyn — cadaadinta awoodda gudaha moodel jaban.

Barashada Mashiinka1 daqiiqo akhris

Qeexid

Distillation wuxuu ka wareejiyaa dhaqanka macallinka (moodel weyn) ilaa ardayga (moodel yar) isagoo isu ekaysiinaya itimaal jilicsan (soft probabilities), xaaladaha qarsoon, ama natiijooyinka la soo saaray — ee aan ahayn kaliya calaamadaha adag.

Si weyn ayaa loo isticmaalaa si loo geeyo kala-saareyaal degdeg ah, iyo si isbadalka loogu bilaabo dhisidda LLM-yo yar.

Si fudud

Shef weyn oo tababaraya bilaa-jir — bilaa-jirku wuxuu bartaa gaaban-gaabinta iyo xukunka dhadhanka, ee kama baran karo kaliya rasaasin buugga.

Halka aad ka aragto

  • Moodellada aragga mobile-ka ee laga miiray CNN-yo waaweyn.
  • Moodellada wada-hadalka yaryar ee lagu tababaray tusaalooyinka macallinka.

Sida ay u shaqeyso

  1. 1.Fuli macallinka

    Ururi calaamadaha jilicsan ama raadraacyada.

  2. 2.Tababar ardayga

    U ekaysii natiijooyinka macallinka iyo khasaaraha hawsha.

  3. 3.Geey ardayga

    Jinjimaad iyo xusuus jaban.

Maxay muhiim u tahay

  • Distillation waxay isku xirtaa moodellada baaritaanka waaweyn iyo xaddidaadaha production-ka.

Inta badan la khaldo

  • Ardaygu had iyo jeer wuxuu la mid yahay macallinka.

    Ardaydu waxay isu ekaysiiyaan macallimiinta — ku fadhiya farqi awood ah.