🕸️BPSC WEB🕸️

What is mixture of expert architecture? #prelims MoE (Mixture of Experts) : Energy Effiency , Cost effective —> Basically think like the model is divided into many specialized sub models, one will be good in Maths, other in Languages, other in Philosophy etc. —> So if you request a specific query, the model will decide which sub models will be activated to solve the query —> Unlike models like ChatGPT where inference typically run by activating all parameters making it expensive

#Prelims Satellite failure Interlink: https://t.me/civils_web/11865