Search

arXiv · Orchestra-Research/AI-Research-SKILLs

3 skills found.
Search results
#SkillRepositoryStarsUsed inTokensAuto-checkLicenceUpdated
1

Compress large language models using knowledge distillation from teacher to student models.

Orchestra-Research/AI-Research-SKILLs13k2 repos~3.4kAutomated safety check: PassMIT3 mo ago
2

Extend context windows of transformer models using RoPE, YaRN, ALiBi, and position interpolation techniques.

Orchestra-Research/AI-Research-SKILLs13k2 repos~3.9kAutomated safety check: PassMIT3 mo ago
3

Reduce LLM size and accelerate inference using pruning techniques like Wanda and SparseGPT.

Orchestra-Research/AI-Research-SKILLs13k2 repos~3.4kAutomated safety check: PassMIT3 mo ago