EdgeLLM-Nano: Auditing Polar-Guided Key-Cache Compression and Consistency-Anchored Pruning on a 33.6 MB On-Device Language Model
arXiv:2610.14475v1 Announce Type: new Abstract: Deploying language models (LMs) on the edge presents unique memory, latency, and power challenges absent in high-performance computing. KV-cache compression emerges as a promising approach to address these challenges. However, the effectiveness of curr
Der Artikeltext wird beim nächsten Sync nachgeladen. Original bei arXiv cs.CL lesen
Quelle: arXiv cs.CL (arXiv cs.CL). Original öffnen