repositories Search Results · repo:whyNLP/LCKV language:Python
Filter by
0 files
inwhyNLP/LCKV (press backspace or delete to remove)Layer-Condensed KV cache w/ 10 times larger batch size, fewer params and less computation. Dramatic speed up with better task performance…

Sponsor open source projects you depend on
Contributors are working behind the scenes to make open source better for everyone—give them the help and recognition they deserve.Explore sponsorable projectsProTip! Press the / key to activate the search input again and adjust your query.