13 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Jani Monoses	db674e3d24	Add OLMo2 model. (#2233)	2024-11-28 00:15:20 -08:00
Jani Monoses	d98fa1e93d	Add simple CPU offloading support. (#2081)	2024-11-23 06:23:53 +00:00
Jani Monoses	66318ffe96	Rename layer_idx to layer_id for consistency (#2078)	2024-11-18 13:00:02 -08:00
Jani Monoses	916b3cdddc	Allow passing dtype and max_new_tokens to HF reference script (#1903)	2024-11-03 08:24:37 -08:00
Jani Monoses	5ab20cceba	Use SGLang imports for linear layer (#1696)	2024-10-17 07:50:01 -07:00
Jani Monoses	a5114b6f91	Add OLMo model (#1676)	2024-10-16 00:11:18 -07:00
Jani Monoses	3ff641132e	Remove references to squeezellm (#1603)	2024-10-07 11:30:41 -07:00
Jani Monoses	1f4b5f770d	Add OLMoE model (#1444)	2024-09-17 01:14:53 -07:00
Jani Monoses	474317f2b6	Support Phi3 mini and medium (#1299)	2024-09-02 21:49:40 -07:00
Jani Monoses	64ee9c030e	Openrouter usage example (#327)	2024-03-23 10:16:24 -07:00
Jani Monoses	30d17840fc	Update dependencies (#326)	2024-03-23 10:15:58 -07:00
Jani Monoses	b57abe1663	Add StableLM model. (#301)	2024-03-22 13:24:08 -07:00
Jani Monoses	e57f079275	Use Anthropic messages API (#304)	2024-03-22 13:23:31 -07:00