GGUF models by elliotthwang
43 GGUF models quantized by elliotthwang on Hugging Face. Sizes run from 12M to 8.03B parameters. The longest trained context is 128K tokens.
LL
elliott Llama 2 7b zh KimLan
Llama · elliotthwang
Params6.74B
Context2K
Smallest4.1 GB
MI
DPO Kimlan Mistral 7B Tw
Mistral · elliotthwang
Params7.25B
Context32K
Smallest4.4 GB
MI
KimLan Adapter Mistral0.2 7b tw
Mistral · elliotthwang
Params12M
Context—
Smallest0.0 GB
LL
Kimlan Llama 3.2 3B Instruct Tw
Llama · elliotthwang
Params3.21B
Context128K
Smallest3.4 GB
LL
KimLan Elliott LLaMa GPTQ
Llama · elliotthwang
Params6.74B
Context2K
Smallest4.8 GB
MI
KimLan Mistral 7B v0.3 tw
Mistral · elliotthwang
Params7.25B
Context32K
Smallest4.4 GB
GE
Kimlantg Gemma 2 It Tw
Gemma · elliotthwang
Params2.51B
Context8K
Smallest1.6 GB
KI
KimLan OpenChat_SFT Tw
Kimlan · elliotthwang
Params7.24B
Context8K
Smallest4.4 GB
GE
Kimlanqa Gemma 2 2b It Tw
Gemma · elliotthwang
Params2.61B
Context8K
Smallest1.7 GB
PH
phi 3.5 tw
Phi · elliotthwang
Params3.82B
Context128K
Smallest2.4 GB
KI
KimLan OpenChat2000 Tw
Kimlan · elliotthwang
Params7.24B
Context8K
Smallest4.4 GB
PH
DPO Kimlan Phi 4 Mini Instruct Tw
Phi · elliotthwang
Params3.84B
Context128K
Smallest2.5 GB
MI
Mistral0.3 7b tw
Mistral · elliotthwang
Params7.25B
Context32K
Smallest14.5 GB