GGUF models by elliotthwang

43 GGUF models quantized by elliotthwang on Hugging Face. Sizes run from 12M to 8.03B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
elliott Llama 2 7b zh KimLan
Llama · elliotthwang
Params6.74B
Context2K
Smallest4.1 GB
GGUF
MI
DPO Kimlan Mistral 7B Tw
Mistral · elliotthwang
Params7.25B
Context32K
Smallest4.4 GB
Tool use
MI
KimLan Adapter Mistral0.2 7b tw
Mistral · elliotthwang
Params12M
Context—
Smallest0.0 GB
GGUF
LL
Kimlan Llama 3.2 3B Instruct Tw
Llama · elliotthwang
Params3.21B
Context128K
Smallest3.4 GB
GGUF
LL
KimLan Elliott LLaMa GPTQ
Llama · elliotthwang
Params6.74B
Context2K
Smallest4.8 GB
GGUF
MI
KimLan Mistral 7B v0.3 tw
Mistral · elliotthwang
Params7.25B
Context32K
Smallest4.4 GB
GGUF
GE
Kimlantg Gemma 2 It Tw
Gemma · elliotthwang
Params2.51B
Context8K
Smallest1.6 GB
GGUF
KI
KimLan OpenChat_SFT Tw
Kimlan · elliotthwang
Params7.24B
Context8K
Smallest4.4 GB
GGUF
GE
Kimlanqa Gemma 2 2b It Tw
Gemma · elliotthwang
Params2.61B
Context8K
Smallest1.7 GB
GGUF
PH
phi 3.5 tw
Phi · elliotthwang
Params3.82B
Context128K
Smallest2.4 GB
GGUF
KI
KimLan OpenChat2000 Tw
Kimlan · elliotthwang
Params7.24B
Context8K
Smallest4.4 GB
GGUF
PH
DPO Kimlan Phi 4 Mini Instruct Tw
Phi · elliotthwang
Params3.84B
Context128K
Smallest2.5 GB
Tool use
MI
Mistral0.3 7b tw
Mistral · elliotthwang
Params7.25B
Context32K
Smallest14.5 GB
GGUF

Keep browsing