GGUF models by second-state
291 GGUF models quantized by second-state on Hugging Face. Sizes run from 23M to 236B parameters. The longest trained context is 10240K tokens.
PH
Phi 4 Reasoning Plus
Phi · second-state
Params14.7B
Context32K
Q4_K_M9.1 GB
LL
Llama 3 Taiwan 8B Instruct Rc2
Llama · second-state
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Liberated-Qwen1.5-72B
Qwen · second-state
Params72.3B
Context32K
Q4_K_M44.1 GB
JI
jina embeddings v2 base zh
Jina · second-state
Params160M
Context8K
Q4_K_M0.1 GB
PA
Palmyra Med 70B 32K
Palmyra · second-state
Params70.6B
Context32K
Q4_K_M42.5 GB
FA
Falcon3 1B Instruct
Falcon · second-state
Params1.67B
Context8K
Q4_K_M1.1 GB
OU
OuteTTS 0.3 1B
Outetts · second-state
Params1.19B
Context4K
Q4_K_M0.7 GB
GE
Gemma 3n E2B It
Gemma · second-state
Params4.46B
Context32K
Q4_K_M2.8 GB
GE
Gemma-2-9B-Chinese-Chat
Gemma · second-state
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 3n E4B It
Gemma · second-state
Params6.87B
Context32K
Q4_K_M4.2 GB
PH
phi 2
Phi · second-state
Params2.78B
Context2K
Q4_K_M1.7 GB
MI
MiniCPM V 4 5
MiniCPM · second-state
Params8.19B
Context40K
Q4_K_M5.0 GB
CO
codegemma-7b-it
Codegemma · second-state
Params8.54B
Context8K
Q4_K_M5.3 GB
FU
functionary small v3.1
Functionary · second-state
Params8.03B
Context128K
Q4_K_M4.9 GB
YI
Yi-1.5-34B-Chat-16K
Yi · second-state
Params34.4B
Context16K
Q4_K_M20.7 GB
LL
DeepHermes 3 Llama 3 8B Preview
Llama · second-state
Params8.03B
Context128K
Q4_K_M4.9 GB
NO
Nomic Embed Text v1.5
Nomic · second-state
Params137M
Context2K
Q4_K_M0.1 GB
QW
Qwen3 30B A3B Thinking 2507
Qwen · second-state
Params30.5B
Context256K
Q4_K_M18.6 GB
ZE
Zephyr 7B Alpha
Zephyr · second-state
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2-0.5B-Instruct
Qwen · second-state
Params494M
Context32K
Q4_K_M0.4 GB
IN
Internlm2_5 1_8b Chat
InternLM · second-state
Params1.89B
Context32K
Q4_K_M1.2 GB
QW
Gte Qwen2 7B Instruct
Qwen · second-state
Params7.61B
Context128K
Q4_K_M4.7 GB
ST
stable diffusion 2 1
Stable · second-state
Params1.3B
Context—
Smallest1.7 GB
BR
Breeze 7B Instruct V1_0
Breeze · second-state
Params7.49B
Context32K
Q4_K_M4.5 GB
PH
phi 4
Phi · second-state
Params14.7B
Context16K
Q4_K_M9.1 GB
GE
gemma-1.1-7b-it
Gemma · second-state
Params8.54B
Context8K
Q4_K_M5.3 GB
LL
Llama-3-8B-Instruct-262k
Llama · second-state
Params8.03B
Context256K
Q4_K_M4.9 GB
LL
Llama 3.3 Swallow 70B Instruct v0.4
Llama · second-state
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
llm-compiler-7b
Llm · second-state
Params6.74B
Context16K
Q4_K_M4.1 GB
MI
Samantha 1.2 Mistral 7B
Mistral · second-state
Params7.24B
Context32K
Q4_K_M4.4 GB