GGUF models by FreedomAISVR
89 GGUF models quantized by FreedomAISVR on Hugging Face. Sizes run from 334M to 70.6B parameters. The longest trained context is 1024K tokens.
QW
Mimo v2.6 Distill Qwen 9b
Qwen · FreedomAISVR
Params8.95B
Context256K
Smallest5.6 GB
GE
Gemma 4 12B it Uncensored Heretic MXFP4
Gemma · FreedomAISVR
Params11.9B
Context256K
Smallest6.6 GB
GE
Gemma 4 E4B it Ultra Uncensored Heretic MXFP4
Gemma · FreedomAISVR
Params7.52B
Context128K
Smallest5.1 GB
QW
Qwen3.8 27b
Qwen · FreedomAISVR
Params27.3B
Context256K
Smallest15.7 GB
GE
Gemma 4 E2B It Qat
Gemma · FreedomAISVR
Params4.63B
Context128K
Smallest3.3 GB
GE
Gemma 4 E4B it QAT MXFP4
Gemma · FreedomAISVR
Params7.46B
Context128K
Smallest5.0 GB
QW
Qwen3.6 35b A3B
Qwen · FreedomAISVR
Params34.7B
Context256K
Smallest19.8 GB
QW
Qwen AgentWorld 35B A3B MXFP4 MOE
Qwen · FreedomAISVR
Params34.7B
Context256K
Smallest19.8 GB
QW
Qwythos 9b
Qwythos · FreedomAISVR
Params8.95B
Context1024K
Smallest5.3 GB
GL
GLM 4.7 Flash NVFP4
GLM · FreedomAISVR
Params29.9B
Context198K
Smallest17.0 GB
QW
Qwen3.5 9B Instruct NVFP4
Qwen · FreedomAISVR
Params8.95B
Context256K
Smallest5.3 GB
GE
Gemma 4 31B it QAT NVFP4
Gemma · FreedomAISVR
Params30.7B
Context256K
Smallest17.3 GB
QW
Qwen3.5 4B Instruct NVFP4
Qwen · FreedomAISVR
Params4.21B
Context256K
Smallest2.5 GB
GE
Gemma 4 31B it QAT MXFP4
Gemma · FreedomAISVR
Params30.7B
Context256K
Smallest17.3 GB
NE
Nemotron 3 30b
Nemotron · FreedomAISVR
Params31.6B
Context1024K
Smallest18.8 GB
LL
Llama 3.3 70B Instruct
Llama · FreedomAISVR
Params70.6B
Context128K
Smallest40.0 GB
MI
Magistral Small 2509
Mistral · FreedomAISVR
Params23.6B
Context128K
Smallest13.4 GB
MU
Muse Glimmer 30b
Muse · FreedomAISVR
Params27.9B
Context128K
Smallest16.4 GB
NE
Nemotron 3 30b
Nemotron · FreedomAISVR
Params31.6B
Context1024K
Smallest19.3 GB
QW
Qwen3.5 4b
Qwen · FreedomAISVR
Params334M
Context256K
Smallest2.6 GB
MI
Ministral 3 14b
Mistral · FreedomAISVR
Params13.5B
Context256K
Smallest7.8 GB
QW
Qwen3.5 9B Instruct MTP NVFP4
Qwen · FreedomAISVR
Params456M
Context256K
Smallest5.5 GB
MI
Devstral Small 2
Mistral · FreedomAISVR
Params23.6B
Context384K
Smallest12.7 GB
MI
Devstral Small 2
Mistral · FreedomAISVR
Params23.6B
Context384K
Smallest13.4 GB
GE
Gemma 4 E4B it QAT NVFP4
Gemma · FreedomAISVR
Params7.46B
Context128K
Smallest5.2 GB
GE
Gemma 4 E2B It
Gemma · FreedomAISVR
Params4.65B
Context128K
Smallest3.3 GB
GL
GLM 4.6V Flash NVFP4
GLM · FreedomAISVR
Params9.4B
Context128K
Smallest5.5 GB
QW
Qwen AgentWorld 35B A3B NVFP4
Qwen · FreedomAISVR
Params34.7B
Context256K
Smallest19.7 GB
QW
Qwen3.5 4B MTP NVFP4
Qwen · FreedomAISVR
Params334M
Context256K
Smallest2.6 GB
MI
Ministral 3 14b
Mistral · FreedomAISVR
Params13.5B
Context256K
Smallest7.4 GB