GGUF models by FreedomAISVR
89 GGUF models quantized by FreedomAISVR on Hugging Face. Sizes run from 334M to 70.6B parameters. The longest trained context is 1024K tokens.
GE
Gemma 4 E2B It
Gemma · FreedomAISVR
Params4.65B
Context128K
Smallest3.4 GB
MI
Ministral 3 8B Reasoning 2512 NVFP4
Mistral · FreedomAISVR
Params8.49B
Context256K
Smallest4.9 GB
GE
Gemma 4 E4B It
Gemma · FreedomAISVR
Params7.52B
Context128K
Smallest5.1 GB
OR
Ornith 1.0 35b
Ornith · FreedomAISVR
Params34.7B
Context256K
Smallest19.7 GB
MU
Muse Glimmer 30b
Muse · FreedomAISVR
Params27.9B
Context128K
Smallest15.5 GB
OR
Ornith 1.0 35b
Ornith · FreedomAISVR
Params34.7B
Context256K
Smallest19.8 GB
QW
Qwable v1 MXFP4 MOE
Qwable · FreedomAISVR
Params35.5B
Context256K
Smallest20.3 GB
GL
GLM 4.6V Flash MXFP4
GLM · FreedomAISVR
Params9.4B
Context128K
Smallest5.2 GB
MI
Ministral 3 8B Instruct 2512 NVFP4
Mistral · FreedomAISVR
Params8.49B
Context256K
Smallest4.9 GB
QW
Qwen3.5 4B Instruct MXFP4
Qwen · FreedomAISVR
Params4.21B
Context256K
Smallest2.6 GB
QW
Qwable v1 NVFP4
Qwable · FreedomAISVR
Params35.5B
Context256K
Smallest20.2 GB
MI
Ministral 3 14B Reasoning 2512 NVFP4
Mistral · FreedomAISVR
Params13.5B
Context256K
Smallest7.8 GB
QW
Qwythos 9b
Qwythos · FreedomAISVR
Params8.95B
Context1024K
Smallest5.1 GB
QW
Qwen3.5 4B MTP MXFP4
Qwen · FreedomAISVR
Params334M
Context256K
Smallest2.7 GB
QW
Qwen3.6 35B A3B Claude 4.7 Distill NVFP4
Qwen · FreedomAISVR
Params35.5B
Context256K
Smallest20.2 GB
QW
Qwen3.5 9B MTP MXFP4
Qwen · FreedomAISVR
Params456M
Context256K
Smallest5.4 GB
GL
GLM 4.7 Flash MXFP4 MOE
GLM · FreedomAISVR
Params29.9B
Context198K
Smallest17.0 GB
MI
Magistral Small 2509
Mistral · FreedomAISVR
Params23.6B
Context128K
Smallest12.7 GB
QW
Qwen3.5 4B Instruct MTP MXFP4
Qwen · FreedomAISVR
Params334M
Context256K
Smallest2.7 GB
DI
DiffusionGemma 26B A4B it MXFP4
Diffusiongemma · FreedomAISVR
Params25.2B
Context256K
Smallest13.7 GB
NO
North Mini Code 1.0 NVFP4
North · FreedomAISVR
Params30.5B
Context488K
Smallest17.3 GB
MI
Ministral 3 8B Instruct 2512 MXFP4
Mistral · FreedomAISVR
Params8.49B
Context256K
Smallest4.7 GB
GE
Gemma 4 E2B It Qat
Gemma · FreedomAISVR
Params4.63B
Context128K
Smallest3.3 GB
NE
Nex N2 Mini
Nex · FreedomAISVR
Params34.7B
Context256K
Smallest19.8 GB
NO
North Mini Code 1.0 MXFP4
North · FreedomAISVR
Params30.5B
Context488K
Smallest17.0 GB
MI
Ministral 3 14B Reasoning 2512 MXFP4
Mistral · FreedomAISVR
Params13.5B
Context256K
Smallest7.4 GB
NE
Nex N2 Mini
Nex · FreedomAISVR
Params34.7B
Context256K
Smallest19.7 GB
LL
Llama 3.3 70B Instruct
Llama · FreedomAISVR
Params70.6B
Context128K
Smallest37.8 GB
MI
Ministral 3 8B Reasoning 2512 MXFP4
Mistral · FreedomAISVR
Params8.49B
Context256K
Smallest4.7 GB