GGUF models by FreedomAISVR

89 GGUF models quantized by FreedomAISVR on Hugging Face. Sizes run from 334M to 70.6B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 4 E2B It
Gemma · FreedomAISVR
Params4.65B
Context128K
Smallest3.4 GB
ReasoningTool useVision
MI
Ministral 3 8B Reasoning 2512 NVFP4
Mistral · FreedomAISVR
Params8.49B
Context256K
Smallest4.9 GB
ReasoningTool useVision
GE
Gemma 4 E4B It
Gemma · FreedomAISVR
Params7.52B
Context128K
Smallest5.1 GB
ReasoningTool useVision
OR
Ornith 1.0 35b
Ornith · FreedomAISVR
Params34.7B
Context256K
Smallest19.7 GB
GGUF
MU
Muse Glimmer 30b
Muse · FreedomAISVR
Params27.9B
Context128K
Smallest15.5 GB
ReasoningTool useVision
OR
Ornith 1.0 35b
Ornith · FreedomAISVR
Params34.7B
Context256K
Smallest19.8 GB
GGUF
QW
Qwable v1 MXFP4 MOE
Qwable · FreedomAISVR
Params35.5B
Context256K
Smallest20.3 GB
ReasoningTool useVision
GL
GLM 4.6V Flash MXFP4
GLM · FreedomAISVR
Params9.4B
Context128K
Smallest5.2 GB
ReasoningTool useVision
MI
Ministral 3 8B Instruct 2512 NVFP4
Mistral · FreedomAISVR
Params8.49B
Context256K
Smallest4.9 GB
Tool useVision
QW
Qwen3.5 4B Instruct MXFP4
Qwen · FreedomAISVR
Params4.21B
Context256K
Smallest2.6 GB
ReasoningTool useVision
QW
Qwable v1 NVFP4
Qwable · FreedomAISVR
Params35.5B
Context256K
Smallest20.2 GB
ReasoningTool useVision
MI
Ministral 3 14B Reasoning 2512 NVFP4
Mistral · FreedomAISVR
Params13.5B
Context256K
Smallest7.8 GB
ReasoningTool useVision
QW
Qwythos 9b
Qwythos · FreedomAISVR
Params8.95B
Context1024K
Smallest5.1 GB
ReasoningTool useVision
QW
Qwen3.5 4B MTP MXFP4
Qwen · FreedomAISVR
Params334M
Context256K
Smallest2.7 GB
Vision
QW
Qwen3.6 35B A3B Claude 4.7 Distill NVFP4
Qwen · FreedomAISVR
Params35.5B
Context256K
Smallest20.2 GB
ReasoningTool use
QW
Qwen3.5 9B MTP MXFP4
Qwen · FreedomAISVR
Params456M
Context256K
Smallest5.4 GB
Vision
GL
GLM 4.7 Flash MXFP4 MOE
GLM · FreedomAISVR
Params29.9B
Context198K
Smallest17.0 GB
ReasoningTool use
MI
Magistral Small 2509
Mistral · FreedomAISVR
Params23.6B
Context128K
Smallest12.7 GB
ReasoningTool useVision
QW
Qwen3.5 4B Instruct MTP MXFP4
Qwen · FreedomAISVR
Params334M
Context256K
Smallest2.7 GB
Vision
DI
DiffusionGemma 26B A4B it MXFP4
Diffusiongemma · FreedomAISVR
Params25.2B
Context256K
Smallest13.7 GB
ReasoningTool useVision
NO
North Mini Code 1.0 NVFP4
North · FreedomAISVR
Params30.5B
Context488K
Smallest17.3 GB
CodingReasoningTool use
MI
Ministral 3 8B Instruct 2512 MXFP4
Mistral · FreedomAISVR
Params8.49B
Context256K
Smallest4.7 GB
Tool useVision
GE
Gemma 4 E2B It Qat
Gemma · FreedomAISVR
Params4.63B
Context128K
Smallest3.3 GB
ReasoningTool useVision
NE
Nex N2 Mini
Nex · FreedomAISVR
Params34.7B
Context256K
Smallest19.8 GB
ReasoningTool useVision
NO
North Mini Code 1.0 MXFP4
North · FreedomAISVR
Params30.5B
Context488K
Smallest17.0 GB
CodingReasoningTool use
MI
Ministral 3 14B Reasoning 2512 MXFP4
Mistral · FreedomAISVR
Params13.5B
Context256K
Smallest7.4 GB
ReasoningTool useVision
NE
Nex N2 Mini
Nex · FreedomAISVR
Params34.7B
Context256K
Smallest19.7 GB
ReasoningTool useVision
LL
Llama 3.3 70B Instruct
Llama · FreedomAISVR
Params70.6B
Context128K
Smallest37.8 GB
Tool use
MI
Ministral 3 8B Reasoning 2512 MXFP4
Mistral · FreedomAISVR
Params8.49B
Context256K
Smallest4.7 GB
ReasoningTool useVision

Keep browsing