GGUF models by FreedomAISVR

89 GGUF models quantized by FreedomAISVR on Hugging Face. Sizes run from 334M to 70.6B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Mimo v2.6 Distill Qwen 9b
Qwen · FreedomAISVR
Params8.95B
Context256K
Smallest5.6 GB
ReasoningTool useVision
GE
Gemma 4 12B it Uncensored Heretic MXFP4
Gemma · FreedomAISVR
Params11.9B
Context256K
Smallest6.6 GB
ReasoningTool useVision
GE
Gemma 4 E4B it Ultra Uncensored Heretic MXFP4
Gemma · FreedomAISVR
Params7.52B
Context128K
Smallest5.1 GB
ReasoningTool useVision
QW
Qwen3.8 27b
Qwen · FreedomAISVR
Params27.3B
Context256K
Smallest15.7 GB
ReasoningTool useVision
GE
Gemma 4 E2B It Qat
Gemma · FreedomAISVR
Params4.63B
Context128K
Smallest3.3 GB
ReasoningTool useVision
GE
Gemma 4 E4B it QAT MXFP4
Gemma · FreedomAISVR
Params7.46B
Context128K
Smallest5.0 GB
ReasoningTool useVision
QW
Qwen3.6 35b A3B
Qwen · FreedomAISVR
Params34.7B
Context256K
Smallest19.8 GB
ReasoningTool use
QW
Qwen AgentWorld 35B A3B MXFP4 MOE
Qwen · FreedomAISVR
Params34.7B
Context256K
Smallest19.8 GB
ReasoningTool useVision
QW
Qwythos 9b
Qwythos · FreedomAISVR
Params8.95B
Context1024K
Smallest5.3 GB
ReasoningTool useVision
GL
GLM 4.7 Flash NVFP4
GLM · FreedomAISVR
Params29.9B
Context198K
Smallest17.0 GB
ReasoningTool use
QW
Qwen3.5 9B Instruct NVFP4
Qwen · FreedomAISVR
Params8.95B
Context256K
Smallest5.3 GB
ReasoningTool useVision
GE
Gemma 4 31B it QAT NVFP4
Gemma · FreedomAISVR
Params30.7B
Context256K
Smallest17.3 GB
ReasoningTool useVision
QW
Qwen3.5 4B Instruct NVFP4
Qwen · FreedomAISVR
Params4.21B
Context256K
Smallest2.5 GB
ReasoningTool useVision
GE
Gemma 4 31B it QAT MXFP4
Gemma · FreedomAISVR
Params30.7B
Context256K
Smallest17.3 GB
ReasoningTool useVision
NE
Nemotron 3 30b
Nemotron · FreedomAISVR
Params31.6B
Context1024K
Smallest18.8 GB
ReasoningTool useVision
LL
Llama 3.3 70B Instruct
Llama · FreedomAISVR
Params70.6B
Context128K
Smallest40.0 GB
Tool use
MI
Magistral Small 2509
Mistral · FreedomAISVR
Params23.6B
Context128K
Smallest13.4 GB
ReasoningTool useVision
MU
Muse Glimmer 30b
Muse · FreedomAISVR
Params27.9B
Context128K
Smallest16.4 GB
ReasoningTool useVision
NE
Nemotron 3 30b
Nemotron · FreedomAISVR
Params31.6B
Context1024K
Smallest19.3 GB
ReasoningTool useVision
QW
Qwen3.5 4b
Qwen · FreedomAISVR
Params334M
Context256K
Smallest2.6 GB
Vision
MI
Ministral 3 14b
Mistral · FreedomAISVR
Params13.5B
Context256K
Smallest7.8 GB
Tool useVision
QW
Qwen3.5 9B Instruct MTP NVFP4
Qwen · FreedomAISVR
Params456M
Context256K
Smallest5.5 GB
Vision
MI
Devstral Small 2
Mistral · FreedomAISVR
Params23.6B
Context384K
Smallest12.7 GB
CodingTool useVision
MI
Devstral Small 2
Mistral · FreedomAISVR
Params23.6B
Context384K
Smallest13.4 GB
CodingTool useVision
GE
Gemma 4 E4B it QAT NVFP4
Gemma · FreedomAISVR
Params7.46B
Context128K
Smallest5.2 GB
ReasoningTool useVision
GE
Gemma 4 E2B It
Gemma · FreedomAISVR
Params4.65B
Context128K
Smallest3.3 GB
ReasoningTool useVision
GL
GLM 4.6V Flash NVFP4
GLM · FreedomAISVR
Params9.4B
Context128K
Smallest5.5 GB
ReasoningTool useVision
QW
Qwen AgentWorld 35B A3B NVFP4
Qwen · FreedomAISVR
Params34.7B
Context256K
Smallest19.7 GB
ReasoningTool useVision
QW
Qwen3.5 4B MTP NVFP4
Qwen · FreedomAISVR
Params334M
Context256K
Smallest2.6 GB
Vision
MI
Ministral 3 14b
Mistral · FreedomAISVR
Params13.5B
Context256K
Smallest7.4 GB
Tool useVision

Keep browsing