GGUF models: apache-2.0 license

86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3-Coder-Next
Qwen · unsloth
Params80B
Context256K
Q4_K_M48.5 GB
Coding
QW
Qwen Image Edit 2509
Qwen · QuantStack
Params20.4B
Context—
Q4_K_M13.1 GB
GGUF
AL
all-MiniLM-L6-v2
All · second-state
Params23M
Context512
Q4_K_M0.0 GB
Embedding
QW
Qwen3-0.6B
Qwen · unsloth
Params596M
Context40K
Q4_K_M0.4 GB
GGUF
SE
SeedVR2 comfyUI
Seedvr · AInVFX
Params7.8B
Context—
Q4_K_M2.0 GB
GGUF
AL
all-MiniLM-L6-v2
All · leliuga
Params23M
Context512
Q4_K_M0.0 GB
CodingEmbedding
MI
Voxtral Small 24B
Mistral · handy-computer
Params24.3B
Context—
Q4_K_M14.3 GB
GGUF
ME
Mellum2 12B A2.5B Instruct
Mellum · JetBrains
Params12.1B
Context128K
Smallest12.9 GB
GGUF
EM
Embeddinggemma 2
Embeddinggemma · unsloth
Params271M
Context256K
Smallest0.2 GB
EmbeddingVision
GE
gemma-4-E4B-it
Gemma · ggml-org
Params7.5B
Context128K
Smallest0.1 GB
Vision
TA
UI-TARS-1.5-7B
Tars · Mungert
Params7.6B
Context125K
Q4_K_M4.8 GB
Vision
QW
Qwen3-8B
Qwen · unsloth
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
GE
gemma 4 E4B it qat
Gemma · unsloth
Params93M
Context128K
Smallest0.1 GB
Vision
FL
FLUX.1 schnell
Flux · city96
Params11.9B
Context—
Smallest4.0 GB
GGUF
QW
Qwen3.6-35B-A3B
Qwen · ggml-org
Params1.9B
Context256K
Q4_K_M20.4 GB
Vision
SN
snowflake arctic embed m v1.5
Snowflake · Snowflake
Params109M
Context512
Smallest0.1 GB
Embedding
QW
Qwen3 1.7B
Qwen · ggml-org
Params2.03B
Context40K
Q4_K_M1.3 GB
GGUF
QW
Qwen3.5-122B-A10B-Uncensored-HauhauCS-Aggressive
Qwen · HauhauCS
Params122B
Context256K
Q4_K_M74.2 GB
Vision
QW
Qwen2.5 VL 3B Instruct
Qwen · ggml-org
Params3.09B
Context125K
Q4_K_M1.9 GB
Vision
WA
Wan2.1 14B VACE
Wan · QuantStack
Params17.3B
Context—
Q4_K_M11.6 GB
GGUF
GR
grug 27b mtp
Grug · ProCreations
Params27.3B
Context256K
Q4_K_M16.8 GB
GGUF
QW
Qwen3.5 4B
Qwen · bartowski
Params4.33B
Context256K
Q4_K_M3.0 GB
Vision
QW
Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive
Qwen · HauhauCS
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
QW
Qwen Image
Qwen · unsloth
Params20.4B
Context—
Q4_K_M12.8 GB
GGUF
GR
Granite 4.2 3B BE
Granite · taronaeo
Params3.66B
Context—
Q4_K_M2.2 GB
ReasoningTool use
IM
Z Image Turbo
Image · leejet
Params6.15B
Context—
Smallest2.6 GB
GGUF
GE
Gemma 4 E2B It
Gemma · bartowski
Params4.65B
Context128K
Q4_K_M3.5 GB
Vision
GE
Google_Gemma 4 12B It
Gemma · lmstudio-community
Params11.9B
Context256K
Q4_K_M7.4 GB
Vision
QW
Qwen3 Reranker 0.6B
Qwen · ggml-org
Params596M
Context40K
Smallest0.6 GB
Embedding
QW
Qwen Image 2.1 Text Encoder Heretic
Qwen · pottokao
Params8.2B
Context256K
Q4_K_M5.0 GB
CodingVision

Keep browsing