GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
GE
gemma ko 7b translate v0.5 i1
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
NE
NVIDIA-Nemotron-3.5-Super-VL-120B-A12B
Nemotron · Myric
Params121B
Context1024K
Smallest81.0 GB
LL
Skywork O1 Open Llama3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
PH
R3 Phi 4 Reasoning Plus LoRA 5K v1.1
Phi · mradermacher
Params14.7B
Context32K
Q4_K_M9.1 GB
FI
Firefly v4
Firefly · Guilherme34
Params4.65B
Context128K
Q4_K_M3.4 GB
LL
Llama 3.2 3B Instruct imatrix
Llama · liodon-ai
Params3.21B
Context128K
Q4_K_M2.0 GB
ST
stablelm-2-12b
Stablelm · mradermacher
Params12.1B
Context4K
Q4_K_M7.4 GB
CE
Cerebrum 1.0 8x7b
Cerebrum · backyardai
Params46.7B
Context32K
Q4_K_M28.4 GB
LL
LexiFun
Llama · Orenguteng
Params8.03B
Context8K
Q4_K_M4.9 GB
AI
airoboros 33b gpt4 1.4 SuperHOT 8k i1
Airoboros · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
LL
Latxa Llama 3.1 70B Instruct v2
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
CO
Codefu 7b v0.1
Codefu · duyntnet
Params7.62B
Context128K
Q4_K_M4.7 GB
NA
Nautilus 70B v0.1
Nautilus · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen2.5 72B Instruct Abliterated v2
Qwen · zetasepic
Params72.7B
Context32K
Q4_K_M47.4 GB
LL
Replete-Coder-Llama3-8B
Llama · BenevolenceMessiah
Params8.03B
Context8K
Q4_K_M4.9 GB
LU
Luth LFM2 1.2B
Luth · mradermacher
Params1.17B
Context125K
Q4_K_M0.7 GB
ST
stablelm-zephyr-3b
Stablelm · duyntnet
Params2.8B
Context4K
Q4_K_M1.7 GB
AN
M3.1 24B Animus V4 Final
Animus · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Qwen 7B Chat
Qwen · mradermacher
Params7.72B
Context32K
Q4_K_M4.9 GB
MO
Moonshine Tiny (Ukrainian)
Moonshine · handy-computer
Params27M
Context—
Smallest0.0 GB
QW
Ohmatic Qwen3 8B
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
MO
MobileLLM 1.5B
Mobilellm · mradermacher
Params1.56B
Context4K
Q4_K_M1.1 GB
MI
MiniMax H3 NVFP4
Minimax · brurpo
Params33.1B
Context—
Smallest11.4 GB
KU
Yehor.kulyk En Uk
Kulyk · csabakecskemeti
Params354M
Context125K
Q4_K_M0.2 GB
CA
Captain Eris Violet GRPO v0.420 i1
Captain · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Mixtral 8x7B Yes Instruct LimaRP
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
WI
Wizard Vicuna 13B Uncensored
Wizard · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
EX
K-EXAONE-236B-A23B
Exaone · LGAI-EXAONE
Params237B
Context256K
Q4_K_M143.5 GB
EX
EXAONE 3.5 32B Instruct
Exaone · mradermacher
Params32B
Context32K
Q4_K_M19.3 GB
EV
EvoLLM JP v1 7B
Evollm · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB