Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
UN
Saluki 27B 1.0 Abliteration LoRA
Underdog · spelled-a66
Params27B
Context—
Smallest0.0 GB
GGUF
AC
act-so101-multi-task
Act · khanhnd61
Params59M
Context—
Smallest0.2 GB
GGUF
QW
Qwen3.5 35B A3B Base
Qwen · maxwellb-hf
Params35.5B
Context256K
Smallest0.2 GB
GGUF
QW
Qwopus3.6 35B A3B v1
Qwopus · jamiefutch
Params35.5B
Context256K
Smallest21.2 GB
GGUF
QW
qwen3.8 27b kv approximation
Qwen · alimpfard
Params931M
Context—
Smallest0.5 GB
GGUF
ST
Stupid Equation Solver
Stupid · XIVAI
Params4M
Context—
Smallest0.0 GB
GGUF
DE
DeepSeek V3.2 dense attn imatrix
DeepSeek · Doctor-Shotgun
Params252M
Context—
Smallest1.0 GB
GGUF
OC
PP-OCRv6_small_det
Ocrv · cstr
Params2M
Context—
Smallest0.0 GB
GGUF
WA
WAI REALISM Illustrious
Wai · nuupy
Params2.57B
Context—
Q4_K_M1.6 GB
GGUF
XA
Xavier v10r34
Xavier · Coercer
Params2.57B
Context—
Q4_K_M1.6 GB
GGUF
HT
Html Model Tinyllama Chat Bnb 4bit
Html · learn-abc
Params51M
Context—
Smallest0.2 GB
GGUF
QW
qwen3.8 27B antislop svd lora
Qwen · hotdogs
Params435M
Context—
Smallest1.7 GB
GGUF
DE
DeepSeek V4 Flash Abliterated lora
DeepSeek · Sabomako
Params2.16B
Context—
Smallest2.3 GB
GGUF
QW
pflash scorer head
Qwen · Lucebox
Params3M
Context—
Smallest0.0 GB
GGUF
FA
Falcon3 10B Base 1.58bit
Falcon · nebuxcloud
Params10.3B
Context—
Smallest2.9 GB
GGUF
QW
Dflash
Qwen · cso3987
Params510M
Context256K
Q4_K_M0.3 GB
GGUF
QW
Qwen3 Coder 480B A35B Instruct heretic i1
Qwen · mradermacher
Params480B
Context256K
Smallest0.6 GB
GGUF
WA
Wan
Wan · coolrna
Params14.3B
Context—
Q4_K_M9.7 GB
GGUF
SN
snowflake arctic embed m v2.0 gguf embeddings cpp
Snowflake · chux0519
Params—
Context—
Smallest0.2 GB
GGUF
MI
MiniMax-M3.1-Flash
Minimax · mondk
Params426B
Context—
Q4_K_M258.1 GB
GGUF
BI
bitvla libero
Bitvla · fai-modelopt-tech
Params1.03B
Context—
Smallest1.4 GB
GGUF
QW
Qwen3.6-35B-A3B
Qwen · michaelw9999
Params35.5B
Context256K
Smallest29.3 GB
GGUF
DE
DeepSeek V4 Flash 0731 heretic
DeepSeek · MorinoNushi
Params284B
Context1024K
Smallest161.9 GB
GGUF
LL
Fingpt Mt_Llama2 7b_lora
Llama · shohaibsmallick
Params6M
Context—
Smallest0.0 GB
GGUF
MO
most embed de
Most · cstr
Params1.14B
Context—
Smallest0.9 GB
GGUF
GE
gemma 4 12B it qat q4 0 unquantized heretic lora
Gemma · Qwe1325
Params12B
Context—
Smallest0.0 GB
GGUF
FA
Falcon3 1B Instruct 1.58bit
Falcon · nebuxcloud
Params1.67B
Context—
Smallest0.7 GB
GGUF
CH
ChemAI v2 LoRA F16
Chemai · Virinchi999
Params40M
Context—
Smallest0.1 GB
GGUF
KI
LMF2.4 2.6B Kimi
Kimi · bunnycore
Params2M
Context—
Smallest0.0 GB
GGUF
PR
problem tensors
Problem · ilintar
Params—
Context—
Smallest0.0 GB
GGUF

Other uses

Keep browsing