F16 GGUF models
Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.
QW
QwQ 32B Preview
Qwen · ThomasBaruzier
Params32.8B
Context32K
Q4_K_M19.9 GB
GE
Gemma 3 4b It Uncensored
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
MO
MOSS Image Text Encoder Heretic
Moss · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
QW
DS R1 Qwen3 8B ArliAI RpR v4 Small
Qwen · Lewdiculous
Params8.19B
Context128K
Q4_K_M5.0 GB
OR
Ornith 1.5 9B
Ornith · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GE
Gemma 4 E4B IT ABLITERATED UNCENSORED PHILADELPHIA CLASS
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
DA
danube2-1.8b-Tess-v1.5
Danube · mradermacher
Params1.83B
Context8K
Q4_K_M1.1 GB
MO
MOSS Transcribe Diarize
Moss · cstr
Params909M
Context—
Smallest0.0 GB
GE
gemma 2 2b rebus solver fp16
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
DA
datagemma rig 27b it
Datagemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
LL
Llama 3.1 8B Lexi Uncensored V2 Heretic
Llama · Spaceballs
Params8B
Context128K
Q4_K_M4.9 GB
SM
SmolLM2 1.7B Instruct Uncensored
SmolLM · mradermacher
Params1.81B
Context8K
Q4_K_M1.1 GB
QW
Huihui Qwen3 1.7B Abliterated v2
Qwen · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
PA
parakeet rnnt 0.6b
Parakeet · cstr
Params617M
Context—
Smallest0.4 GB
AR
ARWKV 7B Preview 0.1
Arwkv · mradermacher
Params8.29B
Context1024K
Q4_K_M5.2 GB
LF
LFM2.5-350M
Lfm · ensu-app
Params354M
Context125K
Q4_K_M0.2 GB
AR
Armenian GPT 1.0 3B
Armenian · ArmGPT
Params3.43B
Context256K
Q4_K_M2.1 GB
PR
Prism Coder 9b
Prism · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
QW
Qwen2.5 0.5B
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
EU
Eurus 2 7B PRIME
Eurus · bartowski
Params7.62B
Context4K
Q4_K_M4.7 GB
LL
Llama 3.2 3B Instruct heretic
Llama · saidutta69
Params3.21B
Context128K
Q4_K_M2.0 GB
QW
Qwen2.5 0.5B Instruct
Qwen · second-state
Params494M
Context32K
Q4_K_M0.4 GB
LL
llava llama 3 8b v1 1
Llama · xtuner
Params8B
Context8K
Smallest4.9 GB
DI
diar streaming sortformer 4spk v2.1
Diar · handy-computer
Params118M
Context—
Smallest0.1 GB
LL
MathCoder2 CodeLlama 7B
Llama · bartowski
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
DarkIdol Llama 3.1 8B Instruct 1.2 Uncensored
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
QW
Qwen3 Reranker 4B
Qwen · mradermacher
Params4B
Context40K
Q4_K_M2.5 GB
QW
Qwen3.5 9B Kimi K3 Distilled
Qwen · somenetworktrouble
Params9.2B
Context256K
Q4_K_M5.8 GB
AL
AllOverButTheCrying-7B-slerp
Alloverbutthecrying · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
RedSage Qwen3 8B Ins
Qwen · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB