F16 GGUF models
Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.
HA
Harmonic 9B
Harmonic · DJLougen
Params8.95B
Context256K
Q4_K_M5.6 GB
LL
Hermes-2-Theta-Llama-3-8B-32k
Llama · mradermacher
Params8B
Context32K
Q4_K_M4.9 GB
MI
Mistral Syndicate 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen3 8B
Qwen · lm-kit
Params8.19B
Context40K
Q4_K_M5.0 GB
IN
Index Homura 2B
Index · mradermacher
Params1.94B
Context256K
Q4_K_M1.3 GB
LL
llama-3-spicy-abliterated-stella-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
IN
InternLM2
InternLM · mradermacher
Params7.74B
Context256K
Q4_K_M4.7 GB
MA
maple preview
Maple · stamsam
Params20.2B
Context128K
Q4_K_M12.3 GB
ST
L3-SthenoMaidBlackroot-8B-V1
Sthenomaidblackroot · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LI
ozone ai 0x lite
Lite · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
PH
Tess v2.5 Phi 3 medium 128k 14B
Phi · mradermacher
Params14B
Context128K
Q4_K_M8.6 GB
QW
Qwen1.5-110B-Chat
Qwen · second-state
Params111B
Context32K
Q4_K_M67.2 GB
QW
AllThingsIntel-Apollo-V0.1-4B-Thinking-Q4_K_M
Qwen · AllThingsIntel
Params4B
Context256K
Q4_K_M2.5 GB
QW
ElisNovel V1 14B
Qwen · cyanelis
Params14.8B
Context40K
Q4_K_M9.0 GB
BA
BabyMistral
Babymistral · mradermacher
Params1.55B
Context8K
Q4_K_M0.9 GB
PH
Phi 3.5 Mini instruct_Uncensored
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
QW
Qwen3-ASR-0.6B
Qwen · OpenVoiceOS
Params938M
Context—
Smallest1.9 GB
ST
starcoder2-15b-instruct-v0.1
StarCoder · second-state
Params16B
Context16K
Q4_K_M9.9 GB
GP
Openai.Gpt Oss 120b
gpt-oss · DevQuasar
Params117B
Context128K
Q4_K_M87.9 GB
NE
NeuralPipe-7B-slerp
Neuralpipe · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral-7B-Instruct-v0.3
Mistral · SanctumAI
Params7.25B
Context32K
Q4_K_M4.4 GB
JA
JackOD 9B Coder
Jackod · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
SO
Soprano 1.1 80M
Soprano · BricksDisplay
Params30M
Context—
Q4_K_M0.0 GB
GE
Gemma4 E4B It Abliterated AND Disinhibited USE THIS
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
FA
Falcon
Falcon · mradermacher
Params8.11B
Context2K
Q4_K_M5.0 GB
LL
Llama3-dolphin-slerp
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
PH
phi 4 mini 3.8b instruct
Phi · lm-kit
Params3.84B
Context128K
Q4_K_M2.5 GB
ON
OneJev1.5 4B
Onejev · mradermacher
Params4.84B
Context256K
Q4_K_M3.1 GB
OU
outetts 0.3 1b
Outetts · cstr
Params1.19B
Context—
Smallest0.1 GB
GE
Gemma 4 E4B It GMCE
Gemma · mradermacher
Params7.5B
Context128K
Q4_K_M5.3 GB