GGUF models by newsletter

56 GGUF models quantized by newsletter on Hugging Face. Sizes run from 596M to 46.7B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 2 2b It
Gemma · newsletter
Params2.61B
Context8K
Smallest2.2 GB
GGUF
NI
NinjaMouse 2.4B 32L danube Q6 K
Ninjamouse · newsletter
Params2.39B
Context16K
Smallest2.0 GB
CodingRoleplayTool use
WI
Wiedervereinigung-7b-dpo-laser
Wiedervereinigung · newsletter
Params7.24B
Context32K
Smallest5.9 GB
GGUF
MI
Codestral 22B v0.1
Mistral · newsletter
Params22.2B
Context32K
Smallest18.3 GB
Coding
MI
Mistral 7B Instruct v0.2
Mistral · newsletter
Params7.24B
Context32K
Smallest7.7 GB
GGUF
WA
wavecoder-ultra-6.7b
Wavecoder · newsletter
Params6.74B
Context16K
Smallest5.5 GB
Coding
GR
granite-8b-code-instruct
Granite · newsletter
Params8.05B
Context4K
Smallest6.6 GB
CodingTool use
MI
Mistral 7B Instruct v0.3
Mistral · newsletter
Params7.25B
Context32K
Smallest7.7 GB
Tool use
LL
LLaMA2 13B Tiefighter
Llama · newsletter
Params13B
Context4K
Smallest13.8 GB
GGUF
GE
Gemma 2 9b It SimPO
Gemma · newsletter
Params9.24B
Context8K
Smallest9.8 GB
GGUF
ST
rocket-3B
Stablelm · newsletter
Params2.8B
Context4K
Smallest2.3 GB
GGUF
MA
magnum 32b v1 Q6 K
Magnum · newsletter
Params32.5B
Context32K
Smallest26.7 GB
GGUF
QW
Qwen3 0.6B Base Q8 0
Qwen · newsletter
Params596M
Context32K
Smallest0.6 GB
GGUF
QW
QwQ 32B
Qwen · newsletter
Params32.8B
Context40K
Smallest34.8 GB
ReasoningTool use
IN
Internlm2_5 1_8b Chat
InternLM · newsletter
Params1.89B
Context32K
Smallest1.6 GB
GGUF
MI
microsoft WizardLM 2 7B Q8 0
Microsoft · newsletter
Params7.24B
Context32K
Smallest7.7 GB
GGUF
WI
wizardcoder-33b-v1.1-mirror
Wizardcoder · newsletter
Params33.3B
Context16K
Smallest27.4 GB
Coding
DA
h2o danube2 1.8b chat Q6 K
Danube · newsletter
Params1.83B
Context8K
Smallest1.5 GB
GGUF
LL
Llama3-German-8B-32k
Llama · newsletter
Params8.03B
Context64K
Smallest6.6 GB
GGUF
MI
Codestral-22B-v0.1-hf-FIM-fix
Mistral · newsletter
Params22.2B
Context32K
Smallest18.3 GB
Coding
LL
Llama3-DiscoLeo-Instruct-8B-32k-v0.1
Llama · newsletter
Params8.03B
Context64K
Smallest6.6 GB
GGUF
PH
Phi 3 Medium 128k Instruct
Phi · newsletter
Params14B
Context128K
Smallest14.8 GB
Coding
GE
Gemma 3 12b It MPOA v2 12B
Gemma · newsletter
Params11.8B
Context128K
Smallest12.5 GB
Vision
BU
buddhi-128k-chat-7b
Buddhi · newsletter
Params7.24B
Context128K
Smallest5.9 GB
GGUF
CO
c4ai-command-r-v01
Command R · newsletter
Params35B
Context128K
Smallest28.7 GB
GGUF
WI
Wiedervereinigung-7b-dpo
Wiedervereinigung · newsletter
Params7.24B
Context32K
Smallest5.9 GB
GGUF
LL
Llama3-DiscoLeo-Instruct-8B-v0.1
Llama · newsletter
Params8.03B
Context8K
Smallest6.6 GB
GGUF

Keep browsing