GGUF models by newsletter
56 GGUF models quantized by newsletter on Hugging Face. Sizes run from 596M to 46.7B parameters. The longest trained context is 1000K tokens.
GE
Gemma 2 2b It
Gemma · newsletter
Params2.61B
Context8K
Smallest2.2 GB
NI
NinjaMouse 2.4B 32L danube Q6 K
Ninjamouse · newsletter
Params2.39B
Context16K
Smallest2.0 GB
WI
Wiedervereinigung-7b-dpo-laser
Wiedervereinigung · newsletter
Params7.24B
Context32K
Smallest5.9 GB
MI
Codestral 22B v0.1
Mistral · newsletter
Params22.2B
Context32K
Smallest18.3 GB
MI
Mistral 7B Instruct v0.2
Mistral · newsletter
Params7.24B
Context32K
Smallest7.7 GB
WA
wavecoder-ultra-6.7b
Wavecoder · newsletter
Params6.74B
Context16K
Smallest5.5 GB
GR
granite-8b-code-instruct
Granite · newsletter
Params8.05B
Context4K
Smallest6.6 GB
MI
Mistral 7B Instruct v0.3
Mistral · newsletter
Params7.25B
Context32K
Smallest7.7 GB
LL
LLaMA2 13B Tiefighter
Llama · newsletter
Params13B
Context4K
Smallest13.8 GB
GE
Gemma 2 9b It SimPO
Gemma · newsletter
Params9.24B
Context8K
Smallest9.8 GB
ST
rocket-3B
Stablelm · newsletter
Params2.8B
Context4K
Smallest2.3 GB
MA
magnum 32b v1 Q6 K
Magnum · newsletter
Params32.5B
Context32K
Smallest26.7 GB
QW
Qwen3 0.6B Base Q8 0
Qwen · newsletter
Params596M
Context32K
Smallest0.6 GB
QW
QwQ 32B
Qwen · newsletter
Params32.8B
Context40K
Smallest34.8 GB
IN
Internlm2_5 1_8b Chat
InternLM · newsletter
Params1.89B
Context32K
Smallest1.6 GB
MI
microsoft WizardLM 2 7B Q8 0
Microsoft · newsletter
Params7.24B
Context32K
Smallest7.7 GB
WI
wizardcoder-33b-v1.1-mirror
Wizardcoder · newsletter
Params33.3B
Context16K
Smallest27.4 GB
DA
h2o danube2 1.8b chat Q6 K
Danube · newsletter
Params1.83B
Context8K
Smallest1.5 GB
LL
Llama3-German-8B-32k
Llama · newsletter
Params8.03B
Context64K
Smallest6.6 GB
MI
Codestral-22B-v0.1-hf-FIM-fix
Mistral · newsletter
Params22.2B
Context32K
Smallest18.3 GB
LL
Llama3-DiscoLeo-Instruct-8B-32k-v0.1
Llama · newsletter
Params8.03B
Context64K
Smallest6.6 GB
PH
Phi 3 Medium 128k Instruct
Phi · newsletter
Params14B
Context128K
Smallest14.8 GB
GE
Gemma 3 12b It MPOA v2 12B
Gemma · newsletter
Params11.8B
Context128K
Smallest12.5 GB
BU
buddhi-128k-chat-7b
Buddhi · newsletter
Params7.24B
Context128K
Smallest5.9 GB
CO
c4ai-command-r-v01
Command R · newsletter
Params35B
Context128K
Smallest28.7 GB
WI
Wiedervereinigung-7b-dpo
Wiedervereinigung · newsletter
Params7.24B
Context32K
Smallest5.9 GB
LL
Llama3-DiscoLeo-Instruct-8B-v0.1
Llama · newsletter
Params8.03B
Context8K
Smallest6.6 GB