GGUF models by antoste

48 GGUF models quantized by antoste on Hugging Face. Sizes run from 134M to 18.5B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2 1.5B Instruct
Qwen · antoste
Params1.54B
Context32K
Smallest0.8 GB
GGUF
EU
EuroLLM 1.7B Instruct Q4 K M
Eurollm · antoste
Params1.66B
Context8K
Q4_K_M1.0 GB
GGUF
QW
Qwen2 1.5B Instruct
Qwen · antoste
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
QW
Qwen2 1.5B Instruct
Qwen · antoste
Params1.54B
Context32K
Smallest0.9 GB
GGUF
PH
Phi 3 Mini 128k Instruct
Phi · antoste
Params3.82B
Context128K
Smallest1.9 GB
Coding
QW
Qwen2 1.5B Instruct
Qwen · antoste
Params1.54B
Context32K
Smallest1.1 GB
GGUF
GP
Gpt2 Xl
Gpt · antoste
Params1.64B
Context1K
Q4_K_M1.2 GB
GGUF
QW
Qwen2.5 3B Instruct
Qwen · antoste
Params3.09B
Context32K
Smallest1.3 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · antoste
Params8.03B
Context128K
Smallest3.8 GB
Tool use
PH
Phi 3 Medium 128k Instruct
Phi · antoste
Params14B
Context128K
Smallest5.1 GB
Coding
GP
Gpt2 Medium
Gpt · antoste
Params406M
Context1K
Smallest0.2 GB
GGUF
PH
Phi 3 Medium 128k Instruct
Phi · antoste
Params14B
Context128K
Smallest7.9 GB
Coding
MI
Minerva-3B-base-v1.0
Minerva · antoste
Params2.89B
Context16K
Smallest1.3 GB
GGUF
LO
Loquace 410m
Loquace · antoste
Params405M
Context2K
Smallest0.4 GB
GGUF
LL
Meta Llama 3.1 8B
Llama · antoste
Params8.03B
Context128K
Smallest4.7 GB
GGUF
PH
Phi 3 Mini 128k Instruct
Phi · antoste
Params3.82B
Context128K
Smallest1.4 GB
Coding
PH
Phi 3 Medium 128k Instruct
Phi · antoste
Params14B
Context128K
Smallest6.1 GB
Coding
MA
Magiq-3
Magiq · antoste
Params18.5B
Context32K
Q4_K_M11.2 GB
GGUF
LL
AMD Llama 135m Q8 0
Llama · antoste
Params134M
Context2K
Smallest0.1 GB
GGUF
SE
SeewebLLM it Q2 K
Seewebllm · antoste
Params6.74B
Context4K
Smallest2.5 GB
GGUF
LO
Loquace 7B Q3 K L
Loquace · antoste
Params7.22B
Context2K
Smallest4.4 GB
GGUF
GE
Gemma 2 9b It
Gemma · antoste
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
QW
Qwen2 1.5B Instruct
Qwen · antoste
Params1.54B
Context32K
Smallest1.1 GB
GGUF
SM
SmolLM2 360M
SmolLM · antoste
Params409M
Context8K
Smallest0.4 GB
GGUF
QW
Qwen2-0.5B-Instruct
Qwen · antoste
Params494M
Context32K
Smallest0.4 GB
GGUF
GE
Gemma 2 9b It
Gemma · antoste
Params9.24B
Context8K
Smallest7.6 GB
GGUF
QW
Qwen2 1.5B Instruct
Qwen · antoste
Params1.54B
Context32K
Smallest0.9 GB
GGUF
AP
Nous 1 2B
Apollo · antoste
Params1.72B
Context40K
Smallest0.8 GB
ReasoningTool use
LL
Llama 3.1 8B Italian SAVA
Llama · antoste
Params7.25B
Context128K
Smallest2.7 GB
GGUF
AP
Nous 1 2B
Apollo · antoste
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use

About antoste on Hugging Face

antoste has published 48 GGUF models that ggufmodels.com tracks, across families such as Qwen, Phi and Llama. The most downloaded are Qwen2 1.5B Instruct, EuroLLM 1.7B Instruct Q4 K M and Qwen2 1.5B Instruct.

The quants antoste publishes most often are Q2_K (10), Q4_K_M (8), Q8_0 (6) and Q4_0 (4). Their Q4_K_M files range from 1.0 to 11.2 GB. Parameter counts run from 134M to 18.5B, and the longest trained context window is 1024K tokens.

Frequently asked questions

What GGUF models has antoste published?

48 models are listed here, mainly from the Qwen, Phi and Llama families. The most downloaded is Qwen2 1.5B Instruct.

Which quants does antoste publish?

The most common are Q2_K (10 models), Q4_K_M (8 models), Q8_0 (6 models) and Q4_0 (4 models).

Keep browsing