GGUF models by fernandoruiz

94 GGUF models quantized by fernandoruiz on Hugging Face. Sizes run from 11M to 46.7B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
OL
OLMoE 1B 7B 0125 Instruct Q4 0
OLMo · fernandoruiz
Params6.92B
Context4K
Smallest3.9 GB
GGUF
SA
Salamandra 2b Instruct
Salamandra · fernandoruiz
Params2.25B
Context8K
Smallest1.4 GB
Coding
QW
Qwen3 30B A1.5B High Speed
Qwen · fernandoruiz
Params30.5B
Context40K
Smallest17.3 GB
ReasoningTool use
EU
EuroLLM 22B Instruct Preview
Eurollm · fernandoruiz
Params22.6B
Context4K
Smallest12.9 GB
GGUF
QW
Qwen3 30B A3B Abliterated
Qwen · fernandoruiz
Params30.5B
Context40K
Smallest17.3 GB
ReasoningTool use
QW
Qwen3 0.6B Abliterated
Qwen · fernandoruiz
Params596M
Context40K
Smallest0.4 GB
GGUF
LI
Ling Lite
Ling · fernandoruiz
Params16.8B
Context32K
Smallest9.5 GB
GGUF
QW
PARD Qwen2.5 0.5B
Qwen · fernandoruiz
Params630M
Context32K
Smallest0.4 GB
Tool use
AL
ALIA 40b
Alia · fernandoruiz
Params40.4B
Context4K
Smallest23.3 GB
Coding
PH
Phi 3 medium 4k instruct Q4 K S
Phi · fernandoruiz
Params14B
Context4K
Smallest8.0 GB
Coding
LL
Llama 3.1 8B Instruct
Llama · fernandoruiz
Params8.03B
Context128K
Smallest4.7 GB
Tool use
GR
GroveMoE Inst
Grovemoe · fernandoruiz
Params32.9B
Context40K
Smallest18.7 GB
ReasoningTool use
LL
Llama 3.2 1B Instruct
Llama · fernandoruiz
Params1.24B
Context128K
Smallest0.8 GB
Tool use
GE
Gemma 2 27b It
Gemma · fernandoruiz
Params27.2B
Context8K
Smallest15.6 GB
GGUF
MI
MiniCPM4 8B
MiniCPM · fernandoruiz
Params8.19B
Context32K
Smallest4.7 GB
GGUF
SA
salamandraTA 7b Instruct
Salamandrata · fernandoruiz
Params7.77B
Context8K
Smallest4.6 GB
GGUF
QW
Biomed Qwen2 VL 2B Instruct
Qwen · fernandoruiz
Params1.78B
Context32K
Smallest1.1 GB
Vision
QW
PARD Qwen3 0.6B
Qwen · fernandoruiz
Params752M
Context40K
Smallest0.5 GB
ReasoningTool use
MI
Mixtral 8x7B Instruct v0.1
Mistral · fernandoruiz
Params46.7B
Context32K
Smallest26.4 GB
GGUF
OL
OLMoE 1B 7B 0125 Q4 0
OLMo · fernandoruiz
Params6.92B
Context4K
Smallest3.9 GB
GGUF
PH
Phi 3 medium 4k instruct Q4 K M
Phi · fernandoruiz
Params14B
Context4K
Q4_K_M8.6 GB
Coding
MI
Mistral Small 3.1 24B Instruct 2503
Mistral · fernandoruiz
Params23.6B
Context128K
Smallest13.4 GB
GGUF
SA
salamandraTA 2B
Salamandrata · fernandoruiz
Params2.25B
Context8K
Smallest1.4 GB
GGUF
FA
Text_Summarization
Falcon · fernandoruiz
Params61M
Context512
Smallest0.0 GB
GGUF
IN
InternVL3 2B
Internvl · fernandoruiz
Params1.78B
Context32K
Smallest1.1 GB
CodingTool useVision
PO
PowerMoE 3b
Powermoe · fernandoruiz
Params3.37B
Context4K
Smallest1.9 GB
GGUF
OP
OpenELM 3B Instruct
Openelm · fernandoruiz
Params3.04B
Context2K
Q4_K_M1.9 GB
GGUF
GE
Gemma 2 9b It
Gemma · fernandoruiz
Params9.24B
Context8K
Smallest5.4 GB
GGUF
GE
Gemma 2 9b Medical
Gemma · fernandoruiz
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
BL
Bloom 560m
Bloom · fernandoruiz
Params816M
Context1K
Smallest0.5 GB
GGUF

Keep browsing