GGUF models by fernandoruiz

94 GGUF models quantized by fernandoruiz on Hugging Face. Sizes run from 11M to 46.7B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
PARD Llama 3.2 1B
Llama · fernandoruiz
Params1.5B
Context128K
Smallest0.9 GB
Tool use
TE
teapotllm Q4 0
Teapotllm · fernandoruiz
Params783M
Context512
Smallest0.5 GB
GGUF
PH
Phi 3 mini 4k instruct Q4 K S
Phi · fernandoruiz
Params3.82B
Context4K
Smallest2.2 GB
Coding
BI
BiMediX Eng Q4 0
Bimedix · fernandoruiz
Params46.7B
Context32K
Smallest26.4 GB
GGUF
OL
OLMo 2 0325 32B Instruct Q4 0
OLMo · fernandoruiz
Params32.2B
Context4K
Smallest18.3 GB
GGUF
QW
Qwen3 0.6B
Qwen · fernandoruiz
Params752M
Context40K
Smallest0.5 GB
ReasoningTool use
IN
InternVL3 14B
Internvl · fernandoruiz
Params14.8B
Context32K
Smallest8.5 GB
CodingTool useVision
GE
Gemma 2 2b It
Gemma · fernandoruiz
Params2.61B
Context8K
Smallest1.6 GB
GGUF
SU
SummLlama3.2 3B
Summllama · fernandoruiz
Params3.21B
Context128K
Smallest1.9 GB
Tool use
OL
OLMoE-1B-7B-0125-Instruct-enron
OLMo · fernandoruiz
Params6.92B
Context4K
Smallest3.9 GB
GGUF
MI
Mistral Small 3.1 24B Instruct 2503 HF
Mistral · fernandoruiz
Params23.6B
Context128K
Smallest13.4 GB
GGUF
OL
translation olmoe conventional full Q4 0
OLMo · fernandoruiz
Params6.92B
Context4K
Smallest3.9 GB
GGUF
OP
OpenELM 1_1B Instruct
Openelm · fernandoruiz
Params1.08B
Context2K
Smallest0.6 GB
GGUF
FA
Medical_Summarization
Falcon · fernandoruiz
Params61M
Context512
Smallest0.0 GB
GGUF
MI
Mistral Nemo Instruct 2407
Mistral · fernandoruiz
Params12.2B
Context1000K
Smallest7.1 GB
GGUF
BI
Bio Medical 3B CoT 012025 Q4 0
Bio · fernandoruiz
Params3.09B
Context32K
Smallest1.8 GB
GGUF
IN
InternVL3 8B
Internvl · fernandoruiz
Params7.61B
Context32K
Smallest4.4 GB
CodingTool useVision
OP
OpenELM 1_1B Instruct
Openelm · fernandoruiz
Params1.08B
Context2K
Q4_K_M0.7 GB
GGUF
AQ
Aquif 3.5 A0.6B Preview
Aquif · fernandoruiz
Params2.61B
Context4K
Smallest1.5 GB
GGUF
AP
Apollo2 2B
Apollo · fernandoruiz
Params2.61B
Context8K
Smallest1.6 GB
GGUF
SA
salamandraTA 2b Instruct
Salamandrata · fernandoruiz
Params2.25B
Context8K
Smallest1.4 GB
GGUF
GR
Granite 3.1 3b A800M Instruct
Granite · fernandoruiz
Params3.3B
Context128K
Smallest1.9 GB
Tool use
OL
Summary_Olmoe_Conventional_Full
OLMo · fernandoruiz
Params6.92B
Context4K
Smallest3.9 GB
GGUF
LL
Llama 3.2 3B Instruct
Llama · fernandoruiz
Params3.21B
Context128K
Smallest1.9 GB
Tool use
PH
Phi 3.5 Mini Instruct
Phi · fernandoruiz
Params3.82B
Context128K
Smallest2.2 GB
Coding
BL
Bloom 560m
Bloom · fernandoruiz
Params816M
Context1K
Smallest0.5 GB
Coding
IN
InternVL3 8B Instruct
Internvl · fernandoruiz
Params7.61B
Context32K
Smallest4.4 GB
CodingTool useVision
LL
Llama 3 Physician 8B Instruct
Llama · fernandoruiz
Params8.03B
Context8K
Smallest4.7 GB
GGUF
OP
OpenELM 3B Instruct
Openelm · fernandoruiz
Params3.04B
Context2K
Smallest1.7 GB
GGUF
FL
Flan T5 Small
Flan · fernandoruiz
Params77M
Context512
Smallest0.0 GB
Coding

Keep browsing