GGUF models by fernandoruiz
94 GGUF models quantized by fernandoruiz on Hugging Face. Sizes run from 11M to 46.7B parameters. The longest trained context is 1000K tokens.
LL
PARD Llama 3.2 1B
Llama · fernandoruiz
Params1.5B
Context128K
Smallest0.9 GB
TE
teapotllm Q4 0
Teapotllm · fernandoruiz
Params783M
Context512
Smallest0.5 GB
PH
Phi 3 mini 4k instruct Q4 K S
Phi · fernandoruiz
Params3.82B
Context4K
Smallest2.2 GB
BI
BiMediX Eng Q4 0
Bimedix · fernandoruiz
Params46.7B
Context32K
Smallest26.4 GB
OL
OLMo 2 0325 32B Instruct Q4 0
OLMo · fernandoruiz
Params32.2B
Context4K
Smallest18.3 GB
QW
Qwen3 0.6B
Qwen · fernandoruiz
Params752M
Context40K
Smallest0.5 GB
IN
InternVL3 14B
Internvl · fernandoruiz
Params14.8B
Context32K
Smallest8.5 GB
GE
Gemma 2 2b It
Gemma · fernandoruiz
Params2.61B
Context8K
Smallest1.6 GB
SU
SummLlama3.2 3B
Summllama · fernandoruiz
Params3.21B
Context128K
Smallest1.9 GB
OL
OLMoE-1B-7B-0125-Instruct-enron
OLMo · fernandoruiz
Params6.92B
Context4K
Smallest3.9 GB
MI
Mistral Small 3.1 24B Instruct 2503 HF
Mistral · fernandoruiz
Params23.6B
Context128K
Smallest13.4 GB
OL
translation olmoe conventional full Q4 0
OLMo · fernandoruiz
Params6.92B
Context4K
Smallest3.9 GB
OP
OpenELM 1_1B Instruct
Openelm · fernandoruiz
Params1.08B
Context2K
Smallest0.6 GB
FA
Medical_Summarization
Falcon · fernandoruiz
Params61M
Context512
Smallest0.0 GB
MI
Mistral Nemo Instruct 2407
Mistral · fernandoruiz
Params12.2B
Context1000K
Smallest7.1 GB
BI
Bio Medical 3B CoT 012025 Q4 0
Bio · fernandoruiz
Params3.09B
Context32K
Smallest1.8 GB
IN
InternVL3 8B
Internvl · fernandoruiz
Params7.61B
Context32K
Smallest4.4 GB
OP
OpenELM 1_1B Instruct
Openelm · fernandoruiz
Params1.08B
Context2K
Q4_K_M0.7 GB
AQ
Aquif 3.5 A0.6B Preview
Aquif · fernandoruiz
Params2.61B
Context4K
Smallest1.5 GB
AP
Apollo2 2B
Apollo · fernandoruiz
Params2.61B
Context8K
Smallest1.6 GB
SA
salamandraTA 2b Instruct
Salamandrata · fernandoruiz
Params2.25B
Context8K
Smallest1.4 GB
GR
Granite 3.1 3b A800M Instruct
Granite · fernandoruiz
Params3.3B
Context128K
Smallest1.9 GB
OL
Summary_Olmoe_Conventional_Full
OLMo · fernandoruiz
Params6.92B
Context4K
Smallest3.9 GB
LL
Llama 3.2 3B Instruct
Llama · fernandoruiz
Params3.21B
Context128K
Smallest1.9 GB
PH
Phi 3.5 Mini Instruct
Phi · fernandoruiz
Params3.82B
Context128K
Smallest2.2 GB
BL
Bloom 560m
Bloom · fernandoruiz
Params816M
Context1K
Smallest0.5 GB
IN
InternVL3 8B Instruct
Internvl · fernandoruiz
Params7.61B
Context32K
Smallest4.4 GB
LL
Llama 3 Physician 8B Instruct
Llama · fernandoruiz
Params8.03B
Context8K
Smallest4.7 GB
OP
OpenELM 3B Instruct
Openelm · fernandoruiz
Params3.04B
Context2K
Smallest1.7 GB
FL
Flan T5 Small
Flan · fernandoruiz
Params77M
Context512
Smallest0.0 GB