GGUF models by fernandoruiz
94 GGUF models quantized by fernandoruiz on Hugging Face. Sizes run from 11M to 46.7B parameters. The longest trained context is 1000K tokens.
OL
OLMoE 1B 7B 0125 Instruct Q4 0
OLMo · fernandoruiz
Params6.92B
Context4K
Smallest3.9 GB
SA
Salamandra 2b Instruct
Salamandra · fernandoruiz
Params2.25B
Context8K
Smallest1.4 GB
QW
Qwen3 30B A1.5B High Speed
Qwen · fernandoruiz
Params30.5B
Context40K
Smallest17.3 GB
EU
EuroLLM 22B Instruct Preview
Eurollm · fernandoruiz
Params22.6B
Context4K
Smallest12.9 GB
QW
Qwen3 30B A3B Abliterated
Qwen · fernandoruiz
Params30.5B
Context40K
Smallest17.3 GB
QW
Qwen3 0.6B Abliterated
Qwen · fernandoruiz
Params596M
Context40K
Smallest0.4 GB
LI
Ling Lite
Ling · fernandoruiz
Params16.8B
Context32K
Smallest9.5 GB
QW
PARD Qwen2.5 0.5B
Qwen · fernandoruiz
Params630M
Context32K
Smallest0.4 GB
AL
ALIA 40b
Alia · fernandoruiz
Params40.4B
Context4K
Smallest23.3 GB
PH
Phi 3 medium 4k instruct Q4 K S
Phi · fernandoruiz
Params14B
Context4K
Smallest8.0 GB
LL
Llama 3.1 8B Instruct
Llama · fernandoruiz
Params8.03B
Context128K
Smallest4.7 GB
GR
GroveMoE Inst
Grovemoe · fernandoruiz
Params32.9B
Context40K
Smallest18.7 GB
LL
Llama 3.2 1B Instruct
Llama · fernandoruiz
Params1.24B
Context128K
Smallest0.8 GB
GE
Gemma 2 27b It
Gemma · fernandoruiz
Params27.2B
Context8K
Smallest15.6 GB
MI
MiniCPM4 8B
MiniCPM · fernandoruiz
Params8.19B
Context32K
Smallest4.7 GB
SA
salamandraTA 7b Instruct
Salamandrata · fernandoruiz
Params7.77B
Context8K
Smallest4.6 GB
QW
Biomed Qwen2 VL 2B Instruct
Qwen · fernandoruiz
Params1.78B
Context32K
Smallest1.1 GB
QW
PARD Qwen3 0.6B
Qwen · fernandoruiz
Params752M
Context40K
Smallest0.5 GB
MI
Mixtral 8x7B Instruct v0.1
Mistral · fernandoruiz
Params46.7B
Context32K
Smallest26.4 GB
OL
OLMoE 1B 7B 0125 Q4 0
OLMo · fernandoruiz
Params6.92B
Context4K
Smallest3.9 GB
PH
Phi 3 medium 4k instruct Q4 K M
Phi · fernandoruiz
Params14B
Context4K
Q4_K_M8.6 GB
MI
Mistral Small 3.1 24B Instruct 2503
Mistral · fernandoruiz
Params23.6B
Context128K
Smallest13.4 GB
SA
salamandraTA 2B
Salamandrata · fernandoruiz
Params2.25B
Context8K
Smallest1.4 GB
FA
Text_Summarization
Falcon · fernandoruiz
Params61M
Context512
Smallest0.0 GB
IN
InternVL3 2B
Internvl · fernandoruiz
Params1.78B
Context32K
Smallest1.1 GB
PO
PowerMoE 3b
Powermoe · fernandoruiz
Params3.37B
Context4K
Smallest1.9 GB
OP
OpenELM 3B Instruct
Openelm · fernandoruiz
Params3.04B
Context2K
Q4_K_M1.9 GB
GE
Gemma 2 9b It
Gemma · fernandoruiz
Params9.24B
Context8K
Smallest5.4 GB
GE
Gemma 2 9b Medical
Gemma · fernandoruiz
Params9.24B
Context8K
Q4_K_M5.8 GB
BL
Bloom 560m
Bloom · fernandoruiz
Params816M
Context1K
Smallest0.5 GB