GGUF models by professorf
55 GGUF models quantized by professorf on Hugging Face. Sizes run from 135M to 70.6B parameters. The longest trained context is 1024K tokens.
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · professorf
Params1.78B
Context128K
Smallest1.9 GB
SM
SmolLM 135M
SmolLM · professorf
Params135M
Context2K
Smallest0.1 GB
LL
Meta Llama 3 1 8B Instruct
Llama · professorf
Params8.03B
Context128K
Smallest16.1 GB
LL
Meta Llama 3 8B Instruct
Llama · professorf
Params8.03B
Context8K
Smallest8.5 GB
SM
SmolLM 1.7B Instruct q8 0
SmolLM · professorf
Params1.71B
Context2K
Smallest1.8 GB
OL
AMD OLMo 1B
OLMo · professorf
Params1.18B
Context2K
Smallest1.3 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · professorf
Params8.03B
Context128K
Smallest8.5 GB
MI
Mistral 7B Instruct v0.3
Mistral · professorf
Params7.25B
Context32K
Smallest7.7 GB
LL
Llama 3.2 3B Instruct
Llama · professorf
Params3.21B
Context128K
Smallest6.4 GB
LL
Meta Llama 3 8B Instruct 16f
Llama · professorf
Params8.03B
Context8K
Smallest16.1 GB
LL
Llama 3.2 1B Instruct f16
Llama · professorf
Params3.21B
Context128K
Smallest6.4 GB
SM
SmolLM 1.7B Instruct f16
SmolLM · professorf
Params1.71B
Context2K
Smallest3.4 GB
GE
gemma-2-9b
Gemma · professorf
Params9.24B
Context8K
Smallest9.8 GB
LL
Llama 3.2 1B Instruct q8 0
Llama · professorf
Params3.21B
Context128K
Smallest3.4 GB
OP
OpenELM-3B-Instruct
Openelm · professorf
Params3.04B
Context2K
Smallest6.1 GB
LL
Llama 3.2 3B Instruct
Llama · professorf
Params3.21B
Context128K
Smallest3.4 GB
SM
SmolLM2 360M Instruct
SmolLM · professorf
Params362M
Context8K
Smallest0.4 GB
MI
Mistral Nemo Instruct 2407
Mistral · professorf
Params12.2B
Context1000K
Smallest24.5 GB
LL
Meta Llama 3 1 8B Instruct
Llama · professorf
Params8.03B
Context128K
Smallest8.5 GB
OL
AMD OLMo 1B SFT
OLMo · professorf
Params1.18B
Context2K
Smallest1.3 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · professorf
Params7.62B
Context128K
Smallest8.1 GB
SM
SmolLM2 135M Instruct
SmolLM · professorf
Params135M
Context8K
Smallest0.1 GB
MI
Mistral Nemo Instruct 2407
Mistral · professorf
Params12.2B
Context1000K
Smallest13.0 GB
MI
Mistral 7B Instruct v0.3
Mistral · professorf
Params7.25B
Context32K
Smallest14.5 GB
PH
phi 3 mini 128k q8 0
Phi · professorf
Params3.82B
Context128K
Smallest4.1 GB