GGUF models by professorf

55 GGUF models quantized by professorf on Hugging Face. Sizes run from 135M to 70.6B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · professorf
Params1.78B
Context128K
Smallest1.9 GB
ReasoningTool use
SM
SmolLM 135M
SmolLM · professorf
Params135M
Context2K
Smallest0.1 GB
GGUF
LL
Meta Llama 3 1 8B Instruct
Llama · professorf
Params8.03B
Context128K
Smallest16.1 GB
Tool use
LL
Meta Llama 3 8B Instruct
Llama · professorf
Params8.03B
Context8K
Smallest8.5 GB
GGUF
SM
SmolLM 1.7B Instruct q8 0
SmolLM · professorf
Params1.71B
Context2K
Smallest1.8 GB
GGUF
OL
AMD OLMo 1B
OLMo · professorf
Params1.18B
Context2K
Smallest1.3 GB
GGUF
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · professorf
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
MI
Mistral 7B Instruct v0.3
Mistral · professorf
Params7.25B
Context32K
Smallest7.7 GB
Tool use
LL
Llama 3.2 3B Instruct
Llama · professorf
Params3.21B
Context128K
Smallest6.4 GB
Tool use
LL
Meta Llama 3 8B Instruct 16f
Llama · professorf
Params8.03B
Context8K
Smallest16.1 GB
GGUF
LL
Llama 3.2 1B Instruct f16
Llama · professorf
Params3.21B
Context128K
Smallest6.4 GB
Tool use
SM
SmolLM 1.7B Instruct f16
SmolLM · professorf
Params1.71B
Context2K
Smallest3.4 GB
GGUF
GE
gemma-2-9b
Gemma · professorf
Params9.24B
Context8K
Smallest9.8 GB
GGUF
LL
Llama 3.2 1B Instruct q8 0
Llama · professorf
Params3.21B
Context128K
Smallest3.4 GB
Tool use
OP
OpenELM-3B-Instruct
Openelm · professorf
Params3.04B
Context2K
Smallest6.1 GB
GGUF
LL
Llama 3.2 3B Instruct
Llama · professorf
Params3.21B
Context128K
Smallest3.4 GB
Tool use
SM
SmolLM2 360M Instruct
SmolLM · professorf
Params362M
Context8K
Smallest0.4 GB
GGUF
MI
Mistral Nemo Instruct 2407
Mistral · professorf
Params12.2B
Context1000K
Smallest24.5 GB
Tool use
LL
Meta Llama 3 1 8B Instruct
Llama · professorf
Params8.03B
Context128K
Smallest8.5 GB
Tool use
OL
AMD OLMo 1B SFT
OLMo · professorf
Params1.18B
Context2K
Smallest1.3 GB
GGUF
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · professorf
Params7.62B
Context128K
Smallest8.1 GB
ReasoningTool use
SM
SmolLM2 135M Instruct
SmolLM · professorf
Params135M
Context8K
Smallest0.1 GB
GGUF
MI
Mistral Nemo Instruct 2407
Mistral · professorf
Params12.2B
Context1000K
Smallest13.0 GB
Tool use
MI
Mistral 7B Instruct v0.3
Mistral · professorf
Params7.25B
Context32K
Smallest14.5 GB
Tool use
PH
phi 3 mini 128k q8 0
Phi · professorf
Params3.82B
Context128K
Smallest4.1 GB
GGUF

Keep browsing