GGUF models by transitionGap

45 GGUF models quantized by transitionGap on Hugging Face. Sizes run from 362M to 9.24B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
RTIACT IN gemma2 9B smallset
Gemma · transitionGap
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
QW
FARMSUBSIDY IN Qwen2.5 0.5B smallset
Qwen · transitionGap
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
QW
PANCARD IN Qwen2.5 0.5B smallset
Qwen · transitionGap
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
GE
ROAD TRANSPORT IN gemma2 9B smallset
Gemma · transitionGap
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
PANCARD IN gemma2 9B smallset
Gemma · transitionGap
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
LL
PENSION IN Llama3.1 8B smallset
Llama · transitionGap
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
QW
PROPERTYREG IN Qwen2.5 0.5B smallset
Qwen · transitionGap
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
LL
HEALTHINSURANCE IN Llama3.1 8B smallset
Llama · transitionGap
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
RATIONCARD IN Llama3.1 8B smallset
Llama · transitionGap
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
QW
BIRTHCERT IN Qwen2.5 0.5B smallset
Qwen · transitionGap
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
QW
ROAD TRANSPORT IN Qwen2.5 0.5B smallset
Qwen · transitionGap
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
LL
MARRAIGELAW IN Llama3.1 8B smallset
Llama · transitionGap
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
QW
ADHAR IN Qwen2.5 0.5B smallset
Qwen · transitionGap
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
LL
COURTPROCEDDING IN Llama3.1 8B smallset
Llama · transitionGap
Params8.03B
Context128K
Smallest16.1 GB
Tool use
QW
RERA IN Qwen2.5 0.5B smallset
Qwen · transitionGap
Params494M
Context32K
Q4_K_M0.4 GB
GGUF

Keep browsing