GGUF models by Mathieu-Thomas-JOSSET

75 GGUF models quantized by Mathieu-Thomas-JOSSET on Hugging Face. Sizes run from 596M to 23.6B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
PH
phi4 finetune finetome 20260211 100630 best trainloss step03900 gguf q4 k m
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
QW
qwen2.5 3b instruct text gguf 20260120 111441
Qwen · Mathieu-Thomas-JOSSET
Params3.09B
Context32K
Smallest3.3 GB
GGUF
PH
phi4 finetune finetome 20260210 111305 best trainloss step01800 gguf q4 k m
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
QW
qwen2.5 1.5b instruct text gguf 20260123 114150
Qwen · Mathieu-Thomas-JOSSET
Params1.54B
Context32K
Smallest1.6 GB
Tool use
PH
phi4 finetune finetome 20260210 052937 best trainloss step00900 gguf q4 k m
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
QW
qwen2.5 3b instruct text gguf 20260121 021519
Qwen · Mathieu-Thomas-JOSSET
Params3.09B
Context32K
Smallest3.3 GB
Tool use
PH
joke finetome model gguf phi4 20260106 220520
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
phi4 finetune finetome 20260210 111305 best evalloss step00250 gguf q4 k m
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
phi4 finetune finetome 20260210 042638 gguf q4 k m
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
phi4 finetune finetome 20260211 100630 best evalloss step00650 gguf q4 k m
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
GE
Gemma 3 Finetune
Gemma · Mathieu-Thomas-JOSSET
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
QW
qwen2.5 3b instruct text gguf 20260120 095909
Qwen · Mathieu-Thomas-JOSSET
Params3.09B
Context32K
Smallest3.3 GB
GGUF
PH
joke finetome model gguf phi4 20260107 021924
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
JO
joke finetome model
Joke · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
GE
gemma 3n text gguf2
Gemma · Mathieu-Thomas-JOSSET
Params4.46B
Context32K
Smallest4.8 GB
Vision
PH
joke finetome model gguf phi4 20260106 130529
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
joke finetome model gguf phi4 20260106 054747
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
QW
Qwen2_5_7B_Instruct_zyptilium78_gguf_unsloth
Qwen · Mathieu-Thomas-JOSSET
Params7.61B
Context32K
Q4_K_M4.7 GB
Tool use
QW
qwen2.5 3b instruct text gguf 20260123 140039
Qwen · Mathieu-Thomas-JOSSET
Params3.09B
Context32K
Smallest3.3 GB
Tool use
JO
joke finetome model gguf 20260105 062407
Joke · Mathieu-Thomas-JOSSET
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
QW
qwen2.5 3b instruct text gguf 20260128 045455
Qwen · Mathieu-Thomas-JOSSET
Params3.09B
Context32K
Smallest3.3 GB
Tool use
QW
Qwen2.5 3b Instruct Text Merged 16bit 20260120_095909
Qwen · Mathieu-Thomas-JOSSET
Params3.09B
Context32K
Smallest3.3 GB
GGUF
JO
joke finetome model gguf 20260105 035838
Joke · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
LL
LLMIKE_20260311_193042
Llmike · Mathieu-Thomas-JOSSET
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
MI
Mike_2E 6_E10_20260220_072336
Mike · Mathieu-Thomas-JOSSET
Params3.21B
Context128K
Smallest3.4 GB
GGUF
QW
qwen2.5 3b instruct text gguf 20260125 063715
Qwen · Mathieu-Thomas-JOSSET
Params3.09B
Context32K
Smallest3.3 GB
Tool use
QW
qwen2.5 3b instruct text gguf 20260123 133719
Qwen · Mathieu-Thomas-JOSSET
Params3.09B
Context32K
Smallest3.3 GB
Tool use
GE
Gemma 3 Finetune
Gemma · Mathieu-Thomas-JOSSET
Params3.88B
Context128K
Smallest4.1 GB
GGUF
JO
joke finetome model 20260105 030853
Joke · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
phi4 finetune finetome 20260210 052937 best evalloss step00950 gguf q4 k m
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF

Keep browsing