Inference Providers
Active filters: quark
Text Generation
• 0.1B • Updated • 479
• 6
ThingAI/Quark-135m-Bilingual
Text Generation
• 0.2B • Updated • 57
• 3
nameistoken/Qwen3.6-27B-Quark-W8A8-INT8
Image-Text-to-Text
• 27B • Updated • 5.06k
• 4
Text Generation
• 0.3B • Updated • 176
• 2
ThingAI/Quark-270m-Instruct
Text Generation
• 0.3B • Updated • 104
• 2
Text Generation
• 466k • Updated • 1.55k
• 7
Text Generation
• Updated • 1
fxmarty/llama-tiny-testing-quark-indev
1.03M • Updated • 3
fxmarty/llama-tiny-int4-per-group-sym
1.03M • Updated • 2
fxmarty/llama-tiny-w-fp8-a-fp8
1.03M • Updated • 19
fxmarty/llama-tiny-w-fp8-a-fp8-o-fp8
1.03M • Updated • 2
fxmarty/llama-tiny-w-int8-per-tensor
1.03M • Updated • 2
fxmarty/llama-small-int4-per-group-sym-awq
16.7M • Updated • 5
fxmarty/quark-legacy-int8
1.03M • Updated • 4
fxmarty/llama-tiny-w-int8-b-int8-per-tensor
1.03M • Updated • 2
fxmarty/llama-small-int4-per-group-sym-awq-old
16.7M • Updated • 4
amd-quark/llama-tiny-w-int8-per-tensor
1.03M • Updated • 11
amd-quark/llama-tiny-w-int8-b-int8-per-tensor
1.03M • Updated • 34
amd-quark/llama-tiny-w-fp8-a-fp8
1.03M • Updated • 24
amd-quark/llama-tiny-w-fp8-a-fp8-o-fp8
1.03M • Updated • 13
amd-quark/llama-tiny-int4-per-group-sym
1.03M • Updated • 12
amd-quark/llama-small-int4-per-group-sym-awq
16.7M • Updated • 10
amd-quark/quark-legacy-int8
1.03M • Updated • 5
amd/Llama-3.1-8B-Instruct-FP8-KV-Quark-test
8B • Updated • 26.5k
amd/Llama-3.1-8B-Instruct-w-int8-a-int8-sym-test
8B • Updated • 16k
EmbeddedLLM/Llama-3.1-8B-Instruct-w_fp8_per_channel_sym
Text Generation
• 8B • Updated • 2
amd/DeepSeek-R1-Distill-Llama-8B-awq-asym-uint4-g128-lmhead
Text Generation
• 2B • Updated • 5
amd-quark/llama-tiny-fp8-quark-quant-method
17.1M • Updated • 15.7k
aigdat/Qwen2.5-Coder-7B-quantized-ppl-14
1B • Updated • 1