Shihan Qu

zenmagnets's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in Qwen/Qwen3.5-397B-A17B 29 days ago

Qwen3.6 397b

3

#75 opened 2 months ago by

zenmagnets

New activity in mmangkad/Qwen3.6-27B-NVFP4 2 months ago

31gb NVFP4 Model?

4

#1 opened 2 months ago by

zenmagnets

New activity in MiniMaxAI/MiniMax-M2.7 2 months ago

license

👀👍 9

16

#5 opened 2 months ago by

festr2

New activity in varjosoft/GLM-5.1-Open-TQ3 2 months ago

Pending GPU & vLLM validation

3

#1 opened 3 months ago by

nwzjk

New activity in MiniMaxAI/MiniMax-M2.7 2 months ago

No commercial use allowed in License?

👀😔 4

10

#6 opened 2 months ago by

zenmagnets

New activity in lukealonso/Qwen3.5-397B-A17B-NVFP4 4 months ago

How to run on vLLM for 4xSM120

#1 opened 4 months ago by

zenmagnets

New activity in lukealonso/MiniMax-M2.5-NVFP4 4 months ago

Here's the vLLM recipe I'm using with 2x RTX Pro 6000

👍 3

17

#1 opened 4 months ago by

zenmagnets

New activity in Ex0bit/Kimi-K2.5-PRISM-REAP-530B-A32B 4 months ago

Anyone get this working on 4x RTX 6000 Pro?

👀 2

5

#1 opened 4 months ago by

zenmagnets

New activity in GadflyII/MiniMax-M2.1-NVFP4 4 months ago

Throughput NVFP4 on Dual 6000 Blackwells

#2 opened 4 months ago by

zenmagnets

New activity in vincentzed-hf/Qwen3.5-397B-A17B-NVFP4 4 months ago

Anyone try this on 4x RTX 6000 Pro yet?

52

#1 opened 4 months ago by

zenmagnets

New activity in mlx-community/Qwen3.5-397B-A17B-nvfp4 4 months ago

I wish it would fit in 2x6000 PRO!

1

#2 opened 4 months ago by

mtcl

New activity in lukealonso/MiniMax-M2.5-NVFP4 4 months ago

"w1_weight_scale_2 must match w3_weight_scale_2. Accuracy may be affected."

👍 1

21

#2 opened 4 months ago by

zenmagnets

New activity in GadflyII/GLM-4.7-Flash-NVFP4 5 months ago

Wasn't able to recreate MMLU-Pro benchmarks

5

#5 opened 5 months ago by

zenmagnets

New activity in zai-org/GLM-4.7-Flash 5 months ago

Enormous KV-cache size?

👍➕ 6

23

#3 opened 5 months ago by

nephepritou

New activity in GadflyII/GLM-4.7-Flash-NVFP4 5 months ago

Really appreciate that you ran performance comparison tests with BF16!

3

#2 opened 5 months ago by

zenmagnets

New activity in marksverdhei/GLM-4.7-Flash-FP8 5 months ago

Performance comps with BF16?

1

#3 opened 5 months ago by

zenmagnets

New activity in cyankiwi/GLM-4.7-Flash-AWQ-4bit 5 months ago

Any plans for a 6bit or 8bit version?

1

#3 opened 5 months ago by

zenmagnets

New activity in marksverdhei/GLM-4.7-Flash-FP8 5 months ago

If 8bit, why shaped like 16 bit

2

#2 opened 5 months ago by

zenmagnets

New activity in nvidia/Qwen3-30B-A3B-NVFP4 7 months ago

6 months since intro of NVFP4, and it's basically still a myth

1

#4 opened 7 months ago by

zenmagnets

New activity in RESMP-DEV/Qwen3-Next-80B-A3B-Instruct-NVFP4 7 months ago

Works with vllm? Any recommendations or howtos?

7

#1 opened 8 months ago by

DrRos