System Info

Latest everything, just installed today, and ubuntu 22.04 and another ubuntu, i tried on 2 sistems and is the same. No output!

Reproduction

I tried to use 4bit and 8bit of gemma3 4b and the output is always empty. Fp16 and 32 work properly.

Expected behavior

I tried to use 4bit and 8bit of gemma3 4b and the output is always empty. Fp16 and 32 work properly.