Qwen3.6-27B-FP8 on One RTX 6000 Ada: Fast TTFT, 668 tok/s Peak Throughput [Benchmark]
HexGrid.cloud
Command Palette
Search for a command to run...
Archive
7 posts published so far
Gemma-4 31B + vLLM on RTX 6000 PRO : 1.17k tokens/sec and still asking for more
HexGrid.cloud
Gemma-4 31B it, is Now Available on HexGrid.cloud
HexGrid.cloud
NVIDIA Nemotron 3 Nano 30B-A3B is Now Available on HexGrid.cloud
HexGrid.cloud
Deploy Gemma 4 31B-it in One Click: 4-bit, 8-bit, 16-bit Production API
HexGrid.cloud
Deploy Llama-3.3 70B in One Click: 4-bit, 8-bit, 16-bit Production API
HexGrid.cloud
Deploy Qwen 3.5 27B in One Click: 4-bit, 8-bit, 16-bit Production API
HexGrid.cloud