LLM Inference Benchmark Explorer

Qwen3.6-27B on 1× DGX Spark — FP8, vLLM, TP1, speculative decoding inference benchmark

Open this configuration in the LLM Inference Benchmark Explorer

ModelQwen3.6-27B
Parameters27B
Intelligence Index21.4
Agentic Index18.5
Device1× DGX Spark
QuantizationFP8
Max C2
Chat Capacity8
Agentic Capacity3
TP—
DP—
PP—
EnginevLLM
Speculative DecodingYes
CTTFT (ms)TPS (tok/s)Status
132320.24PASS
251621.34PASS
453119.90FAIL
862117.87FAIL
1681315.00FAIL

In this measurement, Qwen3.6-27B (27B parameters), served in FP8 format with vLLM and speculative decoding on 1× DGX Spark, reached a generation speed of 20.2 tok/s per request and a time to first token (TTFT) of 323 ms with a single request.

Considering the speed targets and the available KV cache capacity, the estimated capacity is 8 users for chat use and 3 for agentic use. The realistic capacity will likely fall between these two values. In scenarios dominated by coding, tool use, long workflows and multi-agent use, capacity approaches the agentic estimate; where shorter interactions, standard conversations and lighter tasks dominate, it approaches the chat estimate.

Notes: MTP gives 2.4x TPS improvement

Intelligence Index and Agentic Index values are published by Artificial Analysis and are reproduced here with attribution.