InferWeave
Play
Send a prompt to a model through the gateway and stream the response, with cancellation. Fixture metadata until a live gateway surface exists; degrades to a clear unsupported state when no key is present.
Fixture data (no live gateway yet).
Transcript
- inferweave/demo-7b on fp-h100-7b-a — complete · in 12 tok, out 64 tok, ttft 120 ms, queue 5 ms, finished stop
- inferweave/demo-7b on fp-h100-7b-a — cancelled · in 9 tok, out 18 tok, ttft 130 ms, queue 4 ms — stopped before finishing (partial output, not a complete answer)
- inferweave/demo-7b on fp-h100-7b-a — streaming · in 21 tok, out 40 tok, ttft 110 ms, queue 6 ms