Skip to content

Metrics

Defined in: src/models/streaming.ts:535

Performance metrics for a model invocation.

latencyMs: number;

Defined in: src/models/streaming.ts:539

Latency in milliseconds.


timeToFirstByteMs?: number;

Defined in: src/models/streaming.ts:545

Time to first byte in milliseconds. Latency from sending the model request to receiving the first content chunk.