Metrics
Defined in: src/models/streaming.ts:525
Performance metrics for a model invocation.
Properties
Section titled “Properties”latencyMs
Section titled “latencyMs”latencyMs: number;Defined in: src/models/streaming.ts:529
Latency in milliseconds.
timeToFirstByteMs?
Section titled “timeToFirstByteMs?”optional timeToFirstByteMs?: number;Defined in: src/models/streaming.ts:535
Time to first byte in milliseconds. Latency from sending the model request to receiving the first content chunk.