Skip to content

BedrockModelOptions

Defined in: src/models/bedrock.ts:271

Options for creating a BedrockModel instance.

optional maxTokens?: number;

Defined in: src/models/bedrock.ts:199

Maximum number of tokens to generate in the response.

https://docs.aws.amazon.com/bedrock/latest/APIReference/API_runtime_InferenceConfiguration.html

BedrockModelConfig.maxTokens


optional temperature?: number;

Defined in: src/models/bedrock.ts:206

Controls randomness in generation.

https://docs.aws.amazon.com/bedrock/latest/APIReference/API_runtime_InferenceConfiguration.html

BedrockModelConfig.temperature


optional topP?: number;

Defined in: src/models/bedrock.ts:213

Controls diversity via nucleus sampling.

https://docs.aws.amazon.com/bedrock/latest/APIReference/API_runtime_InferenceConfiguration.html

BedrockModelConfig.topP


optional stopSequences?: string[];

Defined in: src/models/bedrock.ts:218

Array of sequences that will stop generation when encountered.

BedrockModelConfig.stopSequences


optional cacheConfig?: CacheConfig;

Defined in: src/models/bedrock.ts:225

Configuration for prompt caching.

https://docs.aws.amazon.com/bedrock/latest/userguide/prompt-caching.html

BedrockModelConfig.cacheConfig


optional additionalRequestFields?: JSONValue;

Defined in: src/models/bedrock.ts:230

Additional fields to include in the Bedrock request.

BedrockModelConfig.additionalRequestFields


optional additionalResponseFieldPaths?: string[];

Defined in: src/models/bedrock.ts:235

Additional response field paths to extract from the Bedrock response.

BedrockModelConfig.additionalResponseFieldPaths


optional additionalArgs?: JSONValue;

Defined in: src/models/bedrock.ts:241

Additional arguments to pass through to the Bedrock Converse API.

https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/client/bedrock-runtime/command/ConverseStreamCommand/

BedrockModelConfig.additionalArgs


optional stream?: boolean;

Defined in: src/models/bedrock.ts:251

Whether or not to stream responses from the model.

This will use the ConverseStream API instead of the Converse API.

BedrockModelConfig.stream


optional includeToolResultStatus?: boolean | "auto";

Defined in: src/models/bedrock.ts:259

Flag to include status field in tool results.

  • true: Always include status field
  • false: Never include status field
  • 'auto': Automatically determine based on model ID (default)

BedrockModelConfig.includeToolResultStatus


optional guardrailConfig?: BedrockGuardrailConfig;

Defined in: src/models/bedrock.ts:265

Guardrail configuration for content filtering and safety controls.

https://docs.aws.amazon.com/bedrock/latest/userguide/guardrails.html

BedrockModelConfig.guardrailConfig


optional region?: string;

Defined in: src/models/bedrock.ts:275

AWS region to use for the Bedrock service.


optional clientConfig?: BedrockRuntimeClientConfig;

Defined in: src/models/bedrock.ts:280

Configuration for the Bedrock Runtime client.


optional apiKey?: string;

Defined in: src/models/bedrock.ts:287

Amazon Bedrock API key for bearer token authentication. When provided, requests use the API key instead of SigV4 signing.

https://docs.aws.amazon.com/bedrock/latest/userguide/api-keys.html


optional modelId?: string;

Defined in: src/models/model.ts:72

The model identifier. This typically specifies which model to use from the provider’s catalog.

BedrockModelConfig.modelId