Nebius Token Factory

←Back to Integrations

Community Contribution

This is a community-maintained package that is not owned or supported by the Strands team. Validate and review the package before using it in your project. Have your own integration? Add it to the integrations page!

Nebius Token Factory provides fast inference for open-source language models. Nebius Token Factory is accessible through OpenAI’s SDK via full API compatibility, allowing easy and portable integration with the Strands Agents SDK using the familiar OpenAI interface.

Installation

The Strands Agents SDK provides access to Nebius Token Factory models through the OpenAI compatibility layer, configured as an optional dependency. To install, run:

pip install 'strands-agents[openai]' strands-agents-tools

Usage

After installing the openai package, you can import and initialize the Strands Agents’ OpenAI-compatible provider for Nebius Token Factory models as follows:

import ast
import operator

from strands import Agent, tool
from strands.models.openai import OpenAIModel

@tool
def calculator(expression: str) -> str:
    """Evaluate an arithmetic expression such as "144 ** 0.5" or "450 / 120".

    Args:
        expression: The arithmetic expression to evaluate.
    """
    ops = {ast.Add: operator.add, ast.Sub: operator.sub, ast.Mult: operator.mul,
           ast.Div: operator.truediv, ast.USub: operator.neg}

    def ev(n):
        if isinstance(n, ast.Constant) and isinstance(n.value, (int, float)):
            return n.value
        if isinstance(n, ast.BinOp) and isinstance(n.op, ast.Pow):
            base, exp = ev(n.left), ev(n.right)
            if abs(exp) > 64:
                raise ValueError(f"exponent too large in {expression!r}: {exp}")
            return base**exp
        if isinstance(n, ast.BinOp) and type(n.op) in ops:
            return ops[type(n.op)](ev(n.left), ev(n.right))
        if isinstance(n, ast.UnaryOp) and type(n.op) in ops:
            return ops[type(n.op)](ev(n.operand))
        raise ValueError(
            f"{expression!r} is not arithmetic; supported: + - * / ** and parentheses over numbers"
        )

    return str(ev(ast.parse(expression, mode="eval").body))

model = OpenAIModel(
    client_args={
        "api_key": "<NEBIUS_API_KEY>",
        "base_url": "https://api.tokenfactory.nebius.com/v1/",
    },
    model_id="deepseek-ai/DeepSeek-R1-0528",  # or see https://docs.tokenfactory.nebius.com/ai-models-inference/overview
    params={
        "max_tokens": 5000,
        "temperature": 0.1
    }
)

agent = Agent(model=model, tools=[calculator])
agent("What is 2+2?")

Configuration

Client Configuration

The client_args configure the underlying OpenAI-compatible client. When using Nebius Token Factory, you must set:

• api_key: Your Nebius Token Factory API key. Get one from the Nebius Token Factory Console.
• base_url: https://api.tokenfactory.nebius.com/v1/

Refer to OpenAI Python SDK GitHub for full client options.

Model Configuration

The model_config specifies which Nebius Token Factory model to use and any additional parameters.

Parameter	Description	Example	Options
model_id	Model name	deepseek-ai/DeepSeek-R1-0528	See Nebius Token Factory Models
params	Model-specific parameters	{"max_tokens": 5000, "temperature": 0.7, "top_p": 0.9}	API reference

Troubleshooting

ModuleNotFoundError: No module named 'openai'

You must install the openai dependency to use this provider:

pip install 'strands-agents[openai]'

Unexpected model behavior?

Ensure you’re using a model ID compatible with Nebius Token Factory (e.g., deepseek-ai/DeepSeek-R1-0528, meta-llama/Meta-Llama-3.1-70B-Instruct), and your base_url is set to https://api.tokenfactory.nebius.com/v1/.

References

• Nebius Token Factory Documentation
• Nebius Token Factory API Reference
• Nebius Token Factory Models
• OpenAI Python SDK
• Strands Agents API