Provider route settings reference

A provider route is one way Oda can reach a model provider: an address, a credential and a set of limits. You manage routes in Settings > Models, and this page is the reference for the settings each route carries. To add a provider or refresh its model list, see Set up models and providers.

What a route carries

A route holds everything Oda needs to call one provider:

A change to a route's settings needs no restart. New values apply from the next request, and a request already running keeps the settings it started with.

Request settings

SettingWhat it controlsDefault
CredentialThe name Oda reads your key from. The key itself is stored on the Models page, and Oda also reads the same name from the environment it was started from.The provider's own variable name
Base addressWhere the route sends its requests.The provider's public address
ThinkingWhether the route may think before it answers.On
Reasoning effortHow much thinking the model may use.High
Max tokensThe most a reply may contain. A model in the route's list can carry its own cap.256,000
Context windowThe window Oda measures the route's requests against.1,000,000 tokens
Stream idle timeoutHow long Oda waits for activity on a streaming reply before it stops waiting.Five minutes
Retry policyHow Oda retries failed calls to this route.Normal mode, up to five retries

Model retries and billing covers the retry modes and their cost.

Reasoning and thinking

Thinking is on by default. Where the route offers reasoning, the choices read:

High is the default. In a chat, make this choice with the Effort control (Chat with Oda).

With thinking off, the route offers only Off, and a settings document that names a higher effort is refused. Oda's automatic chat titles are generated without thinking, whatever the route says.

File and image settings

SettingWhat it controlsDefault
Request file limitThe total size of files one request may carry.128 MiB
Inline image limitThe total size of images kept in the request itself.20 MiB
Images per requestThe most images one request may carry.600
Offload step sizesHow much Oda sets aside at a time when a request goes over its image budgets.64 MiB, 10 MiB and 20 images
File lifetimeHow long an image Oda uploads for the route stays usable.Seven days
Refresh marginHow much lifetime must remain before Oda uploads a fresh copy.One hour
Cleanup batchHow many of Oda's own oldest uploads it removes when the provider reports its storage is full.100

When a request goes over these limits, Oda sets aside the oldest images first; the full behaviour is in Image and file limits in requests.

The route's models

The route Oda ships with lists two models:

Both carry a 1,000,000-token context. A model id the list does not name can still be used; Oda sends it as a text-only model. The list decides what the pickers offer, not what a request may name.

Which request styles a route can serve

Oda can serve three request styles: the common chat style, a response-object style, and a typed-message style in which content travels as blocks.

What Oda checks when you save

Oda validates a route's values before it saves the document, so a refused save leaves the route as it was. The checks that most often refuse a save:

Questions, answered

Does a settings change need a restart?

No. New values apply from the next request, and a request already running keeps the settings it started with.

Why was my setting refused when I saved?

Oda checks each value before it saves; when one fails, nothing is written. The common refusals: a file lifetime outside 1 hour to 30 days or not a whole number; a refresh margin that is negative or not below the lifetime; a timeout that is not a positive, finite number; an offload step larger than its limit; a higher reasoning effort with thinking off; and a setting this version no longer supports.

Which file lifetimes can I set?

A whole number of seconds from 3600 to 2592000: 1 hour to 30 days. Seven days is the default.

What does the refresh margin do?

It keeps an uploaded image from expiring mid-use. When the remaining lifetime drops to the margin, one hour by default, Oda uploads a fresh copy and uses that instead. The margin must be zero or more and below the file lifetime.

What does thinking off do to the reasoning choices?

The route offers only Off. The other choices disappear, and a settings document that names a higher effort is refused. Turn thinking back on to offer the full set again.

What do Off, Low, High and Max mean?

They set how much the model may think before it answers: Off "Use for simple tasks that do not need reasoning."; Low "Prefer for routine or latency-sensitive tasks."; High "The default balance for most tasks."; Max "Reserve for the hardest quality-first tasks." High is the default.

Can I change the request style of a route?

Not on the route Oda ships with: its style is fixed, and a settings document that tries to set one is refused. A route you add names one of the three styles Oda can serve.

Can I use a model id that is not in the route's list?

On the route Oda ships with, yes. Oda sends a model the list does not describe as a text-only model. The list decides what the pickers offer, not what a request may name.

Which models does the route offer out of the box?

Two: a fast model that takes text and images, and a stronger text-only model, both with a 1,000,000-token context.

Do two routes share these settings?

No. Each route keeps its own settings, so two routes can carry different limits, thinking defaults and retry policies.