Configure language models

Opening the site takes you to /setup, with two steps at the top: “Create administrator” and “Configure models.”

The “Configure models” page has three cards:

Click “Complete configuration” to enter the project list. Sites already initialized do not enter this wizard again.

Lower-left avatar → “System settings” → “Model groups” on the left.

The title is “Model group management,” the subtitle is “Manage LLM model group configurations in the system,” and “New model group” appears at the upper right. The left column lists model groups, showing each “Display name” (or “Unique identifier” when blank) and Base URL. Badges include “Official” and “Default”; protocols other than OpenAI show their protocol name, such as “Anthropic.” When nothing is selected, the right column says “Select a model group to view details”; when no groups exist, the left column says “No data.”

Click “New model group.” The first step, “Select model group type,” has three cards:

• “AskTable official” — “Use AskTable compute services; only a Compute API Key is required.”
• “OpenAI compatible” — “Connect third-party LLM services with custom configuration.”
• “Anthropic compatible” — “Connect third-party LLM services using the Anthropic protocol.”

The official type requires only “Compute API Key” (placeholder asktable-). Custom types require:

Click “Create”; the button changes to “Creating...” and success shows “Model group created successfully.” The official type automatically sets Base URL to https://aiproxy.asktable.com/v1 and presets the three roles to asktable-fast, asktable-omni, and asktable-agent.

Select a group and use the “Available models” section in the right column:

1. Manual entry: fill in “Model ID (e.g. gpt-4o)” and “Display name (optional),” then click “Add”; a duplicate shows “Model already exists.”
2. Fetch: click “Fetch” to call the upstream model list endpoint and add models not already listed. Newly fetched models are disabled by default.
3. Search and statistics: the search placeholder is “Search models...”; the statistics above read “N models in total, M enabled (enabled models listed first).”

Each row has four controls on the right: a gear for “Model options,” a trash icon for “Remove model,” a lightning icon for “Test model,” and a switch at the far right to enable it. Removing a model also clears role routes that reference it.

Click the inline “Test model” lightning icon. Success shows “Model X passed the test”; failure shows “Model X failed the test.”

Enable only models that pass: dropdowns under “Model routing” list only enabled models.

“Model routing” has three rows named Fast, Omni, and Agent, each with a dropdown. An unselected row shows “Unspecified”; choices are the enabled models.

Changes save immediately; no additional Save click is needed.

Click a model's gear to open the “Model options” dialog, described as “Configure options for X”:

Provider choices for “Thinking parameters” are “Disabled (no override),” “DeepSeek (thinking switch),” “OpenAI (reasoning_effort),” “Qwen / DashScope (enable_thinking),” and “Custom (raw JSON).” Selecting a provider defaults fast mode to the most economical level and deep thinking mode to a stronger level; these can be changed. Selecting “Custom (raw JSON)” gives each mode a JSON text box. Invalid JSON is highlighted in red and is not saved.

The description for “Send historical reasoning content (reasoning_content)” says “Enable for models that continue reasoning, such as DeepSeek V4; disable for models that do not accept this field, such as asktable-fast.”

The “More” menu at the upper right of the right column has two actions:

• “Set as default”: success shows “Set as default model group.” There is only one default group across the site; it is also the fallback when none is specified.
• “Clone model group”: creates a copy with -copy appended to its identifier, including credentials and model configuration.

“Delete” appears only for non-default groups. Its confirmation dialog reads “Are you sure you want to delete model group "X"? This action cannot be undone.” Default groups do not show a Delete button.

Projects follow the system default group by default. To select a specific group, use the left main navigation → “Settings” beside the project name → “General” → “Model group” dropdown. Options are “Default,” “Default (group name),” or a specific group name; the placeholder says “Please select a model group.” When no group is available, the message says “No model groups available. Please contact an administrator to configure models.”