Choosing AI Models
Each ToolboxAI tool (Activity Summarizer, Extractor, RecordAI) has its own Provider and Model setting under Settings → Tool Settings, so you can pick a different tradeoff of cost, speed, and capability for each one. There's no single right answer — it depends on how much reasoning that tool actually needs to do.
The general tradeoff
Within both OpenAI's and Anthropic's lineups, ToolboxAI offers a small/fast tier, a mid tier, and a large/most-capable tier:
| Provider | Smallest / cheapest / fastest | Mid-tier | Largest / most capable |
|---|---|---|---|
| OpenAI | GPT-5.4 nano | GPT-5.4 mini | GPT-5.4 |
| Anthropic | Claude Haiku 4.5 | Claude Sonnet 5 | Claude Opus 5 |
As you move from left to right in either row: cost per request goes up, response time gets a little slower, and the model gets meaningfully better at nuanced reasoning, following complex instructions, and handling messy or ambiguous data. Exact pricing changes over time — check OpenAI's pricing page or Anthropic's pricing page for current rates before deciding at scale.
Picking a model per tool
Activity Summarizer — usually a good fit for the smallest tier (GPT-5.4 nano or Claude Haiku 4.5). Summarizing a thread of activities is a fairly bounded task, and it runs often, so cost and speed usually matter more here than squeezing out marginal quality gains.
Extractor — depends on how many fields you're extracting and how well-structured your source data (activities, notes) is. If you're pulling a handful of well-defined fields, the smallest tier is usually enough. If you're asking it to infer fields from noisy, unstructured activity notes, step up to the mid tier for better accuracy.
RecordAI — this is the tool users interact with directly and ask open-ended questions, so it benefits the most from a stronger model. The mid tier (GPT-5.4 mini or Claude Sonnet 5) is a solid default; consider the largest tier if your users are asking complex, multi-step questions or you're seeing RecordAI give shallow or incorrect answers on the mid tier.
Custom models
If you want to use a specific model not listed in the dropdown (a newer release, or a specific dated snapshot), choose Custom model... and enter the exact model identifier (e.g. gpt-5.5-nano) in the field that appears. ToolboxAI will pass that identifier straight through to the provider, so it needs to match the provider's API exactly.
Agentforce
If a tool is set to Agentforce, there's no model tier to choose — the tool's behavior, cost, and speed are determined by however you've built the underlying agent in Agent Builder. See Agentforce Setup for how to connect a tool to an agent.
-- IMAGE --