AI agents
Which AI model is right for your contact center
The model is the part of an AI agent that understands the customer's question and writes the answer. It determines how many inquiries AI resolves without an agent, whether a customer hangs up over a pause, and what each conversation costs. We connect cloud models and open models that we deploy on your servers, some of them free, and we choose based on how a model answers your customers' real questions: accuracy, speed, and cost. If a better model comes along, we swap it in without rewriting the agent.
TaskAI consultant in chatssalesLanguageRussian, your terminologykeyDatapersonal data – stays with yourequiredCandidates3 modelsto compareExperience
What we test before choosing a model
Choosing the wrong model costs money: wrong answers, abandoned calls, and unnecessary spending.
Tasks
Different tasks, different models
Contact center tasks vary in complexity, and one powerful model for everything usually means overpaying.
Calls and chats: accuracy and speed matter
A live conversation requires a model that understands your customers' language and your rules well and answers without delay. On a call, three models work in sequence: the first turns the customer's speech into text, the second – the language model – works out the question and writes the answer, and the third reads it out loud. We choose each one separately: for example, speech recognition runs on-premises and speech synthesis in the cloud. The higher the accuracy, the more conversations AI handles to the end without transferring to an employee.
- Accurate answers
- No pauses on calls
- Recognition and synthesis chosen separately
1. Recognitioncustomer speech to textyour server2. Languageunderstands and repliescloud3. Voicespoken replycloudPauseunnoticeable to customerverifiedHelping employees: fast and inexpensive
A suggested reply during a call and a summary afterward are simpler than a live conversation, so a lighter model works here: it responds faster and costs less. Employees search less and type less by hand, and fit more conversations into a shift.
- Suggested replies during calls
- Conversation summary
- A lighter model
Suggestionon the calllighter modelSummaryafter the calllighter modelQualityon the same referencesverifiedStaffmore conversationsthis shiftAnalytics: volume matters more than speed
Call quality review and inquiry topic detection process thousands of conversations, but they don't need instant answers. These tasks are cost-effective on your own GPU server: there are no per-minute charges, so you can review every conversation, even after hours.
- Thousands of conversations
- No per-minute bill
- Overnight, while the lines are quiet
Callsall 4,120 of the dayfor reviewModelopen-source, on serverownTime10:00 PM to 6:00 AMline freePaymentno per-minute fee$0Different AI agents on the platform can run on different models at the same time.
Hosting
Where the model runs
Cloud
The model runs in the provider's cloud – no hardware needed
The model's answers reach the AI agent over the internet, so you don't need to buy a server. Only what's needed for the answer leaves your system: the text of the conversation and the selected information, and personal data can be masked before sending. When data must be processed in a specific country, we choose providers that process it there.
- No server of your own
- Providers in the country you need
- Pay by volume
ProviderRussian or foreignyour choiceServernot neededcloudSent outquestion and KB excerptsno desk phonesPaymentusage-basedprice listOn-premises
An open model in your server room
We install an open model on a GPU server; sometimes spare capacity on the analytics server is enough. Conversations are processed inside your company, and there's no per-minute charge – the only cost is hardware.
- Data stays in-house
- No per-minute bill
- Requires a GPU
Serverwith a GPUyour networkCallsnever leave the companyinsidePer-minute feesnone$0Costshardware onlyyoursSwitching models
The model changes, the AI agent stays
When a better or cheaper model comes out, we connect it in place of the old one and test it on the same reference answers. The knowledge base doesn't change, and if the new model answers differently, we adjust the instructions. This way you cut costs without rewriting the whole agent, and you can start in the cloud and move on-premises later.
- Checked against reference answers
- Same knowledge base
- Start in the cloud, move in-house later
Beforecloud modelchatsAfteropen model on your servercheaperReviewsame 312 samplespassedAI agentsame instructions and KBno reworkLaunch
How we choose a model
- 01RequirementsWe find out which data may leave your systems and what AI needs to do.
- 02SamplesWe collect customer questions with answers checked by your expert.
- 03CandidatesWe shortlist two or three models that fit the language, task, and budget.
- 04ComparisonWe compare accuracy, speed, and cost for all candidates on the same list.
- 05ConnectionWe launch the chosen model and review conversations with your team for the first few days.
- 06ReviewWhen new models or updates come out, we run the comparison again.
Requirements
What the model needs
- Cloud model
- Internet access, billed by volume
- Your own model
- A GPU server on-premises
- Voice
- Speech-to-text and text-to-speech – cloud or yours
- Samples
- A list of questions with correct answers from an expert
- Cost of your own model
- Only the server; minutes are free
- Selection and comparison
- From your support hours
Preparation
Decisions to make before choosing
Q&A
Frequently asked questions
Which model is best?
There's no universal answer: one is stronger at reasoning, another is faster and cheaper, a third writes better in your customers' language. That's why we compare candidates on your questions and choose by the numbers.
Can we avoid third-party cloud models altogether?
You can run open models on your own hardware. We test their quality the same way we test any other model.
How well do models understand our customers' language?
Modern models are fluent, but they differ in how they handle your terminology and your customers' conversational speech. That's exactly what we test on the samples.
Are free models worse than paid ones?
Not always. For suggested replies, summaries, and call review, free open models often do just as well, while a complex customer conversation may need a paid one.
What exactly does a cloud model receive?
The text of the turns needed for the answer and the selected knowledge base articles, plus the audio if speech recognition runs in the cloud. Phone numbers and ID details are masked, and for full isolation, the model runs on your servers.
What if the cloud model provider goes down?
The AI agent switches to a backup model that's been tested on your question set in advance, and the customer keeps talking without noticing anything.
Is the cloud cheaper than our own server, or the other way around?
It depends on your tasks and data requirements. We calculate both options for your case: the cloud by volume, your own server by hardware cost.
How do we check that the model pays off?
Look at how three metrics change: the share of inquiries AI resolved without an employee, the share of abandoned calls, and the average cost of an AI conversation.
What hardware do we need to run a model ourselves?
You need a GPU. The platform's analytics server often works too, if it isn't fully loaded – we check this during selection.
Can we change the model later?
Any time, with no need to rewrite the agent. We first check the new model against reference answers and adjust the instructions if needed.
Do we need to fine-tune the model for our company?
Usually not: the AI agent does fine with instructions and your knowledge base. We save fine-tuning for a narrow subject area or a distinctive speaking style.
Who chooses the model?
We make a recommendation based on the comparison and show you the numbers; the decision is yours.
How much does model selection cost?
Comparison and connection are billed in support hours, with no licenses. Cloud models are billed by volume.
Glossary
Terms on this page
- Cloud deployment (cloud)
- The platform runs on the vendor's servers, and agents connect over the internet. Learn more →
- On-premises deployment
- The system runs on the company's own servers, not in the vendor's cloud. Learn more →
- Knowledge base
- All answers, policies, and prices in one place – for agents and AI. Learn more →
- Abandonment rate
- How many callers hang up before an agent answers. Learn more →
- Speech-to-text
- Turns spoken conversation into text. Learn more →
- Personal data
- Anything that points to a specific person: a name, a number, a voice. Learn more →
- Text-to-speech
- Reads text aloud in a human-like voice. Learn more →
- Model fine-tuning
- An existing model is trained further on company materials so it speaks the company's language. Learn more →
- Large language model (LLM)
- A neural network that understands questions asked in everyday words and answers the same way. Learn more →
- Hosting
- You rent a server from a provider instead of buying one. Learn more →
- Backup
- Data is regularly copied to a separate place so it can be restored if something goes wrong. Learn more →
Updated: