Modernising a legacy on-prem contact centre with AI is layered, not flipped: the AI is added on top of the existing telephony, CRM, and workforce systems, with integrations that bridge old and new, rather than replacing everything at once. The teams that succeed treat the legacy stack as a real constraint and the AI as a feature that fits into it. The teams that try to rip and replace usually lose the project to scope.

A bank's contact centre runs on a ten-year-old on-prem telephony platform with a CRM nobody loves. The AI vendor proposes a full replatform. The CIO knows this is a multi-year, multi-million project. The honest path is layering: keep the telephony, add the AI in front of it, integrate where possible, replace the underlying systems on a separate, slower timeline.

What people in the field are saying

Verint and similar incumbents argue that AI can be added over existing telephony stacks without rebuilding the underlying contact centre. Newer vendors argue the opposite. Both are partly right; the answer depends on how much technical debt the legacy stack carries.

What can be added without replacement?

AI agent assist for human agents (works alongside the existing CRM, reads from it, writes back). AI QA over conversations (consumes the existing call recordings). AI-generated wrap-up codes. Conversational AI for the chat channel (which often does not depend on the legacy telephony at all). Each adds capability without forcing a replatform.

What needs replacement eventually?

The IVR, when it cannot be bridged to a conversational AI cleanly. The CRM, if its data model cannot represent what the AI needs (rich case state, audit trails, cross-channel records). The workforce engagement tools, when they assume schedules based on volume the AI changes. None of these has to be replaced in year one; all probably will be by year three or four.

Where does this go wrong?

The team is told the AI will work over the existing stack and discovers the integrations are much harder than the vendor's demo. The data the AI needs is not in the legacy CRM. The audit logs the AI produces cannot be joined to the existing compliance records. Each gap is solvable; each takes longer than the project plan assumed.

What does the layered approach look like?

A staging layer between the legacy systems and the AI. The AI reads from and writes to the staging layer; the staging layer translates to and from the legacy systems. The legacy systems eventually retire; the staging layer is the migration path. This is more work up front and less work over the lifecycle.

What is the practical first step?

Pick one AI capability that can be added without touching telephony (chat AI, AI QA over recordings, agent assist on the existing CRM). Launch it in production. Use the experience to build the staging layer. Add the next capability. The rip-and-replace temptation is real; the layered approach is the one that ships.

Related: the right pace of AI deployment, vendor lock-in, and strategy vs implementation.