I have been using the internet for a long time, and I can say with complete confidence that until about 2024, every chatbot I ever interacted with was worse than a search bar. The classic intercom-style bot with the three canned options and the eventual fallback to "let me connect you with a human" was a pure waste of screen space.
A lot of businesses still have that bot up. It is embarrassing. Not because the team is lazy, but because the technology was not good enough until recently, and nobody has bothered to upgrade.
The bar has moved. A modern conversation bot, properly built, can now do things that genuinely save time. It can read your entire product documentation and answer questions with citations. It can help a user configure a product before checkout, including recommending the right variant. It can handle a refund request, pull up the order, and actually process the refund without routing to a human. That last one is new in the last 18 months and it is still rare in production.
The reason most companies still ship bad bots is that the default tools make bad bots easy and good bots hard. The default tool gives you a decision tree and some fallback responses. You can build a pretty okay customer service triage flow in an afternoon. What you cannot build is a bot that actually resolves tickets, because resolving tickets requires the bot to do things, not just say things.
The real test of a bot is what percentage of conversations end without human handoff. If your bot handles 40 percent of conversations end-to-end, you are beating industry average. If it handles 70 percent, you are doing something genuinely different. Most of that gap is not AI quality, it is integration. The bot needs to read from your order system, your inventory, your knowledge base, your shipping provider. All of them, in real time.
If you are picking a chatbot in 2026, the question is not "does it use AI." They all do. The question is "can it take actions." Can it update the subscription. Can it refund the order. Can it schedule the service. If the answer to those is no, you are still shipping a FAQ page with extra steps.
Every bot we ship has a hard metric attached: containment rate. The percentage of conversations the bot closes without a human. We do not ship until it is above 55 percent, and we track it weekly after launch. It is the only metric that actually matters, because it is the only one tied to the cost of the alternative.