Improvement Agent

The Improvement Agent is an AI-powered tool that helps you systematically improve your chatbot's responses based on real customer feedback.

Overview

When a chat is marked as "needs improvement", the Improvement Agent analyzes:

• The original conversation
• Where the chatbot didn't respond optimally
• How the responses can be improved

Accessing the Improvement Agent

Via the Chats Page

1. Go to Chats in the dashboard
2. Open a chat with negative feedback
3. In the "AI Improvement Agent" section, click Improve with AI

Directly from Chat Detail View

1. Open a chat
2. In the "AI Improvement Agent" section, you'll see the feedback status
3. If the chat is marked as "Needs Improvement", click Improve with AI

The Improvement Process

1. Analyze the Original Conversation

The left panel shows the original chat conversation:

• Each message is numbered for easy reference
• User messages (purple) and bot responses (gray) are color-coded
• Bot messages have an "Improve" button to select them for improvement

Smart Message Selection:

• If the chat contains only one bot message, it is automatically pre-selected — the agent knows immediately which response you want to improve.
• If there are multiple bot messages, the agent's greeting will guide you to click "Improve" next to the specific message you want to fix. The selected message is highlighted in blue and an indicator bar appears near the chat input.

2. Chat with the Improvement Agent

The center panel is an interactive chat with the AI Improvement Agent:

• Describe what wasn't optimal about the chat
• Ask for improvement suggestions
• Discuss alternative response strategies
• Reference specific messages from the original chat

Example Prompts:

• "The answer to question 3 was too vague. How could the bot respond better?"
• "The bot didn't understand the product inquiry. What can we improve?"
• "Suggest a better fallback response when the bot is uncertain."

3. Review and Apply Suggestions

The right panel shows the generated improvement suggestions:

For each suggestion, you can:

• Start Simulation: Test how the bot would respond with the improvement
• Accept: Apply the improvement directly
• Reject: Discard the suggestion

Test Simulation

Before applying a suggestion, you can simulate it:

1. Click Start Simulation on a suggestion
2. The simulation shows:
   • The original user question
   • The original bot response
   • The simulated improved response
3. Rate the simulated response:
   • Good: Applies the improvement
   • Almost: Small adjustments needed
   • Bad: Discards the suggestion

Feedback Workflow

Rating Chats

Before the Improvement Agent can be used, a chat must be rated:

1. Open a chat
2. In the "AI Improvement Agent" section:
   • Good (Thumbs up): Marks as positive example
   • Needs Improvement (Thumbs down): Opens the Improvement Agent
   • Reviewed (Check): Marks the chat as reviewed/dismissed without rating it good or bad (does not affect the confidence score and does not trigger emails or improvement sessions)

Using the Learning Phase

During the learning phase, you'll be automatically prompted to rate chats. This significantly accelerates the improvement of your chatbot.

Reset Session

If you want to start a new improvement session:

1. Click Restart in the header
2. Confirm the reset
3. Previous suggestions will be discarded

Availability

Best Practices

1. Be specific: The more precisely you describe the problem, the better the suggestions
2. Provide context: Mention what response you would have expected
3. Simulate before applying: Always test suggestions first
4. Use regularly: Weekly improvement sessions keep your bot up to date

Next Steps

• FAQ Management →
• Knowledge Base →
• Chatbot Settings →