Inbox

Central hub for triaging and managing all AI application issues and regressions

The Avido Inbox is where all issues and regressions in your AI application are gathered, triaged, and assigned. With the Inbox, you know where to start your day, and what issues to tackle first. It also allows for smooth and frictionless collaboration between stakeholders. A response is flagged as providing wrong answers? Assign it to the document owner. An answer about a feature is vague or contradictory? Assign the product manager who can clear it up. Technical error? Route it to the dev in charge.

An AI application is never done, nor perfect. It’s a continuous cycle of improvement through collaboration. This is what the Inbox solves.

What is the Inbox?

The Inbox is a real-time, multi-source queue for all high-priority platform issues. It consolidates test failures, System Journal alerts, customer reports, and API-submitted errors into a single, actionable queue. Every incoming item is automatically summarized, categorized, and prioritized before surfacing to users, who can rapidly triage and assign.

This is a focused, high-signal triage and assignment tool—not a deep workbench or collaborative analysis surface. It’s designed to help you quickly understand what’s wrong and get it to the right person.

Issues

Issues are the core of the Inbox. Every regression, bug, potential hallucination, or actual error is processed and added into the Inbox as an issue.

When Issues Appear

Issues show up when:

• A test run by Avido fails: Evaluation tests that don’t meet their thresholds automatically create issues
• System Journal entries flag critical changes: Configuration changes outside acceptable ranges trigger issues
• External API submissions: Your application or third-party services call the Avido /issues endpoint
• Future: Customer reports and AI Core alerts (planned)

Before getting added to the Inbox, Avido’s AI pre-processes each issue to make it actionable for your entire team.

Pre-Processing Pipeline

One of the core benefits of using Avido is the ability to work from the same truth, even when some stakeholders are technical, like engineers, and some are non-technical like SMEs. To enable this, Avido pre-processes all incoming issues before adding them to the Inbox.

During processing, Avido’s AI will:

• Summarize the issue: Create both business and technical summaries
• Estimate impact: Assess the expected effect this issue will have
• Assign priority: Set criticality level (Critical, High, Medium, Low)
• Find similar issues: Detect duplicates and related problems using AI embeddings
• Add metadata: Include source, timestamps, and relevant context

This allows you to focus on the errors that matter most and keeps everyone working from the same truth about what’s happening and how it’s affecting the application. Less coordination, faster time-to-fix.

Using the Inbox

Accessing Your Inbox

Navigate to the Inbox section in your Avido dashboard. You’ll see a real-time queue of all unresolved issues, sorted by priority and creation time.

Understanding Issue Cards

Each issue displays:

• Priority Badge: Visual indicator of criticality
• Source: Where the issue originated (Test, System Journal, API)
• Title: Clear description of the problem
• Business Summary: Plain-language explanation (default view)
• Technical Summary: Detailed technical context (toggle to view)
• Metadata: Creation time, affected systems, related traces
• Similar Issues: Count of potentially related problems

Core Actions

Triage Workflow

1. Review: Scan the queue, starting with highest priority items
2. Understand: Read AI-generated summaries to grasp impact
3. Act: Take one of these actions:
   • Assign: Route to a specific user or team with optional notes
   • Dismiss: Mark as resolved or non-actionable with a reason
   • Merge: Combine with similar issues to reduce duplication

Bulk Operations

Select multiple issues using checkboxes to:

• Assign all to one person
• Dismiss multiple non-issues
• Apply the same action to related problems

Business vs Technical Views

Every issue comes with two perspectives:

• Business Summary (default): What happened and why it matters, in plain English
• Technical Summary: Root cause details, stack traces, and technical context

Toggle between views based on your needs and audience.

The Issues API

The /issues endpoint allows you to create issues and send them straight into the Avido Inbox from any application.

Example Use Cases

• Catch technical errors: Send application errors directly to the Inbox
• User feedback: Allow users to report hallucinations or unhelpful answers
• Support integration: Let customer service reps create issues from support tools

API Usage

POST /v0/issues
Authorization: Bearer YOUR_API_KEY
Content-Type: application/json

{
  "title": "User reported incorrect product pricing",
  "description": "AI provided outdated pricing information",
  "priority": "HIGH",
  "metadata": {
    "conversation_id": "conv_123",
    "affected_product": "premium_plan"
  }
}

Issues sent via the API go through the same pre-processing pipeline as any issue that Avido creates. Include as much context as possible for better summarization and categorization.

Important: Always PII-scrub any personal information before sending to the API.

Deduplication & Similar Issues

The Inbox uses AI embeddings to automatically detect similar issues:

• Automatic Detection: Flags potential duplicates with similarity percentages
• Merge Suggestions: Recommends combining highly similar issues (>90% similarity)
• Pattern Recognition: Groups related issues to reveal systemic problems

This prevents alert fatigue and helps you see the bigger picture when multiple related issues occur.

Best Practices

Daily Triage

• Start your day by reviewing new issues in the Inbox
• Focus on High priority items first
• Aim for “Inbox Zero” - clearing all unassigned urgent issues

Effective Assignment

• Assign based on expertise and current workload
• Add notes when assigning to provide context
• Reassign if someone is overwhelmed

Maintain Inbox Hygiene

• Dismiss false positives promptly with clear reasons
• Merge duplicates to keep the inbox clean
• Don’t let issues accumulate - triage regularly

Leverage AI Summaries

• Use business summaries for quick understanding
• Switch to technical view when diving into implementation
• Trust the AI prioritization but apply your judgment

Success Metrics

The Inbox helps you track:

• Response Time: How quickly issues are triaged and assigned
• Resolution Rate: Percentage of issues successfully resolved
• False Positive Rate: How many dismissed issues were non-actionable
• Pattern Detection: Recurring issues that indicate systemic problems

Current Limitations

The Inbox is designed as a triage tool, not a full incident management platform:

• No multi-step workflows or root-cause analysis features
• No deep collaboration workspaces within the Inbox
• Limited to standardized /issues API for external submissions

Getting Started

1. Automatic Setup: The Inbox is ready to use immediately
2. First Issues: Will appear as soon as tests fail or issues are submitted
3. Customization: Contact your Avido team to adjust priority thresholds or configure integrations

The Inbox transforms issue management from scattered alerts across multiple systems into a single source of truth, ensuring your team addresses what matters most and nothing falls through the cracks.