Goal: Assemble an evidence-based rollout checklist.
Prerequisites: Bring your brief, instructions, approved knowledge, and test notes from the earlier lessons.
Expected result: A list of checked behaviors, unresolved failures, and the person responsible for each follow-up.
Bringing It All Together
You have now learned every component of the raia platform. This final lesson walks through the complete lifecycle of building and deploying an agent from start to finish, connecting all the modules together.
Phase 1: Plan (Module 2)
Before touching the platform:
- Answer the 5 Planning Questions (objective, audience, tone, guardrails, escalation rules)
- Document your agent's "North Star" — the specific outcome it should achieve
- Define 3–5 critical negative constraints
- Identify your escalation triggers (knowledge gaps, complexity, sentiment)
Phase 2: Build (Modules 3–5)
In raia CX Launch Pad:
- Info tab: Set agent name, description, and avatar
- Highlight 1: The Info tab.
- Highlight 1: Public Name: the name people see when they talk to the agent.
- Highlight 2: Internal Name (make it unique).
- Highlight 1: Description, with Optimize with AI.
- Highlight 2: Tags: labels that help your team group agents.
- Train tab: Write system instructions, optionally using the suggested six-section template and Four Pillars framework
- Highlight 1: The Train tab.
- Highlight 2: Agent Instructions, Documents and Advanced Settings.
- Highlight 3: Instructions Version: which saved version you are looking at.
- Highlight 1: Current Instructions: edit the text here.
- Highlight 2: Save
- Highlight 3: Save version keeps this text as a new version.
- Skills tab: Enable communication channels (start with Live Chat only), configure the Escalation Skill, and set up any Functions needed
- Highlight 1: The Skills tab.
- Highlight 2: The plus button adds a skill from Skills to add.
- Highlight 1: The pencil opens a skill's settings (here, Escalation).
- Highlight 1: Each row says whether the skill still needs setting up.
In raia Command:
- Create a project for your agent's knowledge
- Upload documents (Markdown preferred, with short, clearly headed sections)
- Highlight 1: Destination folder
- Highlight 2: Convert with AI
- Convert to Markdown if needed
- Send the converted documents to the agent for training, wait until they show as trained, then ask a test question
See the knowledge worked example for each of these steps with screenshots.
Phase 3: Test (Module 6)
In raia Copilot:
- Create a Test Script covering common tasks, missing information and refusal or escalation boundaries. Write the expected answer or action for each case and include realistic variations
- Run the test conversations
- Check Sources on replies that are wrong
- Highlight 1: Click Sources under the reply.
- Highlight 2: The Files tab.
- Highlight 3: The cited file: northstar-support-guide.md.
- Use the Diagnostic Framework as an investigation guide, not root-cause proof: review knowledge and retrieval for unexpected citations, instructions and source use for incorrect answers, and configuration, access, and execution for missing actions
- Iterate: fix the source, re-test, confirm the fix
- Before a controlled rollout, review results against your acceptance criteria and confirm the agent took no unintended actions
Phase 4: Deploy (Module 7)
- Start with Live Chat on your website (copy embed snippet from Launch tab)
Worked example
The examples use fictional data. Follow the same checks with approved, non-sensitive information for your own task.
Open the agent, then Launch. Agent Status shows Public, Private or Inactive; Private means only organization members can chat with this agent. View Embed Code gives the snippet for your site. Select Test Agent to try a sandbox conversation. If no chat appears, keep the agent Private and report the issue; switching to Public broadens access and is not a preview fix. Changing the status changes who can reach the agent, so check with your admin first.
- Highlight 1: Launch tab
- Highlight 2: View Embed Code
- Highlight 3: Agent Status
- For example, plan 2–4 weeks of monitoring in Copilot; adjust based on observed results
- Expand to additional surfaces: Browser Extension, Teams/Slack, SaaS integrations
- Add SMS, Email, Voice channels one at a time as confidence grows
Phase 5: Integrate (Modules 8–9)
- Configure authorized CRM access via webhooks (for example, onThreadEnd → log to HubSpot/Salesforce), then test the workflow
- Configure and test Functions with authorized access for live data retrieval (order status, account balance)
- Set up n8n ETL pipelines to send updated documents, then confirm each upload, training and a test answer
- Expose the agent via MCP for developer tool integration
- Build custom UIs via the API if needed
Phase 6: Improve (Continuous)
- Monitor conversations daily in Copilot
- Provide feedback (especially Suggested Replacements) on bad answers
- Review the Scoring Skill using your rubric; below 6 is an example threshold from the demo's custom 1–10 rubric
- Update Instructions and Vector Store based on patterns you observe
- Save instruction versions so you can compare a tested change and go back if needed
Example First-Week Plan
The dates, document counts, and test counts below are illustrative planning inputs, not requirements. Proceed to production only after actual acceptance checks, permissions, channel tests, and side-effect checks support readiness.
| Day | Activity | Product |
|---|---|---|
| Day 1 | Answer 5 Planning Questions, draft objectives and guardrails | — |
| Day 2 | Draft instructions using the suggested template if useful, create agent in CX | raia CX |
| Day 3 | Format and upload, for example, 10–20 relevant documents to Vector Store | raia Command |
| Day 4 | Run, for example, 15 test conversations, fix issues and assess acceptance checks | raia Copilot |
| Day 5 | Enable Live Chat on a staging/internal page, invite team to test | raia Chat |
| Day 6–7 | Monitor, gather feedback, refine instructions | raia Copilot |
| Week 2 | If readiness checks pass, begin a controlled production rollout; otherwise continue fixing and testing | All |
Final Principle: An AI agent is never "finished." Treat agent management as a continuous loop: Monitor → Spot Issues → Fix the Source → Re-test → Repeat. Feedback informs review; it does not automatically retrain the agent or guarantee permanent improvement. Verify changes and keep monitoring.
Practice check
Recommended practice: trace one support question from its source document to the reply. Record whether the answer and any requested action were verified separately; do not mark a real action successful based only on the agent saying it happened.