οΏ½ Speech-to-Speech (STS)

AI Voice Conversation Demo

Hello! I'm your AI voice assistant. How can I help you today?
Batch Mode: Click to record, then process
0%
πŸ”΄ Not Recording
Ready to listen
Current Agent: Default Agent

Try saying:

  • "Hello, how are you today?"
  • "Tell me a joke"
  • "What's the weather like?"
  • "Explain artificial intelligence"
  • "Help me with a question"

πŸ’° API Usage Tracker

Whisper (STT): 0 requests $0.00
GPT-3.5 Turbo: 0 tokens $0.00
TTS (Voice): 0 chars $0.00
Total Cost: $0.00

πŸ” AI Communication Debug

Speech-to-Text (Whisper):

Waiting for speech input...

System Prompt to GPT:

System prompt will appear here...

GPT Response:

AI response will appear here...

OpenAI TTS:

TTS information will appear here...

Streaming Connection:

Streaming debug info will appear here...

Customer Personas Management

Add New Persona

Existing Personas

Transaction Management

AI System Prompts Configuration

Base AI Personality

Define the core personality and tone of your AI assistant

Financial Services Context

Specific instructions for handling financial services scenarios

Response Instructions

How the AI should structure and deliver responses

Custom Scenario Prompts

Add custom prompts for specific scenarios or industries

Generated System Prompt Preview:

Click "Test Current Setup" to see the complete system prompt that will be sent to the AI.

πŸ€– Agent Configuration & Management

Configure and manage your AI agents. Control which agents are enabled, their priorities, and their specific behaviors and capabilities.

Total Agents: -
Enabled: -
Disabled: -

Quick Actions

Available Tools

  • πŸ”§ Agent Configuration - Enable/disable agents, set priorities, configure LLM models
  • πŸ§ͺ AI Agent Routing - Test semantic understanding and conversation context
  • 🎯 Basic Agent Routing - Test keyword-based routing and agent selection
  • πŸ”„ Status Monitoring - Real-time agent status and performance metrics
  • ⚑ Quick Actions - Instantly toggle agents on/off
  • πŸ›‘οΈ Security Testing - Validate agent boundaries and permissions

πŸŽ›οΈ LLM Manager Console

Advanced agent management with detailed configuration, guardrails, voice settings, and audit logging.

πŸ“Š System Statistics

0 Total Agents
0 Enabled
0 Disabled
Never Last Updated

⚑ Quick Actions

Agent Status Grid

Agent Configuration Management

Configure individual agent settings, LLM providers, and operational parameters.

Guardrails Management

Configure security boundaries and capability restrictions for each agent.

Voice Configuration

Configure TTS settings, voice personalities, and contextual adaptations.

Audit Log

Configuration Changes

Bulk Operations

Settings

OpenAI Configuration

No API key set
Fast and cost-effective for basic financial conversations

🎀 Text-to-Speech Settings

OpenAI TTS Settings

1.0x

OpenAI TTS: Premium quality, natural-sounding voices. Requires API key and costs per character.

πŸŽ™οΈ Speech Recognition Enhancement

πŸ’‘ Tips for Better Recognition:

  • Speak clearly and at normal pace
  • Use a quiet environment with minimal background noise
  • Hold the microphone 6-8 inches from your mouth
  • Pause briefly between sentences
  • Use financial terms naturally (e.g., "account balance", "credit card")
  • Watch the audio level indicator - aim for green/yellow range

πŸ“ž Streaming Mode Settings

1.0s

πŸ”„ Streaming Mode Features:

  • Real-time conversation: Continuous audio connection like a phone call
  • Voice Activity Detection: AI responds when you pause speaking
  • Full Duplex: Both parties can speak and listen simultaneously
  • Lower latency: Faster response times than batch mode
  • Natural flow: More conversational interaction

πŸ› Debug Settings

Debug logging is disabled (recommended for normal use)

Debug Mode: Shows detailed console logs for troubleshooting

Note: Only enable when investigating issues - can impact performance