ChatWarden System
Advanced AI-powered chat moderation with real-time violation detection and automated punishment escalation.
Real-time Protection
System Overview
Real-time Analysis
Messages are analyzed instantly using Google's Gemini AI for immediate violation detection.
Smart Escalation
Progressive punishment system that escalates based on violation history and severity.
Batch Processing
Efficient message processing with optimized API usage and minimal server impact.
Custom Rules
Server-specific rules and patterns for targeted moderation policies.
Violation Detection
Spam Detection
Weight: 0.5
• Repeated identical messages
• Excessive caps
• Chat flooding
• Server advertising
Toxicity Detection
Weight: 1.0
• General insults
• Personal attacks
• Negative behavior
• Threats
Harassment Detection
Weight: 1.4
• Targeted behavior
• Persistent attacks
• Following/stalking
• Coordinated targeting
Hate Speech Detection
Weight: 2.0
• Discriminatory language
• Slurs
• Targeted group attacks
• Extremist content
Profanity Detection
Weight: 0.8
• Inappropriate language
• Sexual content
• Explicit material
• Contextual swearing
Punishment System
Score Thresholds
punishment_score_thresholds: warn: 1.5 # Low threshold mute: 4.0 # Medium tempban: 8.0 # High ban: 20.0 # Very high
Escalation Formula
Final Score = Base Score × Escalation Where: Base = Severity × Weight × Modifiers Escalation = 1.0 + (0.1 × Recent Severities)
Batch Processing
Processing Configuration
Optimized for performance and API efficiency
batch_processing: enabled: true chunk_size: 25 # Messages per batch process_interval_seconds: 20 # Process every 20 seconds max_batch_delay_minutes: 2 # Maximum message delay queue_limit: 200 # Maximum queue size
Monitoring & Statistics
Real-time Stats
• Violations detected
• Punishments issued
• Processing efficiency
• API usage metrics
Player Tracking
• Violation history
• Escalation status
• Risk assessment
• Appeal tracking
System Health
• Queue status
• API quota usage
• Response times
• Error rates
Related Documentation
Violation Detection
Deep dive into AI analysis
Punishment System
Automated punishment handling
Escalation System
Progressive punishment escalation
Batch Processing
Efficient message processing
Weights & Scoring
Violation scoring system
Configuration
Complete configuration guide