New updates and improvements
June 2025
Guard API Latency Improvement
- Latency Reduction: Reduced latency by 3x, resulting in more stable and robust LLM inference.
- p50 Improvement: p50 now under 50ms.
Feedback Flow Fixes
- Instant Feedback Updates: Feedback updates are now reflected instantly in the Guard API, taking effect immediately.
Usage Analytics
- New Usage Page: Added a new usage page to track trends in request and token consumption.
Policy Deployment
- Policy Confirmation: Policy updates now require confirmation to ensure immediate application in the API.
Flagged Filter in Log Details
- Flagged Messages Filter: Introduced a filter to display only flagged messages in log details, improving threat identification when passing full conversation histories.
May 2025
Enhanced Security Monitoring & Feedback
Logs & Investigation
- Improved Logs Interface: Redesigned logs interface for easier tracking of details and historical interactions.
- Enhanced Logs API Performance: Enhanced search speed and added expanded filtering options for more efficient log retrieval.
Feedback System
- Bulk Feedback: Added support for submitting multiple feedback items simultaneously.
- Integrated Feedback Loop: Integrated new feedback system with Guard API evaluation for immediate application.
- Historical Feedback Dataset: Created a consolidated dataset of historical feedback to support policy retraining.
Dashboard Improvements
- Top Threats Visibility: Dashboard now highlights the top 10 threats detected, prioritized by lowest confidence scores, to focus attention on areas requiring action.
April 2025
Try Policies with Playground
- Interactive Console Playground: Launched an interactive playground within the console, allowing users to test and iterate on custom policies in real-time.