Product Updates

​

Guard API Latency Improvement

• Latency Reduction: Reduced latency by 3x, resulting in more stable and robust LLM inference.
• p50 Improvement: p50 now under 50ms.

​

Feedback Flow Fixes

• Instant Feedback Updates: Feedback updates are now reflected instantly in the Guard API, taking effect immediately.

​

Usage Analytics

• New Usage Page: Added a new usage page to track trends in request and token consumption.

​

Policy Deployment

• Policy Confirmation: Policy updates now require confirmation to ensure immediate application in the API.

​

Flagged Filter in Log Details

• Flagged Messages Filter: Introduced a filter to display only flagged messages in log details, improving threat identification when passing full conversation histories.

​

Enhanced Security Monitoring & Feedback

​

Logs & Investigation

• Improved Logs Interface: Redesigned logs interface for easier tracking of details and historical interactions.
• Enhanced Logs API Performance: Enhanced search speed and added expanded filtering options for more efficient log retrieval.

​

Feedback System

• Bulk Feedback: Added support for submitting multiple feedback items simultaneously.
• Integrated Feedback Loop: Integrated new feedback system with Guard API evaluation for immediate application.
• Historical Feedback Dataset: Created a consolidated dataset of historical feedback to support policy retraining.

​

Dashboard Improvements

• Top Threats Visibility: Dashboard now highlights the top 10 threats detected, prioritized by lowest confidence scores, to focus attention on areas requiring action.

​

Try Policies with Playground

• Interactive Console Playground: Launched an interactive playground within the console, allowing users to test and iterate on custom policies in real-time.

​

Enhanced Security Features

• SSO/SAML Support: Added Single Sign-On (SSO) via SAML for enterprise customers.
• MFA Enforcement: Multi-factor authentication (MFA) is now enforced across all accounts for added security.