Understanding Compliance Model Updates

Beta Release: The Compliance Model is currently in beta as we continue to gather client feedback, refine scoring, and incorporate feedback into ongoing model improvements.

Understanding the Compliance Model Updates

Why We Introduced New Compliance Model Updates

Compliance Model updates were developed as a way to continue training our model by consistently providing a more robust, flexible, and detailed auditing framework. The updated model better accommodates the diversity in clinical documentation, enables providing note level insights for more targeted feedback, and helps prepare for evolving regulatory standards.  We have applied our learnings from the past two years to inform our updates and better account for the diverse set of clinical documentation workflows and styles we have observed in practice groups across the country.  We are excited to be able to provide more targeted feedback with examples to help organizations monitor compliance, provide therapist education via snapshots. 

Key Enhancements in Our Recent Compliance Model Updates

1. Model Retraining and Expanded Coverage

Our AI model underwent significant retraining, increasing the label count from approximately 65 to over 100. This enhancement allows for:

• Improved recognition of diverse sentence types and clinician workflows.
• Better support for varied note structures, including re-evaluations, plan of care recertifications, and discharge summaries.
• The labeling process has been enhanced to accommodate more sentences within each note. As part of this update, new labels have been introduced to provide more precise categorization and support improved documentation coverage.

• While new note types are incorporated, additional validation is underway to ensure consistent accuracy.

  
  

2. Greater Flexibility and Improved Scoring

• Modifications to the rubric and evaluation criteria, including adjustments to the scoring system itself.
• The system is now more resilient to format changes in source EMRs, maintaining consistent capture of relevant documentation.
• Our new compliance model introduces a more robust scoring system that captures finer details in documentation and aligns with potential regulatory updates.
• Human feedback through tools like “Is this prediction correct?” supports ongoing supervised training, allowing continuous model refinement.
• More Accurate Historical Insight: Historical data is rescored using the updated Compliance model to ensure consistency and alignment across all time periods.

3. Dashboard and User Interface Updates

The Compliance Model brings a completely refreshed user experience to make compliance insights easier to interpret and act upon:

Visual and Functional Improvements

• New Audit Score Layout with alpha tags and improved visual cues (red, yellow, green) to quickly identify risk areas.

• Graphs and Tables have been condensed and combined for easier comparison and interaction.

  
  

4. Enhanced Graphs and Drill-downs

• Consolidated graphs display note type averages with overlays showing highest and lowest provider scores.
• Hover interactions reveal detailed subcomponent data for better insight into specific strengths and weaknesses.

• Strengths and Improvement Areas Graphs offer a longitudinal view of provider performance trends.

  
  

5. Provider Table & Note Exploration

• The provider table now includes sortable columns, visit counts, and average audit scores per note type.
• Clicking on a provider’s name opens a detailed pop-up with component- and subcomponent-level performance data.
• Users can drill down to sentence-level mappings, including indicators for copy-forward content, helping contextualize each compliance component directly within the note.

The Compliance Model represents a major leap forward in clinical audit precision, system adaptability, and provider performance insight. These updates are designed to better reflect real-world documentation practices, support evolving regulatory needs, and empower teams with actionable, transparent data.

If you need help navigating the new Compliance Model features or have questions about how these changes affect your organization, feel free to reach out to our support team at support.insight@prompthealth.com.