A healthcare provider had physicians review a potential diagnostic AI application.

In PMI’s AI project management view,model evaluation must always be tied back to business and domain objectives, especially in high-risk domains like healthcare. A high false-positive rate in a diagnostic system directly affects clinical workflow, patient anxiety, and cost. Before deciding to proceed or invest in further model tuning, PMI recommends confirming whether the observed performance actuallymeets or fails the agreed success criteria and risk thresholds.

The PMI-CPMAI approach to AI risk and value alignment stresses that teams should “evaluate model performance in the context of stakeholder needs, risk tolerance, and expected outcomes, revisiting objectives and requirements when discrepancies emerge” (paraphrased from PMI AI risk and value guidance). In this scenario, the team and physicians have identified that the false-positive rate is higher than acceptable. The next step, before a go/no-go decision, is toreassess the business and clinical objectives, trade-offs, and acceptable error rates: e.g., whether increased sensitivity justifies more false positives, or whether the system must be redesigned or repositioned (decision support vs. primary screener).

Technical options like hyperparameter tuning or more data may eventually be used, but they comeafterconfirming what level of performance and error trade-off is required. Therefore, the appropriate next step is toreevaluate the business objectives and outcomes.