--- title: Some model review findings matter less in real terms description: Understanding the impact of potential model biases, based on actual data. Check if findings warrant immediate action or can be monitored for future. image: https://riskinsights.com.au/hubfs/Some%20model%20review%20findings%20matter%20less%20in%20real%20terms.png --- [Skip to content](https://riskinsights.com.au/blog/model-review-findings-that-matter-less#main-content) [![Risk Insights - Logo - (RGB, Horizontal, Small)](https://riskinsights.com.au/hs-fs/hubfs/Risk%20Insights%20-%20Logo%20-%20(RGB%2c%20Horizontal%2c%20Small).png?width=200&height=40&name=Risk%20Insights%20-%20Logo%20-%20(RGB%2c%20Horizontal%2c%20Small).png)](https://riskinsights.com.au) - [Articles](https://riskinsights.com.au/blog) - [Approach](https://riskinsights.com.au/approach) Show submenu for Approach - [Commissions (Accuracy)](https://riskinsights.com.au/broker-partner-commission-accuracy-reviews) - [Claims Fraud (Fairness)](https://riskinsights.com.au/claims-fraud-fairness-reviews) - [Fees and Charges (Accuracy)](https://riskinsights.com.au/fee-and-charge-accuracy-reviews-risk-insights) - [About](https://riskinsights.com.au/about) - [Contact](https://riskinsights.com.au/contact) Open main navigation Close main navigation - [Articles](https://riskinsights.com.au/blog) - [Approach](https://riskinsights.com.au/approach) Show submenu for Approach - [Commissions (Accuracy)](https://riskinsights.com.au/broker-partner-commission-accuracy-reviews) - [Claims Fraud (Fairness)](https://riskinsights.com.au/claims-fraud-fairness-reviews) - [Fees and Charges (Accuracy)](https://riskinsights.com.au/fee-and-charge-accuracy-reviews-risk-insights) - [About](https://riskinsights.com.au/about) - [Contact](https://riskinsights.com.au/contact) --- 17 Sep 2026 # Some model review findings matter less in real terms ![Picture of Yusuf Moolla](https://riskinsights.com.au/hs-fs/hubfs/Yusuf_Moolla_Headshot-transformed.png?width=50&name=Yusuf_Moolla_Headshot-transformed.png) [Yusuf Moolla](https://riskinsights.com.au/blog/author/yusuf) Share: [linkedin-in icon](http://www.linkedin.com/shareArticle?mini=true&url=https://riskinsights.com.au/blog/model-review-findings-that-matter-less) [envelope icon](mailto:?body=https://riskinsights.com.au/blog/model-review-findings-that-matter-less) In a review we might identify a variable that could be acting as a proxy for a protected attribute. On face value, it’s worth raising, because the variable is in the model, the correlation is plausible, and someone needs to look at it. Then we get into the data, and the field is populated for a small set of customers or carries little weight in the model. On its own this doesn't say much. What matters is whether these customers have different outcomes to others. If not, the proxy is there but with no real impact, or impact limited enough that it may not justify immediate effort. Effort that could be directed at more important things, in the short term. For example, a model review might find vehicle type acting as a proxy for disability. The range of vehicle types includes vehicles with accessibility modifications, like modified driving controls. This type of issue could come up in a vehicle finance model review, or in a motor claims model review. But when we look at the data, there's only a handful of loans or claims involved, and those are not treated unfavourably. The system won’t really pick up on them, even if vehicle type is fed in. There simply isn't enough of it for the machine learning models to learn from; the field is available to the models, but effectively unused. This doesn't mean the original finding was wrong; we need to raise it. But until we know how often it happens and how much it moves the decision, we don't really know whether the problem is real or theoretical. Real needs action now, theoretical could wait for the next cycle with monitoring in the meantime. This is especially important when models are not changed very often, and immediate action means an off-cycle change in the model. If the issue is theoretical, we could delay the change in the model until the next proper cycle, rather than trying to deal with it straight away and creating way more immediate effort than we really need to. So when we find a potential problem in the models or rules of an algorithmic system, we can ask a couple of questions before deciding what action to take. How often does this actually happen, and are the affected customers getting different outcomes? If they aren't, do we need to change it now, or monitor and fix it in the next cycle?    --- Disclaimer: The info in this article is not legal advice. It may not be relevant to your circumstances. It was written for specific contexts within banks and insurers, may not apply to other contexts, and may not be relevant to other types of organisations. ---     ## Related posts [![Curated Insight: Fraud detection in the EU AI Act (based on recent draft guidance)](https://riskinsights.com.au/hs-fs/hubfs/Curated%20Insight%20Fraud%20detection%20in%20the%20EU%20AI%20Act%20%28based%20on%20recent%20draft%20guidance%29.png?height=200&name=Curated%20Insight%20Fraud%20detection%20in%20the%20EU%20AI%20Act%20%28based%20on%20recent%20draft%20guidance%29.png)](https://riskinsights.com.au/blog/curated-insight-fraud-detection-in-the-eu-ai-act-based-on-recent-draft-guidance) ## [Curated Insight: Fraud detection in the EU AI Act (based on recent draft guidance)](https://riskinsights.com.au/blog/curated-insight-fraud-detection-in-the-eu-ai-act-based-on-recent-draft-guidance) 20 Aug 2026 TL;DR • The European Commission has published draft guidance on which AI systems count as high-risk... [Read more](https://riskinsights.com.au/blog/curated-insight-fraud-detection-in-the-eu-ai-act-based-on-recent-draft-guidance) [![Models aren’t evil, but they are sometimes lazy](https://riskinsights.com.au/hs-fs/hubfs/Models%20aren%E2%80%99t%20evil%2c%20but%20they%20are%20sometimes%20lazy.png?height=200&name=Models%20aren%E2%80%99t%20evil%2c%20but%20they%20are%20sometimes%20lazy.png)](https://riskinsights.com.au/blog/models-arent-evil-but-they-are-sometimes-lazy) ## [Models aren’t evil, but they are sometimes lazy](https://riskinsights.com.au/blog/models-arent-evil-but-they-are-sometimes-lazy) 15 Jan 2026 TL;DR • We sometimes confuse algorithmic "bias" with bad intent, but it’s usually just efficiency... [Read more](https://riskinsights.com.au/blog/models-arent-evil-but-they-are-sometimes-lazy) [![Review triggers and practical checks for algorithmic systems (Part 5)](https://riskinsights.com.au/hs-fs/hubfs/Review%20triggers%20and%20practical%20checks%20for%20algorithmic%20systems%20Part%205.png?height=200&name=Review%20triggers%20and%20practical%20checks%20for%20algorithmic%20systems%20Part%205.png)](https://riskinsights.com.au/blog/review-triggers-and-practical-checks-for-algorithmic-systems-part-5) ## [Review triggers and practical checks for algorithmic systems (Part 5)](https://riskinsights.com.au/blog/review-triggers-and-practical-checks-for-algorithmic-systems-part-5) 30 Apr 2026 TL;DR • The final article in a 5-part series. • Part 1 explained triggers for testing and deep... [Read more](https://riskinsights.com.au/blog/review-triggers-and-practical-checks-for-algorithmic-systems-part-5) We acknowledge Aboriginal and Torres Strait Islander peoples as the Traditional Custodians of the lands on which we live and work. We pay our respects to Elders past and present, and honour the rich diversity of the world's oldest living cultures. [View our LinkedIn page](https://www.linkedin.com/company/riskinsightsap) [email us](mailto:info@riskinsights.com.au) [Call us](tel:+61408946143) 2026 Risk Insights Pty. Ltd. | [Privacy](https://riskinsights.com.au/privacy-policy) | [Disclaimer](https://riskinsights.com.au/disclaimer) ```json { "@context" : "https://schema.org", "@type" : "BlogPosting", "author" : { "@type" : "Person", "name" : "Yusuf Moolla", "url" : "https://riskinsights.com.au/blog/author/yusuf" }, "dateModified" : "2026-09-16T20:30:00.815Z", "datePublished" : "2026-09-16T20:30:00.000Z", "headline" : "Some model review findings matter less in real terms", "image" : [ "https://riskinsights.com.au/hubfs/Some%20model%20review%20findings%20matter%20less%20in%20real%20terms.png" ], "mainEntityOfPage" : { "@id" : "https://riskinsights.com.au/blog/model-review-findings-that-matter-less", "@type" : "WebPage" }, "publisher" : { "@type" : "Organization", "logo" : { "@type" : "ImageObject", "url" : "https://riskinsights.com.au/hubfs/Risk%20Insights%20-%20Logo%20-%20(RGB%2c%20Horizontal%2c%20Small).png" }, "name" : "Risk Insights Pty. Ltd." } } ```