Skip to content
Book intro call

Algorithm Integrity Matters

Algorithm Integrity Matters

Algorithm_Integrity_Matters_Podcast_Artwork

A podcast for FS leaders who want to enhance fairness and accuracy in their use of data, algorithms, and AI.

Each episode explores existing and emerging challenges and solutions related to algorithmic integrity, including discussions on navigating independent audits.

The goal of this podcast is to give leaders the knowledge they need to ensure their data practices benefit customers and other stakeholders, reducing the potential for harm and upholding industry standards.

Episode 0: Introduction

A brief intro to the podcast.
If you have topic suggestions, feel free to reach out via email: yusuf@riskinsights.com.au

 

Episode 1: How reliable is the algorithm / workflow audit that you have commissioned?

Spoken (by a human) version of this article.

One common issue with audits is undue reliance.

Can you rely on the audit report to tell you what you need to know?

Could you be relying on it too much?

 

Episode 2: Choice vs obligation: motivation shapes the effectiveness of your audit

Spoken (by a human) version of this article.

The motivation(s) for commissioning an audit can determine how effective it will be. Our engagement and satisfaction levels are generally higher when we choose (than when we are forced).

 

Episode 3: Navigate Algorithm Audit Guidance: some aren't relevant to your context

Spoken (by a human) version of this article.

AI and algorithm audits help ensure ethical and accurate data processing, preventing harm and disadvantage. 

However, the guidelines are not yet mature, and quite disparate.

This can make the audit process confusing, and quite daunting - how do you wade through it all to find the information that you need, in deciding how to commission your audit? 

Fortunately, there is a solution - narrowing the guidelines down, based on relevance.

 

Episode 4: Structuring the Audit Objective: 10 Key Aspects of Algorithm Integrity

Spoken (by a human) version of this article.

In a previous episode, we explored the challenges of placing undue reliance on audits.

One potential solution that we outlined is a clear scope, particularly regarding the audit objective.

In this episode, we focus on algorithm integrity as the broad audit objective.

While it’s easy to assert that an algorithm has integrity, confirming this assertion is a bit more complex.

To help simplify this, this episode breaks it down into a set of key areas to consider.

 

Episode 5: Equal vs Equitable: Algorithmic Fairness

Spoken (by a human) version of this article.

Fairness in algorithmic systems is a multi-faceted, and developing, topic.

In episode 4, we explored ten key aspects to consider when scoping an algorithm integrity audit.

One aspect was fairness, with this in the description: "...The design ensures equitable treatment..."

This raises an important question. Shouldn't we aim for equal, rather than equitable treatment?

This episode aims to shed light on the distinctions between equal and equitable treatment in algorithmic systems, while acknowledging that our understanding of fairness is still developing and subject to ongoing debate.

 

Episode 6: Balancing Security and Access for increased algorithmic integrity

Spoken (by a human) version of this article.

When we talk about security in algorithmic systems, it's easy to focus solely on keeping the bad guys out.

But there's another side to this coin that's just as important: making sure the right people can get in.

This article aims to explain how security and access work together for better algorithm integrity.