Shop
EN

Sections

Language

Reading list

This list is saved in this browser on this device.

Your list is empty. Save an article using the bookmark icon to find it here.

TECHNOLOGY

Medical AI: A Biased Doctor?

L-IA-médicale-un-docteur-biaisé HYTRAPE

Thought artificial intelligence was going to revolutionize medicine? Not so fast! A recent study shows us that those famous AI models that analyze medical images may need a little consultation themselves.

Imagine this: the models that are best at guessing your age, gender, or origin are also the ones that make the biggest mistakes when it comes to diagnosing certain groups of people. These are called “fairness gaps.” Not very reassuring, is it?

But wait, it gets even more interesting. These smart AI guys are reportedly using “demographic shortcuts” to make their diagnoses. The result? Mistakes galore for women, black people, and other groups. It’s like your doctor diagnosing you based on your appearance instead of your symptoms. Not very professional, huh?

Marzyeh Ghassemi, a leading expert at MIT, explains: "We already knew that these machine learning models were aces at predicting demographic characteristics. But now, we've made the link between this ability and their unequal performance across groups. This is unprecedented!"

So what do we do? Do we throw AI out the window? Not so fast. These discoveries are crucial to improving these systems. We need to make sure they are as reliable at diagnosing Grandma Jane as they are for young Kevin from the next door neighborhood.

In the meantime, let’s keep our eyes open. AI in medicine is promising, but it will never replace common sense and human expertise. After all, would you rather be diagnosed by a biased algorithm or by a real doctor?

Leave a comment

Please note, comments need to be approved before they are published.

This site is protected by hCaptcha and the hCaptcha Privacy Policy and Terms of Service apply.

HYTRAPE shop · 3D

Put your reading into practice.

A 3D selection from HYTRAPE’s independent creators.

View the collection

20,000+ downloads 4.7/5 45 verified reviews

In this article