Metrics aren’t neutral: they reflect the interests of whoever built them

Ever wondered why audience metrics don’t seem to fully capture the truth, and what the long-term, macro effects are on news media? This is the issue that Sophie Chauvet investigated during her PhD research, and a topic she shared on stage at our recent Audiencers’ Festival in Paris. Metrics are misunderstood, and following them blindly may have high costs for journalists and the democratic health of media landscapes. Opening the black box however may offer clues as to how to really seize their potential. It lies in seeing them for what they really are: not a defined reality, but indicators of power dynamics at the heart of internet economics, mostly defined by statistics, and with very real risks for media diversity and journalistic autonomy.

Key takeaways to copy & share
> Metrics look objective. They are not. Every metric carries the business interests of whoever designed it, so a newsroom running on off-the-shelf analytics is optimising for someone else's goals

> Platform analytics are built to maximise ad inventory and time on network. If you sell subscriptions, you are measuring success with a tool designed for a different business model

> The free analytics smaller outlets use are modelled on what the biggest outlets negotiated with platforms. The advantage compounds: winner-take-all monetisation, hierarchies that are hard to challenge, and incentives to consolidate

> Chasing volume shows up in the copy. Articles translated into several languages, wire reports pasted in, headlines bent towards trending keywords. In the AI era the suggestions are no longer keywords but whole sentences, which risks framing social issues more stereotypically

> Goodhart's law: once a metric becomes a target, it stops being a good metric. The argument is not to abandon analytics, but to ask of every number on your dashboard who designed it and what behaviour it rewards

Based on the PhD research of Sophie Chauvet.

The paradox: Are metrics bullsh*t?