When Meta unveiled the Muse Charm, a keychain-sized agentic artificial intelligence (AI) device, equipped with cameras and a cartoon avatar, at its Connect conference on September 23–24, the alarm from privacy advocates was immediate. Given Meta’s track record, and the ongoing backlash over its “pervert glasses,” the concern is understandable.
But the spotlight on Meta has also conveniently overshadowed some concerning features introduced by Apple two weeks earlier at its “Surprise and Shine” event, specifically, new Audio Intelligence features released in beta this month to its Apple Watch. Two of the four stand out. Siri Recap produces summaries of the conversations happening around the wearer, while Live Rewind displays the last 15 seconds of speech as a text snippet on the watch display. Both are marketed as privacy wins. To me, they demonstrate the gap between safeguarding data and safeguarding people.
Meta and Apple are part of the same shift from passive digital tools that we operate to agentic tools that observe and interpret the world around us based on what we see, hear and do. While Meta is building new gadgets for this, Apple is building it into the watch already on millions of wrists.
Apple says its Audio Intelligence features are private “by design.” Its watch processes audio in a hardware-isolated Secure Exclave on the S11 chip, deletes it immediately, and, for Siri Recap, summarizes it in a Private Cloud Compute environment that Apple says it cannot access. Summaries the user saves sync with end-to-end encryption, and those left unsaved auto-delete after seven days. If data security were the measure of privacy, Apple would be the gold standard and Meta the cautionary tale.
But setting data security aside, Apple’s approach is every bit as concerning for the norms around ambient capture and the erosion of privacy. It is arguably more concerning because a trusted brand has the scale and influence to make capturing conversation feel ordinary.
Like Meta, which is facing legal action over bystander privacy concerns, Apple has a bystander problem. The company says, “You’re in control”: “Each Audio Intelligence feature is opt-in. And for Live Rewind and Siri Recap, you decide when and where each feature is active.” But every control Apple describes belongs to the wearer. The colleagues, friends or strangers whose words are summarized never agreed to Apple’s terms, cannot opt out and have no say in the matter. Live Rewind chimes when activated, indicating Apple’s awareness of the issue. But as these devices proliferate, such signals risk becoming as meaningless as the many digital pings and alerts that already pollute our physical experience. Siri Recap, which runs in the background, does not. And in the dozen or so jurisdictions requiring all-party consent to intercept confidential conversations, “we don’t keep the audio” may prove a thin defence.
Data Security Is Not the Same as Meaningful Privacy
While much has been written about the bystander problem, Apple’s framing represents a much deeper governance challenge. Apple’s central promise is that audio is not recorded or stored. But not stored is not the same as not processed or used in a potentially harmful way. “Not stored” only means that no copy was kept, at least not by Apple (the wearer can choose to retain summaries). A border agent may hand back my passport without copying it and still deny me entry based on what it says. The information was still used, and it still had an effect.
With Siri Recap, the effect is the summary. Apple compares it to notes you might jot down after a conversation, and stresses that it omits speaker labels and sensitive identifiers. But a summary is only useful if it captures what mattered, so anything material is likely to survive. And people identify themselves through names, roles and context, just as technology identifies us through pervasive behavioural tracking and analysis. My handwritten notes from memory also don’t run through a private company’s infrastructure or operate at the scale of millions of wrists. While Apple is relying heavily on sophisticated privacy-enhancing technologies (PETs), the record on PETs is mixed.
The Real Risk Is Eroding Norms
In my book Beyond Data, I argue that our singular focus on protecting data in the face of rapid technological change has endangered our fundamental human rights, including the right to privacy. Corporate giants have redefined privacy as a narrow techno-computational exercise in securing and protecting data. But data security is not the same thing as the human right to privacy. As Apple and others normalize these technologies, the real risk here is whether a private conversation may no longer be possible at all.
As one researcher, Luke Heemsbergen, puts it, “Apple can encrypt, minimise and delete all it likes, but data protection isn’t the problem. The problem is a conversation has been quietly re-routed from the room where it happened into a device and service and product.” Heemsbergen adds, “what Apple is actually selling [is] a new default understanding that a conversation is something that may be casually captured, analysed and used elsewhere by others.”
Apple advises wearers to “consider those around you where conversations might be private or sensitive,” but conversations don’t announce when they’ll turn private or sensitive. If we don’t change our behaviour, we’ll either predictably reveal things we never meant to share or, if we do, we put our candour and intimacy with one another in jeopardy.
This shift is legal as well as cultural. The reasonable expectation of privacy asks whether the speaker expected privacy and whether society would recognize that expectation as reasonable. The more normalized ambient capture becomes, the less any of us can reasonably expect privacy, and the weaker the protections built on that expectation become.
Perhaps it’s no surprise that a company that made it fashionable to carry a tracking device in our pockets is now making it normal to carry a listening one. This time, we need to draw the line between securing our data and protecting our privacy before private conversations become a thing of the past.