What Apple is testing
Apple began rolling out beta versions of its "Audio Intelligence" technology for the Apple Watch on Tuesday, according to TechCrunch. The first testers are developers, who get the features through the iOS 27.3 update. Apple first announced the technology at its Surprise and Shine hardware event in September. Headlines from other outlets, including Bloomberg, Engadget, The Verge and MacRumors, describe the same beta as part of the latest watchOS test release.
The package has four opt-in AI features for Apple Watch Series 12 wearers. They detect important sounds, identify songs, help users catch up on conversations, and take notes. TechCrunch reported that the news first came in an emailed press release from Apple's communications team in India, and that the update reached the U.S. and other markets later in the day.
Sound recognition is aimed at deaf and hard-of-hearing users. It can flag sounds such as sirens, alarms or doorbells on the watch. Song recognition uses Apple's Shazam app to name music playing nearby and its artist.
How Live Rewind and Siri Recaps work
The two features that listen to people talking are Live Rewind and Siri Recaps. According to TechCrunch, they are the more potentially controversial part of the package, given the backlash to AI recording devices such as Meta's AI glasses and other wearables.
With Live Rewind, a user double-presses the digital crown to see a text snippet of what was said in the previous 15 seconds. That could help if someone gave verbal directions or read a long list of restaurant specials. The snippet disappears permanently if the user does nothing. It can instead be saved to the stand-alone Siri app that shipped with iOS 27. Users can also tap an "Ask Siri" option below the snippet to ask about something they didn't understand, such as a technical term. A chime and an animation play when the crown is pressed, which Apple intends as a signal to people nearby that something was captured. Unsaved snippets are deleted automatically after 30 seconds.
Siri Recaps works more like note-taking. Apple says it does not identify speakers, save raw audio or provide word-for-word transcripts. It produces a short summary sentence and bullet points covering items such as dates, deadlines or pricing. Apple suggested uses including work meetings, parent-teacher conferences and personal training sessions. Recaps are not recorded while the user listens to music through headphones or uses noise cancellation.
Controls and privacy design
Users prompted at the end of each day, and again when they first unlock the watch in the morning, can review their saved recaps and choose which to keep. Kept recaps can go to the Notes app, or to the Journal app if they are more personal. Anything left alone is deleted within seven days.
Siri Recaps can be switched on manually or set to a schedule, such as work hours only or never at night. Users can turn it off at any time from Control Center. Apple says the feature is designed to omit sensitive information, including government-assigned identifiers, financial and authentication data, certain personal identifiers, and language promoting self-harm.
The features run on the Apple Watch Series 12 and Apple Watch Ultra 4. They rely on the S11 chip, the built-in microphone, Apple Intelligence models on the iPhone and Apple's Private Cloud Compute. TechCrunch reported that raw audio is processed in a dedicated buffer inside a secure enclave, a hardware-protected memory space. Apple says that makes the audio inaccessible to anyone, including Apple. Only the paired iPhone can access it, through a secure pairing mechanism.
Lightweight models on the watch detect when the wearer is part of a conversation. The audio then goes to the iPhone, which turns it into condensed text with filler words removed. That text is encrypted and sent to Private Cloud Compute to generate the recap, and the recap and any summaries used to make it are deleted from the cloud immediately afterward. Recaps are encrypted when they sync across a user's Apple devices. Apple says the features should not affect battery life on the watch or phone.
What happens next
TechCrunch reported that the features will later reach the public beta for broader testing before becoming available to everyone. The source did not give a date for the full release.
