SonicAIR: Supporting independent living with reciprocal ambient audio awareness

Authors: Hanif Baharin, Stephen Viller, Sean Rintel
Venue: ACM Transactions on Computer-Human Interaction, 2015

AThe study

Technology probe field study with five people in two pairs of homes, aged 60 to 79 plus a daughter in her 30s. Each deployment of SonicAIR linked two kitchens by sound for five to six weeks.

  1. Two pairs of homesTwo friends, then a new pairing after one had a fall, and a mother and daughter.
  2. Five to six weeksSonicAIR ran in each pair of homes for five to six weeks.
  3. Interviews and diariesData came from about a dozen interviews, diaries, some home visits, a researcher logbook and sensor logs.
  4. Close readingThe researchers looked for revealing examples of use rather than measured outcomes.

BThe tool

  1. Sense kitchen activitySwitches on appliance doors, drawers and cabinets detect when they are opened.
  2. Send a codeA box in the kitchen posts a code for the activity to a private online feed.
  3. Play a matching soundThe box in the partner's home reads the feed and plays a matching recorded sound.
  4. Work both waysOpening a fridge in one home plays a sound in the other kitchen, and vice versa. There is nothing to operate.

There is no live audio, to ease fears of surveillance. Some sounds were later prefaced with short tones or replaced with soft bells, so people would not confuse them with sounds at home.

CWhat the study found

Learning the soundsthe first days of each deployment

  • Participants first had to learn that the sounds came from the device, not their own home.One participant put the sounds down to possums. All participants reached a moment of mutual awareness after a few days.

Hearing each other's dayhow participants made sense of the sounds

  • Participants described attending to rhythms and patterns of sound more than single sounds.Participants combined these patterns with what they knew of each other to tell stories of everyday life, such as a meal being made.
  • No participant reported checking whether these stories were true.Being able to create the stories mattered more than accuracy. The authors note that misread stories are a risk where wellbeing is at stake.

Acting for each otherchanges participants made because of the link

  • Three of the five participants changed kitchen habits so as not to disturb their partner.One example was not heating milk late at night.
  • The mother and daughter triggered sounds in reply, a playful way of saying 'I'm here'.The friend pairs did not play back in this way.
  • In the second pair of friends, each sometimes took the other's sounds as a cue to act.Each might get up or make a drink without signalling back. The authors consider this the most interesting finding for independent living.

DKey takeaway

Ambient sound that trades kitchen activity between the homes of older people living alone can foster a reciprocity of perspectives. People may hear each other's daily rhythms, build comforting stories and adjust habits out of care.

Made for this site with AI assistance from the verified research brief. It is not the paper's own figure.

Abstract

SonicAIR is an ambient awareness technology probe designed to explore how connecting the soundscapes of friends or family members might reduce the isolation of seniors living independently. At its core, SonicAIR instruments kitchen activity sites to produce an always-on real-time aural representation of remote domestic rhythms. This paper reports how users in two pilot SonicAIR deployments used the sounds as resources for recognizing comfortable narratives of sociability. Used alongside telecare monitoring, such technologized interaction might enable older people to engage in community-oriented soundscape narratives of shared social responsibility.

Research brief

By Hanif Baharin, Stephen Viller, and Sean Rintel.

Takeaway: Sharing everyday rhythms could ease the isolation of older people living alone. When kitchen activity in one home played as sounds in a friend's or relative's home, people heard routines rather than single sounds. They built comforting stories about each other and sometimes adjusted their own behaviour out of care.

Why this matters

What was known
Strong social ties benefit seniors' health, but independent living can slide into isolation. Ironically, this isolation may be exacerbated by telecare technologies that support independent living and decrease healthcare costs associated with ageing populations (§1, p. 2)
What this paper adds
A reciprocal, always-on audio awareness probe deployed in seniors' homes, linking each person's kitchen to a friend's or daughter's. Rather than evaluating the viability of SonicAIR, we were interested in participants' accounts of how individual signals generated by actions from the remote other were learned as resources for social understandings. (§1, pp. 1–2)
Who it matters to
Designers of ambient awareness and sonification systems, and those providing telecare and support for older people living independently. we argue that, in the future, ambient awareness technology could be installed alongside telecare and make use of existing infrastructure that enables remote monitoring (§7, p. 19)

Research question

Method and data

Design
Technology probe field study with two pilot deployments of SonicAIR (see Prototype).
Prototype
SonicAIR (Sonic Atomic Interaction Radio): a pair of linked boxes, one in each home's kitchen. Magnetic reed switches on appliance doors, drawers and cabinets detect when they are opened. Each box (a Mac Mini with an Arduino board and a 3G modem) posts a code for the activity to a private Twitter feed. The box in the partner's home watches that feed and plays a matching recorded sound, so opening your fridge plays a sound in your partner's kitchen, and vice versa. There is no live audio, to save bandwidth and ease fears of surveillance, and nothing for users to operate. Sounds began as recordings of the actual action. For participants who confused these with sounds in their own home, they were prefaced with short musical tones (earcons) or replaced by suggestive sounds such as soft bells. It was not compared with another system.
Photo of a SonicAIR unit on a kitchen bench: a small white enclosure with two speakers on top and wires running to sensors, next to a spice rack and coffee machine.
Fig. 2. SonicAIR deployed. From the paper, Fig. 2, p. 7.
Setting
Pairs of homes: a pair of friends (Lucy with Janet, then with Mary after Janet had a fall) and a mother-daughter pair (Roseanne and Josephine).
Participants / data
Five people, three dyads in two pairs of homes. Participants aged 60 to 79, plus a daughter in her 30s.
Duration
Each deployment lasted a total of five to six weeks.
Analysis
Qualitative analysis of participant interviews (a dozen sessions), participant diaries, some in-home observation, researcher logbook and Twitter logs of sensor events, looking for perspicuous examples rather than generalisable uses or measurable evaluations.

Findings

Questions this paper answers

Can hearing a relative's kitchen sounds make older people living alone feel connected?
Yes, in a lean way. When older people's kitchens were linked by sound with a friend's or daughter's for five to six weeks, they soon heard the sounds as the other person, not just noises. They built comforting stories of each other's routines. (See §5.1, p. 15; §4.2, p. 11; §5.2, p. 16.)
Do people need to know exactly what each awareness sound means?
Mostly not. When five people's kitchens were linked by sound with a friend's or relative's for five to six weeks, all but one paid little attention to which sound meant which action. The timing and rhythm of sounds, combined with what they knew about each other, carried the meaning. (See §4.2, p. 11; §5.2, p. 16.)
Does being connected by ambient sound change people's behaviour at home?
It can. Hearing a partner's routine made people consider their own. Among five people whose kitchens were linked by sound, three changed habits to avoid disturbing their partner. Two friends sometimes took a partner's activity as a prompt to make a drink or get up. (See §4.3, pp. 12–13; §4.5, p. 14.)
Does ambient sound make people feel they are living together?
No. People talked about the sounds they triggered as if present in the other's home, but said they did not feel they were living with their partner. The link felt like two lives running in parallel, not an illusion of being together. (See §5.1, p. 15; §4.2, p. 11.)

Contributions and implications

Limitations

›

Concepts

Phatic technology
The design tradition SonicAIR belongs to: Phatic technologies are those designed to sustain remote relationships between noncolocated parties by affording lightweight reciprocal communication in which the fact of exchange itself is more important than the quality or quantity of information exchanged (§2.1, p. 2)
Reciprocity of perspectives
A central idea of ethnomethodology, from Schutz via Garfinkel: actors engaged in coordinated actions with others will assume the socially standardized and shared nature of their knowledge and will seek actively, if unconsciously, to sustain it (§2.1, p. 3)
Technologized interaction
The lens we use: Technologized interaction refers to communication in which users treat technology as materially framing but not causally determining social action. (§2.1, p. 3)
Earcons
One of the sound types SonicAIR used, alongside denotative samples (recordings of the actual sound) and connotative samples (realistic sounds that suggest the action): Earcons are the representation of information using abstract musical sounds (§3.1, p. 6)

Figures

Photo of a SonicAIR unit on a kitchen bench: a small white enclosure with two speakers on top and wires running to sensors, next to a spice rack and coffee machine.
Fig. 2. SonicAIR deployed. From the paper, Fig. 2, p. 7.
Two linked homes, A and B, each with a SonicAIR speaker wired to a microwave and fridge. Using an appliance in one home plays an auditory icon in the other.
Fig. 3. SonicAIR process scenario. From the paper, Fig. 3, p. 7.

How to cite

Hanif Baharin, Stephen Viller, and Sean Rintel. 2015. SonicAIR: Supporting independent living with reciprocal ambient audio awareness. ACM Transactions on Computer-Human Interaction 22 (4). https://doi.org/10.1145/2754165

This brief was prepared with AI assistance and published by Sean Rintel. It is not the authors' published text. Page numbers refer to this PDF.

BibTeX

@article{baharin2015sonicair,
author = {Baharin, Hanif and Viller, Stephen and Rintel, Sean},
title = {SonicAIR: Supporting independent living with reciprocal ambient audio awareness},
year = {2015},
month = {July},
url = {https://doi.org/10.1145/2754165},
journal = {ACM Transactions on Computer-Human Interaction},
volume = {22},
number = {4},
doi = {10.1145/2754165},
}