Live Transcribe Dual Screen

01 — About the product

What is Live Transcribe?

Live Transcribe captures speech and sound as text for d/Deaf and hard-of-hearing users. It’s Google’s most-used assistive tech, with about 2.5 million daily users.

02 — Problem

Transcription in conversation is awkward

The ergonomic experience breaks down mid-conversation: constant app switching to reply, and frequently turning the device so others can see the screen.

LIVE_TRANSCRIBE // DEVICE_ROTATION.LOG FRICTION: HIGH · 03 FINDINGS

Turn. Switch. Repeat.

> one screen cannot face two people

FRICTION_01 / DISRUPTION — □ ×

Transcribing a conversation on a single device felt awkward and disruptive.

FRICTION_02 / APP-SWITCH — □ ×

Users constantly switched apps to reply to what was transcribed.

FRICTION_03 / ROTATION — □ ×

The device was turned around again and again so the partner could read the screen.

ERGONOMIC_FRICTION_V1 · 2024 [ IGNORE ] [ SOLVE ]

03 — Solution

One device, two screens, no more turning

Deployed a text-to-speech experience optimized for dual-screen and foldable devices
Inside screen shows the live transcription and keyboard for typing a reply; outside screen mirrors the conversation and typed response for the other person to read
Added supporting controls: dual-screen toggle, show/hide text for privacy, voice selection, clear text, and primary/secondary language settings

Inside screen of Pixel Fold showing live transcription, typed reply, Dual Screen controls, and split keyboard

Inside screen — live transcription, typed reply, and split keyboard.

Outside screen showing the transcribed conversation and typed response for the other person to read

Outside screen — conversation mirrored for the other person to read.

First-run Dual Screen tour — tapping through privacy, speak, and delete tooltips

First-run tour — privacy, speak, and delete controls.

04 — Impact

Shipped with Pixel Fold

The dual-screen feature launched with Pixel Fold / Pixel Pro Fold (Aug 2024), a new take on accessibility across form factors. Live Transcribe became a shared conversational interface, not just a single-user tool.

Pixel Fold announcement of Live Transcribe Dual Mode

Pixel Fold — Dual Mode product announcement.

Google Keyword blog featuring Pixel accessibility updates

Highlighted in Google’s accessibility launch coverage (Aug 2024).

05 — Research

One device, no hand-offs

Partner research with Samsung showed how hard it is to use Live Transcribe on a single device. Users were juggling phones and handing devices around to keep conversations going.

“When I talk with others, I use Live Transcribe on the Galaxy and insert text on my iPhone to show others. It’s really hard to have a conversation with one device handing here and there.” — Research participant

Research insights

Users didn’t want to use multiple devices
Users don’t like handing their device to strangers
Users were relying on other apps for voice / text-to-speech

06 — Journey

Mapping the dual-screen experience

User journeys and IA work placed the feature where foldable posture made dual-screen mode discoverable — without disrupting core transcription.

Live Transcribe Dual Screen journey map with actions, tasks, feelings, and a sentiment graph

Dual Screen journey — start, conversation, typed reply, and spoken response.

Information architecture for home transcription and foldable controls

IA map — navigation, keyboard controls, and foldable entry points.

07 — Form factors

Considering Samsung Z Flip

Designs covered inside and outside screens, plus a modified version for Samsung Z Flip’s smaller real estate. A delete control let users clear text quickly.

Outside screen

Samsung Z Flip

08 — Iteration

From Foldable Mode to Dual Screen

The dual-screen UI evolved across two named versions, then a first-run tooltip tour so icon-only controls still made sense without cluttering the shipped UI.

PROJECT_LT // DUAL_SCREEN_ITER.LOG 03 PASSES

Design iterations

> foldable mode → dual screen → first-run tooltips

01VERSION 1

First design pass

TTS controls and an early “foldable mode” so users could type a reply the device spoke aloud for the person on the other side.

PASS_01 / FOLDABLE MODE — □ ×
02VERSION 2

Naming, privacy, consistency

With UX Writing and Marketing, naming moved from Foldable Mode to Dual Screen. Privacy visibility controls and icon-only actions landed next for consistency across form factors.

PASS_02 / DUAL SCREEN — □ ×
03TOOLTIPS

Teach without clutter

Icon-only controls needed context. A first-run tooltip sequence taught each control once, then the UI stayed clean.

PASS_03 / FIRST USE — □ ×

DUAL_SCREEN_ITER_V1 · 2024 [ LIVE TRANSCRIBE ]

09 — Lessons

What I carry forward

Stay aware of form-factor constraints while implementing
Speaking engineers’ language speeds the development process

First design pass

Naming, privacy, consistency

Teach without clutter

Have a problemworth solving?

Have a problem
worth solving?