All guides

Talking to your agents

Hold the talk key and speak. SimpleEdit puts the text where your cursor is: a text field, an edit box over a terminal, or a new Review Room comment. Voice never sends anything on its own.

whisper.cpp transcribes on your computer. The audio is deleted as soon as the text is ready.

1. Set up whisper.cpp

In Settings → Voice, the Transcription section shows whether whisper.cpp and a model are set. You need both.

Quick way: select Set up with an agent. An agent session starts in your last project window. It installs whisper.cpp and downloads a model once you agree, proposes the model for you to approve, and has you try a sentence. If your language comes out wrong, it offers a larger model. It ends by telling you how to remove whisper.cpp again.

Manual way:

  1. Install whisper.cpp. On a Mac, brew install whisper-cpp does it. SimpleEdit looks for the whisper-cli command.
  2. Download a model file.
  3. Select Choose model… (Change model… once one is set) and pick the file. Select Re-check if you installed whisper.cpp while the pane was open.

Settings → Voice with the talk key set to Right Option, and whisper.cpp and a model both found

SimpleEdit detects the language you speak. Models whose name ends in .en understand English only. For any other language, use ggml-base.bin, or ggml-large-v3-turbo.bin for better accuracy.

The phone uses the same setup (Your agents on your phone). On a Mac, if you refused microphone access, allow it in System Settings → Privacy & Security → Microphone.

2. Hold the talk key

The talk key is Right Option on a Mac and Right Alt on Windows and Linux.

Click where the text should go, hold the key on its own and speak. A bar at the bottom of the window says Listening and where the text will go. Let go: it says Transcribing, then the text appears.

A terminal session with the Listening bar at the bottom of the window

Change the talk key

In Settings → Voice, select Change… and press the key you want. A modifier key or a function key works. Keys that type a character or that you need for editing (Enter, Tab, Esc, the arrows) can’t be the talk key. Change it if another dictation app, such as Superwhisper, uses that key. Use Right Option (Use Right Alt) brings back the default.

3. Where your words go

What has focus when you press the key decides.

A text field. The text goes in at the cursor, in every text field: the ⌘I composer, comment and reply boxes, the prompt editor and the rest.

A terminal. An edit box opens over the bottom of the terminal, headed Dictated for ‹terminal›. Read and fix the text there, then:

The edit box over a terminal, holding the dictated sentence "Run the late fee tests and show me only the failures." with Send, Paste and Discard buttons

The Send, Paste and Discard buttons do the same. Speak again while the box is open to add to it. Each terminal keeps its own box, so dictating into another session leaves an unsent box alone.

Nothing focused. The bar shows what you said with a Copy button. If a field disappears while its text is being transcribed, the text shows up here too.

4. Speak a comment in the Review Room

In a Review Room, with no text field focused, what you say becomes a comment on the code. Point at a line with the mouse, or select some lines, and say what you think: “Is this right? The limit should be inclusive.”

The Review Room with the Listening bar while the mouse points at a line of late-fees.ts

SimpleEdit opens the new-comment box there with your words in it. Nothing goes to the Companion, the author or GitHub until you pick the recipient and send it. Enter sends, Shift+Enter starts a new line, Esc cancels.

A new-comment box on line 29 of late-fees.ts, prefilled with the spoken question "Does dividing by 365 undercharge interest in leap years?"

You can also name the place instead of pointing. The place you name is left out of the comment. English and German both work (“Zeile 40”, “der PR”).

When the spot is unclear

If SimpleEdit isn’t sure which line you mean, the bar asks Where should this go? It shows up to four lines, each with a number, and As a whole for the whole change.

The Where should this go? bar for a remark about the late-fee rate: choice 1 is line 13 of late-fees.ts, choice 2 the README line the mouse points at, choice 3 As a whole

It also asks when you point at one line but name another, such as “This duplicates line 45”. Say the place first to avoid it: “Line 45, is this right?” A decision model, if set up, puts the likeliest line first. It never picks for you.

If something goes wrong