Skip to content

bodhi-realtime-agent / CartesiaTTSProvider

Class: CartesiaTTSProvider

Defined in: transport/cartesia-tts-provider.ts:48

Streaming TTS provider backed by the Cartesia WebSocket API.

Each requestId from synthesize() maps to a unique Cartesia "context". Text is buffered at sentence boundaries via SentenceBuffer before being sent to the API. Audio chunks arrive as base64-encoded PCM and are delivered through the onAudio callback.

Implements

Constructors

Constructor

new CartesiaTTSProvider(config): CartesiaTTSProvider

Defined in: transport/cartesia-tts-provider.ts:92

Parameters

config

CartesiaTTSConfig

Returns

CartesiaTTSProvider

Properties

onAudio()?

optional onAudio: (base64Pcm, durationMs, requestId) => void

Defined in: transport/cartesia-tts-provider.ts:87

Audio chunk ready for delivery to client.

Parameters

base64Pcm

string

Base64-encoded PCM audio chunk

durationMs

number

Duration of this chunk in milliseconds

requestId

number

The requestId from the synthesize() call that produced this audio

Returns

void

Implementation of

TTSProvider.onAudio


onDone()?

optional onDone: (requestId) => void

Defined in: transport/cartesia-tts-provider.ts:88

Synthesis completed for a request. Fired after the final audio chunk for the given requestId. VoiceSession uses this to gate turn completion.

Parameters

requestId

number

The requestId that has completed synthesis

Returns

void

Implementation of

TTSProvider.onDone


onError()?

optional onError: (error, fatal) => void

Defined in: transport/cartesia-tts-provider.ts:90

Error during synthesis. Non-fatal errors are logged; fatal errors trigger session close (fail-fast in V1).

Parameters

error

Error

fatal

boolean

Returns

void

Implementation of

TTSProvider.onError


onWordBoundary()?

optional onWordBoundary: (word, offsetMs, requestId) => void

Defined in: transport/cartesia-tts-provider.ts:89

Word-level timing for caption synchronization (optional). Providers that support word timestamps (Cartesia, ElevenLabs) fire this for real-time caption alignment on the client. NOTE: This is for timing metadata only, NOT for output transcription.

Parameters

word

string

The spoken word

offsetMs

number

Offset from the start of synthesis for this requestId, in milliseconds

requestId

number

The requestId this word belongs to

Returns

void

Implementation of

TTSProvider.onWordBoundary

Methods

cancel()

cancel(): void

Defined in: transport/cartesia-tts-provider.ts:211

Cancel any in-progress synthesis (best-effort). Called when the user interrupts (barge-in). Provider SHOULD stop generating audio as quickly as possible and clear internal buffers. Late-arriving audio chunks after cancel() are safe — VoiceSession filters them via requestId.

Returns

void

Implementation of

TTSProvider.cancel


configure()

configure(preferred): TTSAudioConfig

Defined in: transport/cartesia-tts-provider.ts:109

Called once before start(). Provider receives the preferred output format (derived from the transport's outputSampleRate) and returns the actual format it will produce. If the provider can emit at the preferred rate natively, it SHOULD do so to avoid resampling overhead.

Parameters

preferred

TTSAudioConfig

The ideal output format (sampleRate, bitDepth, channels)

Returns

TTSAudioConfig

The actual output format the provider will produce

Implementation of

TTSProvider.configure


start()

start(): Promise<void>

Defined in: transport/cartesia-tts-provider.ts:132

Open connection (WebSocket for streaming providers).

Returns

Promise<void>

Implementation of

TTSProvider.start


stop()

stop(): Promise<void>

Defined in: transport/cartesia-tts-provider.ts:141

Close connection and release resources.

Returns

Promise<void>

Implementation of

TTSProvider.stop


synthesize()

synthesize(text, requestId, options?): void

Defined in: transport/cartesia-tts-provider.ts:169

Synthesize text into speech. Called with text chunks as they arrive from the LLM. The provider decides internally whether to buffer for sentence boundaries or stream immediately.

Parameters

text

string

Partial or complete text from LLM response

requestId

number

Monotonic ID correlating this text to a specific turn/response. All onAudio/onDone callbacks for this text MUST carry the same requestId.

options?
flush?

boolean

If true, flush any buffered text to TTS now (does NOT mean end-of-request).

Returns

void

Implementation of

TTSProvider.synthesize

Built with VitePress