Dograh
Experiments  /  TTS verbalization benchmark  /  chatterbox-turbo
Model · EXP-001

chatterbox-turbo

Ranked 4 of 7 on the TTS verbalization benchmark. Strongest on initialism or acronym, weakest on hashtag or mention.

At a glance
Said right49%share of all 1,080 sentences
Rank4 of 7among the seven models
Cost per clip1.06scomputing time per audio clip
Likely range46%–52%where the true score most likely sits
Strengths and weak spots

Where chatterbox-turbo does best and worst

Its five strongest and five weakest types of text, by the share of sentences it said right.

Best at
Initialism or Acronym
0.97
Ordinal
0.93
Stock Ticker
0.85
Sports score
0.82
Abbreviation
0.80
Breaks on
Hashtag or Mention
0.00
Fractions
0.03
Date
0.15
Geographic Coordinates
0.23
Address
0.25
A real miss

Hashtag or Mention: what chatterbox-turbo actually said

The text
Follow #GreenBreak for updates during the conference.
Should be said as
Follow hashtag green break for updates during the conference.
chatterbox-turbo said
"follow number green break for updates during the conference"
All 27 types

Every type of text, best to worst

The share of sentences chatterbox-turbo said right on each of the 27 types. Each type has 40 test sentences.

Initialism or Acronym
0.97
Ordinal
0.93
Stock Ticker
0.85
Sports score
0.82
Abbreviation
0.80
Vehicle or Product Code
0.78
Legal Reference
0.72
Currency
0.68
Cardinal
0.62
Decimal
0.62
Unit
0.53
URL or Email
0.50
Chemical Formula
0.45
License Plate or Serial Numbers
0.45
Time
0.45
Biological Classification
0.40
Mathematical Expression
0.40
Musical Notation
0.38
Phone Number
0.38
Roman Numeral
0.38
ISBN
0.28
Version Numbers
0.28
Address
0.25
Geographic Coordinates
0.23
Date
0.15
Fractions
0.03
Hashtag or Mention
0.00