Dograh
Experiments  /  TTS verbalization benchmark  /  chatterbox-multilingual
Model · EXP-001

chatterbox-multilingual

Ranked 6 of 7 on the TTS verbalization benchmark. Strongest on stock ticker, weakest on url or email.

At a glance
Said right25%share of all 1,080 sentences
Rank6 of 7among the seven models
Cost per clip2.40scomputing time per audio clip
Likely range23%–28%where the true score most likely sits
Strengths and weak spots

Where chatterbox-multilingual does best and worst

Its five strongest and five weakest types of text, by the share of sentences it said right.

Best at
Stock Ticker
0.85
Initialism or Acronym
0.82
Ordinal
0.70
Abbreviation
0.62
Time
0.62
Breaks on
URL or Email
0.00
Mathematical Expression
0.00
ISBN
0.00
Hashtag or Mention
0.00
Geographic Coordinates
0.00
A real miss

URL or Email: what chatterbox-multilingual actually said

The text
Send the completed form to http://www.granite.dev before Friday.
Should be said as
Send the completed form to h t t p colon slash slash w w w dot granite dot dev before Friday.
chatterbox-multilingual said
"send the completed form to http:aholfongranet dev before friday"
All 27 types

Every type of text, best to worst

The share of sentences chatterbox-multilingual said right on each of the 27 types. Each type has 40 test sentences.

Stock Ticker
0.85
Initialism or Acronym
0.82
Ordinal
0.70
Abbreviation
0.62
Time
0.62
Chemical Formula
0.50
Sports score
0.38
Unit
0.38
Musical Notation
0.33
Vehicle or Product Code
0.28
Legal Reference
0.25
Biological Classification
0.20
Version Numbers
0.20
Date
0.17
License Plate or Serial Numbers
0.17
Roman Numeral
0.15
Cardinal
0.12
Address
0.05
Currency
0.03
Fractions
0.03
Phone Number
0.03
Decimal
0.00
Geographic Coordinates
0.00
Hashtag or Mention
0.00
ISBN
0.00
Mathematical Expression
0.00
URL or Email
0.00