Common Voice Scripted Speech 23.0 - Toki Pona

Specifics

Licensing

CC0-1.0

https://creativecommons.org/publicdomain/zero/1.0/legalcode

Considerations

Restrictions/Special Constraints

You agree that you will not re-host or re-share this dataset

Forbidden Usage

You agree not to attempt to determine the identity of speakers in the Common Voice dataset

Processes

Intended Use

This dataset is intended to be used for training and evaluating automatic speech recognition (ASR) models. It may also be used for applications relating to computer-aided language learning (CALL) and language or heritage revitalisation.

Metadata

toki pona — Toki Pona (`tok`)

This datasheet has been generated automatically, we would love to include more information, if you would like to help out, get in touch!

This datasheet is for version 23.0 of the the Mozilla Common Voice Scripted Speech dataset for Toki Pona (tok). The dataset contains 19221 clips representing 23 hours of recorded speech (16 hours validated) from 170 speakers.

Demographic information

The dataset includes the following distribution of age and gender.

Gender

Self-declared gender information, percentage refers to the number of clips annotated with this gender.

Gender	Pertentage
Undefined	41.0%
Male Masculine	52.0%
Female Feminine	5.0%
Do Not Wish To Say	3.0%

Age

Self-declared age information, percentage refers to the number of clips annotated with this age band.

Age Band	Percentage
Undefined	31.0%
Twenties	19.0%
Thirties	6.0%
Teens	21.0%
Eighties	23.0%

Data splits for modelling

The official data splits for modelling this language are as follows. Of the validated clips, 55.09% are included in the splits.

Split	Count
Train	2635
Test	2248
Dev	2251

Text corpus

The text corpus contains 9744 sentences, of which 7498 are validated, 2246 are invalidated and 165 are reported.

Sample

There follows a randomly selected sample of five sentences from the corpus.

mije lili li awen lon suno pi mun lili lon len pi pimeja tomo.
nimi pi soweli sina li seme?
sina ken ala awen lon ni.
lupa lili li lon len ilo pi lupa lukin.
kalama suwi la, mi mute li pana e pona ali tawa nimi sewi.

Text domains

Domain	Count
Undefined	19219
Finance	2
General	2

Fields

Each row of a tsv file represents a single audio clip, and contains the following information:

client_id - hashed UUID of a given user
path - relative path of the audio file
text - supposed transcription of the audio
up_votes - number of people who said audio matches the text
down_votes - number of people who said audio does not match text
age - age of the speaker1
gender - gender of the speaker1
accent - accent of the speaker1
segment - if sentence belongs to a custom dataset segment, it will be listed here

Community links

Contribute

Licence

This dataset is released under the Creative Commons Zero (CC-0) licence. By downloading this data you agree to not determine the identity of speakers in the dataset.

Footnotes

For a full list of age, gender, and accent options, see the demograpics spec. These will only be reported if the speaker opted in to provide that information. ↩ ↩2 ↩3