Minimally Formatted Text
The ASR hypothesis includes both formatted text and minimally formatted text.
By default, the tool uses the formatted text field when comparing the predicted transcription to the reference transcription from the truth file (see Formatting Options for information about configuring formatted text output).
If you would like to use the minimally formatted text instead, you can do so by setting the score_against_mft
parameter to true
in the asr
section of your config file:
...
"asr": {
"topic": "GEN",
"dlm_weight": 0.2,
...
"score_against_mft": true,
...
}
...
Which option you choose should depend on how your reference transcriptions in the truth file are formatted.
Note that this does not effect NLU evaluation when running an ASR+NLU test (the ASR result object itself is still passed directly to NLUaaS).