Feedback form on Subtitling at European Language Grid and Serbian Language Technologies 2022

JavaScript isn't enabled in your browser, so this file can't be opened. Enable and reload.

Thank you for helping us in improving speech recognition and speech translation technology.
We would be grateful for your feedback on our activities, even if you have not really tested the system during the online ICTI Task Force - Workshop on Speech recognition.

What is your mother tongue?

Language(s) you checked out:

English

Czech

Albanian

Arabic

Armenian

Azerbaijani

Belorussian

Bosnian

Bulgarian

Croatian

Danish

Dutch

Estonian

Finnish

French

Georgian

German

Greek

Hebrew

Hungarian

Icelandic

Irish

Italian

Kazakh

Latvian

Lithuanian

Luxembourgish

Macedonian

Maltese

Moldovan

Montenegrin

Norwegian

Polish

Portuguese

Romanian

Russian

Serbian

Slovak

Slovene

Spanish

Swedish

Turkish

Ukrainian

How many languages were you watching at the same time?

More than 4

Clear selection

How much time have you spent with the demo in total?

None at all.

I played around with it for a minute or two.

2-5 minutes

5 or more minutes

I watched it all the time.

Clear selection

General preferences

Please indicate your preferences.

Which type of automated translation is more important for you in general?

Speech transcription and translation in real time (the one shown today)

Automated translation of documents (not shown today)

Clear selection

Which form of speech translation would seem more practical for you?

Subtitles (more space left for the slides/video)

Longer paragraphs (the one shown today; more of past output accessible)

Clear selection

Speed/precision trade-off

I prefer partial translation in shorter time.

I prefer to wait a little longer and get more precise output.

Clear selection

Questions on transcription and translation quality and usability

Please comment on the experience today.

Most annoying English errors

If you had a chance to follow English transcription for a little while, what were the most annoying errors?

No transcription; nothing was shown when I had the chance to look at it

Disturbing or annoying words (swearwords and similar)

Distracting or laughable words

Transcription too much delayed after the speaker

Text was scrolling too fast to read it

Too much text to read

Transcription overall incomprehensible, garbage

Other:

Most annoying errors in translation into the languages you followed.

If you had a chance to follow translation in your mother tongue for a little while, what were the most annoying errors?

No translation; nothing was shown when I had the chance to look at it

Disturbing or annoying words (swearwords and similar)

Distracting or laughable words

Translation too much delayed after the speaker

Text was scrolling too fast to read it

Too much text to read

Translation overall incomprehensible, garbage

Other:

Given your English skills what type of assistance would be most useful for you?

None: When all speak English as well as they did here, transcription and translation cannot help.

None: I find the transcription and translation only distracting, even when they are correct.

English: Correct English transcription would be useful, e.g. if I miss something, to scroll back.

Mother tongue: Having translation in my mother tongue would be useful to support me in understanding.

Other:

Clear selection

If the main meeting was not held in English but a language you do not speak, what type of assistance would be most useful?

None: I know I could not follow written transcript (even if flawless), I need interpretation to headphones.

None: I am afraid that the system will miss too many important pieces of information.

English: I expect English to be of the best quality and I can easily follow it.

Mother tongue: I would prefer translation in my mother tongue, following English would be harder for me.

My choice: I would like to be able to select one or more languages on the spot.

Other:

Clear selection

Focus on Names, Abbreviations and Key Terms

During this session, we were testing a variant of the system which allows to manually improve the recognition (but not yet translation) of *names*, *abbreviations* and *key terms* in some conditions. Could you help us evaluate this aspect? Let's denote all of them collectively *focus elements*.

Importance of Names, Abbreviations and Key Terms Recognition

Please choose where you agree most. "Focus elements" means collectively names, abbreviations and key terms.

Not too important: Speech recognition quality was overall at the same level; focus elements do not stand out as particularly problematic.

Important: Improvements in the recognition of focus elements would substantially improve the overall impression.

Critical: The recognition of focus elements is often bad, to the extent that the output is useless given these errors.

Clear selection

Hot Fixes

We were manually fixing recognition of problematic focus elements on the fly. Did you notice?

No, all the focus elements were either recognized correctly or incorrectly all the time.

Unsure, my impression of the recognition quality varied in time, I did not see any trend.

Yes, I noticed improvements in this area during individual presentations.

Clear selection

Names, abbreviations or key terms you saw misrecognized

Please list the words or expressions that you remember you saw misrecognized (in English). Write primarily the correct form; you may list also the wrong version you saw if you remember.

Names, abbreviations or key terms you saw mistranslated

Please list the words or expressions that you remember you saw mistranslated (into the language you were observing). If possible, try to separate mistranslation from misrecognition. (A misrecognized term is almost guaranteed to lead to a wrong translation. We are particularly interested in cases where the recognition was correct but the translation was wrong.) Write primarily the correct form; you may list also the wrong version you saw if you remember.

Surprising Recognition Successes

Please list the words or expressions that you remember you saw correctly recognized in English. We are curious esp. about the "wow" effect you hopefully might have experienced when seeing a "really tough term or name" correctly recognized.

Surprising Translation Successes

Please list the words or expressions that you remember you saw correctly translated into the language you were watching. We are curious esp. about the "wow" effect you hopefully might have experienced when seeing a "really tough term or name" correctly expressed in your language.

Final comments

Any other general benefits that automatic transcription or translation could provide to you?

Critical conditions needed for this to be useful

Please write as many ideas as you can: what has to be met so that live translation and translation is useful in practice for you or in general? (In what circumstances such as language knowledge, presence/connection setup, topics discussed etc. and under what technological conditions such as quality and timeliness of output, space for outputs, etc.)

Do you have any other comments or suggestion for us?

Submit

Clear form

Never submit passwords through Google Forms.

This content is neither created nor endorsed by Google. Report Abuse - Terms of Service - Privacy Policy

Forms