DIGHT (DIGital Humanities Task) Survey
DIGHT attracts participants who are interested in exploring new tools, datasets and methods in digital humanities. The aim of this survey is to gauge the interest in and possible format of an unshared task to take place at DHBenelux 2018. This is an initiative of CLARIN, DARIAH and the DHBenelux 2018 organisers.

Our goal is to promote cross-disciplinary collaborations in the realm of digital humanities research through an unshared task. Shared tasks have a long history in computational disciplines, such as natural language processing where a shared annotated dataset is made available to the research community to test and compare their systems on. In an unshared task, no quantitative performance measures or clearly defined problems to be solved are present, rather the goal is to provide the community with a creative playground to test and exchange ideas. We think this task format may suit the very heterogeneous digital humanities community well and can invite input from historians, linguistics, ethnologists, GIS specialists, literature scientists and others to present their perspective and analyses on the same case.

This survey collects information from the wider research community concerning their interests in the tasks, datasets, challenges that could be offered in context of DIGHT. This unshared task will be defined on the basis of your feedback.

The survey should take 5-10 minutes depending on the detail with which you choose to respond.

We very much appreciate that you take the time to answer our questions. Note that in addition to collecting your feedback on potential tasks/challenges with this survey, we also hope to gauge what possible participants there would be for such a task. Expressing your interest in participating of course does not oblige you to do so.

Thank you for your interest and input.

Maria Eskevich, CLARIN-ERIC
Marieke van Erp, KNAW Humanities Cluster, DHBenelux local organiser
Vicky Garnett, Trinity College Dublin, DARIAH-EU

1. A few questions about you for us to get to know the community
1.1. What is your research field? (e.g. linguistics, history, social studies, …) *
Your answer
1.2. Would you consider yourself a digital humanist?
Your answer
1.3. Do you program yourself? *
Your answer
1.4. Whereabouts are you in your career? (PhD student, (postdoc) researcher, professor, developer, other) *
Your answer
1.5. Please enter your email address if you want us to contact you with follow-ups about the unshared task
Your answer
2. Overall benchmarking experience and expectations
2.1. For our record, please let us know whether you or your group has participated in any benchmarking evaluation tasks in the past? *
2.2. All in all, the (un)shared task type of event sounds to me *
Required
2.3. There are various formats an (un)shared task could take. Which of the following do you think suits your interests best?
2.4. How difficult would you rate this activity for you personally, or your group?
Easy to start with
Hard to get into
2.5. If you feel the task is too hard, please explain why and describe what could be done to make it more appealing. Is it the technical issue, new type of activity, other?
Your answer
2.6. How would you complete/change the above described format to better suit your opinion of an interesting (un)shared task activity?
Your answer
2.7. Do you have any suggestions to improve the task/format?
Your answer
3. Dataset(s) and tool(s) to work with
For the task we aim to make available a dataset concerning dialects, economic growth, travel journeys connected to some geographical location. Each researcher or research team can choose what kind of research questions and analyses they would like to take on with this data.

Potentially we consider the following datasets as options:

1. Prize Papers : http://www.brill.com/products/online-resources/prize-papers-online
2. Parliamentary corpora: https://office.clarin.eu/v/CE-2017-1019-Parliamentary-data-report.pdf
3. Computer - Mediated Communication: https://office.clarin.eu/v/CE-2017-1064-Resources-for-computer-mediated-communication.pdf
4. Parallel corpora: https://office.clarin.eu/v/CE-2017-1095-Parallel-corpora-report.pdf
5. Newspaper corpora: https://office.clarin.eu/v/CE-2017-1128-Newspaper-corpora.pdf

3.1. What do you think about the size/type of the mentioned above datasets?
3.2. What do you think about the content of the mentioned above datasets?
3.3. CLARIN and DARIAH have made available several tools/pipelines that may aid in getting started working with the data. Have you used these before? What other tools do you think could help the community in advancing digital humanities?
Your answer
4. Follow up comments and suggestions
4.1. If any additional comments, questions or suggestions about this task occurred to you while you were answering the detailed questions, it would be helpful if you could enter them here.
Your answer
4.2. Do you want to recommend any colleagues for us to contact to inform them of the opportunity to comment on this proposed unshared task (either because of their expertise or their potential interest or both)?
Your answer
Submit
Never submit passwords through Google Forms.
This content is neither created nor endorsed by Google. Report Abuse - Terms of Service - Additional Terms