论文标题
众包多字表达式的相对排名：专家与非专家
Crowdsourcing Relative Rankings of Multi-Word Expressions: Experts versus Non-Experts
论文作者
论文摘要
在这项研究中，我们调查了哪些程度专家和非专家在众包实验中就难度问题达成共识。我们询问非专家（瑞典语的第二语言学习者）和两组专家（瑞典语作为第二/外语的教师和CEFR专家）在众包实验中对多字表达式进行排名。我们发现，所有三个测试组的结果排名都非常高，这表明在比较环境中产生的判断不受专业见解作为第二语言的专业见解的影响。
In this study we investigate to which degree experts and non-experts agree on questions of difficulty in a crowdsourcing experiment. We ask non-experts (second language learners of Swedish) and two groups of experts (teachers of Swedish as a second/foreign language and CEFR experts) to rank multi-word expressions in a crowdsourcing experiment. We find that the resulting rankings by all the three tested groups correlate to a very high degree, which suggests that judgments produced in a comparative setting are not influenced by professional insights into Swedish as a second language.
