论文标题
针对基准：关于当前自然语言处理研究的方法论
Targeting the Benchmark: On Methodology in Current Natural Language Processing Research
论文作者
论文摘要
它已成为我们领域的一种常见模式：一个组引入了一个语言任务，以数据集为例，他们认为这足以充当基准。他们还为其提供了基线模型，然后很快就会由其他小组改进。通常，研究工作继续前进，模式会重复。通常，隐含的是关于为什么构成进步并朝着什么进步的论点。在本文中，我们试图从这种模式中退后一会儿，并提出可能的论点及其部分。
It has become a common pattern in our field: One group introduces a language task, exemplified by a dataset, which they argue is challenging enough to serve as a benchmark. They also provide a baseline model for it, which then soon is improved upon by other groups. Often, research efforts then move on, and the pattern repeats itself. What is typically left implicit is the argumentation for why this constitutes progress, and progress towards what. In this paper, we try to step back for a moment from this pattern and work out possible argumentations and their parts.
