论文标题
一击机教学:花费很少的示例来更快地收敛
One-shot Machine Teaching: Cost Very Few Examples to Converge Faster
论文作者
论文摘要
人工智能是教机器像人类一样采取行动。为了实现智能教学,机器学习社区成为了一个有前途的主题,名为机器教学的有前途的主题,教师将在其中设计目标模型和特定学习者的最佳(通常很少)教学集。但是,以前的作品通常需要许多教学示例以及大型迭代来指导学习者融合,这是昂贵的。在本文中,我们考虑了一个更智能的教学范式,名为单发机器,该范式的成本更少才能更快地收敛。与典型的教学不同,这种高级范式从教学集到模型参数建立了可拖动的映射。从理论上讲,我们证明了该映射是汇总的,它可以保证最佳的教学集。然后,依靠从教学集到参数的汇总映射,我们制定了在适当设置下设置的最佳教学的设计策略,其中两个流行的效率指标,教学维度和迭代教学维度是一个。广泛的实验验证了我们战略的效率,并进一步证明了这种新教学范式的智能。
Artificial intelligence is to teach machines to take actions like humans. To achieve intelligent teaching, the machine learning community becomes to think about a promising topic named machine teaching where the teacher is to design the optimal (usually minimal) teaching set given a target model and a specific learner. However, previous works usually require numerous teaching examples along with large iterations to guide learners to converge, which is costly. In this paper, we consider a more intelligent teaching paradigm named one-shot machine teaching which costs fewer examples to converge faster. Different from typical teaching, this advanced paradigm establishes a tractable mapping from the teaching set to the model parameter. Theoretically, we prove that this mapping is surjective, which serves to an existence guarantee of the optimal teaching set. Then, relying on the surjective mapping from the teaching set to the parameter, we develop a design strategy of the optimal teaching set under appropriate settings, of which two popular efficiency metrics, teaching dimension and iterative teaching dimension are one. Extensive experiments verify the efficiency of our strategy and further demonstrate the intelligence of this new teaching paradigm.