2017

Attention Is All You Need

The Transformer, a sequence transduction model that replaces recurrent layers and relies entirely on attention mechanisms, achieves new SotA on machine translation tasks while reducing training time significantly.

Intuitive Physics: Current Research and Controversies

Recent research in intuitive physics, guided by knowledge-based and learning-based approaches, shifts to a probabilistic simulation framework that better explains human intuitive physics predictions compared to earlier heuristic models.

Automated Curriculum Learning for Neural Networks

Investigates automatically generating curricula based on a variety of progress signals that are computed for each data sample.