Facebook AI announced a new technique for image classification called DeiT to train computer vision models. They achieved 84.2 top-1 accuracy on the ImageNet benchmark without using any external training data for training.
It’s competitive with the performance of cutting-edge CNNs, which have been the dominant approach to image classification for many years.
Wait a second. What is CNN? And what is DeiT?