Facebook’s DeiT paper explained in 5 minutes

Facebook AI announced a new technique for image classification called DeiT to train computer vision models. They achieved 84.2 top-1 accuracy on the ImageNet benchmark without using any external training data for training.

It’s competitive with the performance of cutting-edge CNNs, which have been the dominant approach to image classification for many years.

Wait a second. What is CNN? And what is DeiT? :point_down:

3 Likes