In this paper, we investigate strategies to accelerate CNNs designed for the JPEG compressed domain. The starting point for our study is a state-of-the-art CNN proposed by Gueguen et al. [1], which is a modified version of the ResNet-50 [2]. However, the changes introduced by Gueguen et al. [1] in the ResNet-50 raised its computational complexity and number of parameters. To alleviate these drawbacks, Santos et al. [3] proposed to feed the network with the lowest frequency DCT coefficients, thus losing image details irretrievably. Here, we explore smart strategies to reduce the network computation complexity without sacrificing rich information provided by the DCT coefficients.
We conducted experiments on the ImageNet dataset, both in a subset and in the whole. Our results on both datasets showed that learning how to combine all DCT inputs in a data-driven fashion is better than discarding them by hand. Also, we found that skipping some stages of the network is beneficial, proving to be effective for re...