The dataset is privately downloadable. Below is a link to the team's website and paper. http://movieqa.cs.toronto.edu http://movieqa.cs.toronto.edu/static/files/CVPR2016_MovieQA.pdf