Dataloader missing temporal dimension?

I'm using the Charades dataset class in charadesrgb.py to construct a Dataset object and then feeding it into a Dataloader. However, it seems like the mini-batches returned by my Dataloader are of dimension BxCxHxW (missing the temporal T dimension). 

Is this the expected behavior? Or am I using this incorrectly?