Calculate correct input length for every prompt in a single batch

[kira-lin]

After #209 closes, consider to calculate correct input length for every prompt in MultiplePromptInput, as well as generated tokens.

torch.sum(input_ids == tokenizer.pad_token_id, dim=0).tolist()

Doing so can remove pad tokens when calculating benchmark results.