Currently, when you calculate BLEU with different max_ngram_order's and everything the same, they will have the same signature when you use bleu_metric.get_signature().format(short=True). Something like #:1|c:mixed|e:no|tok:13a|s:exp|v:2.3.1. Should an argument be added to the signature to specify the max ngram order, like with ChrF where both nc and nw are specified?
If you agree I can do a PR.