I-Frame Detection Issue in MP4 Files

[myselfishani2]

For some exported MP4 files, the framework correctly identifies I-frames (NAL type 5) and signs the GOPs successfully.

For other MP4s , the framework fails to detect I-frames.

Extracted NAL unit logs confirm the presence of valid SPS (type 7), PPS (type 8), and IDR (type 5) NAL units.
The logs and the mp4 files are in the drive link.
(https://drive.google.com/drive/folders/16d1KveCwIH6EhNbpx1OTAugu4wFfymHH?usp=drive_link)

[myselfishani2]

In cases where the signing completes successfully, the validation step still reports the video as invalid, even though the file has not been tampered with and the public key verification passes. The validation test results are in the drive link.

[srivikramanm]

@bsriramprasad Could you ask @bjorn.volcker@axis.com to help here?

[bsriramprasad]

@bjornvolcker for your kind attention

[bjornvolcker]

I'll see if I can get some time to look at this today Wednesday or tomorrow Thursday

[bsriramprasad]

@myselfishani2 Please comment if this is an issue different to what's been discussed in mail thread, If it same issue, I would suggest you to update the ticket with the debug logs presented, so that Björn response can also be captured here for future reference and helps other member companies, better than in mail chain.

[myselfishani2]

We are already passing the SPS/PPS NAL units separately — they are not included with the IDR (I-frame) in our implementation.

[myselfishani2]

This is the signing debug. I am currently testing it on https://drive.google.com/drive/folders/1y7BI5XTqRlOePDiQIgnHnIw8Ngve2Hh2?usp=drive_link
h264parse
DEBUG: Creating media signing from code version v1.0.2
DEBUG: Setting hash algo sha256 that has ASN.1/DER coded OID length 11
DEBUG: This NAL Unit (type PPS/SPS/VPS) was not hashed
Hash of P (primary): ec31ee5b8ae1f747b1d65fbad395dd4100fc81a3afb03d6c1500ca6788fac05f
Hash of P (primary): ee6e3212137c2db5a940ff0b6a8c0b6f89444046561c0bc40d4f21376b42b073
Hash of P (primary): 712ba2a2a49c186fa52d23631768d0aa443e9c57cc00a4ac0ab5b90f2b6a289c
Hash of P (primary): a3b92f87c5eb81f0af486461aedcfe44242ed8d0047634f242a74d865c925986
Hash of P (primary): 9664f0980fe78fa8d7c61bdc7637e519db9745cf5e28a98e9718c705452ae067
Hash of P (primary): 981975a13470d9d1bd105338e8a20ec2f86d0f86ef53fd626068ae9f03db318f
Hash of P (primary): 8490da99b16ecc8c29c46f6a2cf02851e5ea7b480deda88c7477f8df3a81a811
Hash of P (primary): 31fb65b19737d47ef94120dac8a0474ff49d65fde11802e8192f17b5378dd123
Hash of P (primary): 749f979367b31d5b5587bdecbabbcb81a9e07a8a3a0c24e573a2f26ef9f5a21d
Hash of P (primary): 30753dcfabdd17627f254beaa0c993749baf887fe95df4835ea3a4638c3da431
Current (partial) GOP hash: 28cc4b3d181e0c6fe0fd61ba18f948a9df22d1d451bbb99050db8c62dae73f80
Hash of I (primary): 4b02366ae9518b15bef9beebde063f6f794356a0351ff5d97ae53a934ec29f92
Hash of P (primary): 92fdbf997502d6252bb27269109a4a1994c3304e78b8d7845a05e8ea03d4c357
Hash of P (primary): fd82e114328f1f100de23b1ee281c48fb84991fb3fb4cbe076291d972daee220
Hash of P (primary): 6824e5463277317c6289fda9e0baa9a908fca0a41e3914be4d8cf678273102e7
Hash of P (primary): d5990615fafe58a0ea86b65be4053f71f896e08bc9c8ff0bbc5887ca66c0d745
Hash of P (primary): 190e508d138728da664847876bb000359518885ee21f01897aca434be89d70e1
Hash of P (primary): cf5fda35fd001a7652e50066f73c285ce703a49b8f96b4b47f12fb66724ffdbc
Hash of P (primary): 7c7e4d43331ae4986b79b39b538791a02643868cc937e1ce08ee0eed02293ba1
Hash of P (primary): 7e0973da163d3c5e7005d41447eb88caeda9bde22b655cce184508f6b3cfa56f
Hash of P (primary): b8db9e5a9e379871546d994d3cedb818b94eea5738b327255a6c715721c9a7cb
Current (partial) GOP hash: 11ecc751242b35016ca11977f4947055f44e8db9d6bfc8b11044536984ad3369
DEBUG: Crypto tag has size 16
DEBUG: Tag 4 is of total size 19
DEBUG: Vendor info tag has size 36
DEBUG: Tag 5 is of total size 39
DEBUG: Certificate chain tag has size 562
DEBUG: Tag 6 is of total size 565
DEBUG: General tag has size 83
DEBUG: Tag 1 is of total size 86
DEBUG: Hash list tag has size 641
DEBUG: Tag 2 is of total size 644
DEBUG: Tag 7 is without payload
DEBUG: Signature tag has size 75
DEBUG: Tag 3 is of total size 78
DEBUG: Crypto tag has size 16
DEBUG: Vendor info tag has size 36
DEBUG: Certificate chain tag has size 562
DEBUG: General tag has size 83
DEBUG: Encoding GOP counter = 1
DEBUG: Hash list tag has size 641
DEBUG: Tag 7 is without payload
DEBUG: Computed -78 emulation prevention byte(s)
Hash of SEI: 752f877930e22f37a07508a4115813df861ce3a23e957d56c4518c1303a17e7f
SIGNING HASH
hash: 752f877930e22f37a07508a4115813df861ce3a23e957d56c4518c1303a17e7f
signature (71 B): 304502210095fd1017a2f69719600b4ada9847f9d84fb026b25b48d4d07a1a09c62b4e896f022006d312152cc27e65dacb442bbb1bb7376c04def28b3184ef4f9ead4c5391e986
Hash of I (primary): 7d3307ed208321e8f8752f10cfaea17b6d78dabde5fd3f2536a099960350db96
DEBUG: Signature tag has size 75
DEBUG: Computed 0 emulation prevention byte(s)
VERIFYING HASH
hash: 752f877930e22f37a07508a4115813df861ce3a23e957d56c4518c1303a17e7f
signature (71 B): 304502210095fd1017a2f69719600b4ada9847f9d84fb026b25b48d4d07a1a09c62b4e896f022006d312152cc27e65dacb442bbb1bb7376c04def28b3184ef4f9ead4c5391e986

SEI (1461 bytes): 00 00 00 01 06 05 ff ff ff ff ff ad 00 5b c9 3f 2d 71 5e 95 ad a4 79 6f 90 87 7a 6f 00 04 00 10 01 0b 06 09 60 86 48 01 65 03 04 02 01 00 00 00 05 00 24 01 06 76 31 2e 30 2e 32 03 4e 2f 41 17 4d 65 64 69 61 20 53 69 67 6e 69 6e 67 20 46 72 61 6d 65 7
7 6f 72 6b 06 02 32 01 00 2d 2d 2d 2d 2d 42 45 47 49 4e 20 43 45 52 54 49 46 49 43 41 54 45 2d 2d 2d 2d 2d 0d 0a 4d 49 49 42 61 54 43 43 41 51 38 43 46 44 36 46 32 4c 32 34 2f 67 79 43 54 33 56 4e 55 66 52 58 52 46 47 43 71 41 4a 6e 4d 41 6f 47 43 43 71 47 53 4d 34 39 42
41 4d 43 4d 44 63 78 45 44 41 4f 0d 0a 42 67 4e 56 42 41 6f 4d 42 31 4e 76 62 57 56 50 63 6d 63 78 44 54 41 4c 42 67 4e 56 42 41 73 4d 42 46 52 6c 63 33 51 78 46 44 41 53 42 67 4e 56 42 41 4d 4d 43 31 52 6c 63 33 51 67 55 6d 39 76 0d 0a 64 45 4e 42 4d 42 34 58 44 54 49
31 4d 44 45 77 4f 54 45 30 4d 7a 63 30 4e 6c 6f 58 44 54 49 32 4d 44 45 77 4f 54 45 30 4d 7a 63 30 4e 6c 6f 77 4e 7a 45 51 4d 41 34 47 41 31 55 45 43 67 77 48 0d 0a 55 32 39 74 5a 55 39 79 5a 7a 45 4e 4d 41 73 47 41 31 55 45 43 77 77 45 56 47 56 7a 64 44 45 55 4d 42 49 4
7 41 31 55 45 41 77 77 4c 56 47 56 7a 64 43 42 6a 59 57 31 6c 63 6d 45 77 57 54 41 54 0d 0a 42 67 63 71 68 6b 6a 4f 50 51 49 42 42 67 67 71 68 6b 6a 4f 50 51 4d 42 42 77 4e 43 41 41 52 62 57 63 67 31 76 4c 37 4a 72 31 48 52 65 76 37 66 42 30 37 43 30 36 53 58 55 6c 4e 6d
77 70 39 76 0d 0a 30 2f 55 43 78 38 46 38 55 67 6c 57 36 39 57 54 53 6a 37 50 4b 49 57 57 6d 35 7a 41 6c 6a 38 52 65 7a 36 73 33 62 68 75 62 45 4d 2f 30 5a 77 73 44 31 49 46 4d 41 6f 47 43 43 71 47 53 4d 34 39 0d 0a 42 41 4d 43 41 30 67 41 4d 45 55 43 49 51 44 71 33 5a
7a 42 38 63 39 34 77 4b 2b 66 34 48 63 61 61 37 65 53 72 6c 38 38 54 5a 79 45 34 33 62 50 6f 53 35 73 33 76 7a 48 6a 77 49 67 47 54 37 63 0d 0a 45 47 69 54 65 54 75 68 5a 41 72 44 2b 68 6d 7a 73 58 73 69 56 4e 75 66 44 57 7a 37 65 54 37 53 4a 66 66 55 58 38 30 3d 0d 0a 2
d 2d 2d 2d 2d 45 4e 44 20 43 45 52 54 49 46 49 43 41 54 45 2d 2d 2d 2d 2d 0d 0a 01 00 53 01 01 00 02 00 00 00 00 00 00 98 96 80 00 00 00 01 00 14 11 ec c7 51 24 2b 35 01 6c a1 19 77 f4 94 70 55 f4 4e 8d b9 d6 bf c8 b1 10 44 53 69 84 ad 33 69 00 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 02 02 81 01 ec 31 ee 5b 8a e1 f7 47 b1 d6 5f ba d3 95 dd 41 00 fc 81 a3 af b0 3d 6c 15 00 ca 67 88 fa c0 5f ee 6e 32 12 13 7c 2d b5 a9 40 ff 0b 6a 8c 0b 6f 89 44 40 46 56 1c 0b c4 0d 4f 21 37 6b 42 b0 73
71 2b a2 a2 a4 9c 18 6f a5 2d 23 63 17 68 d0 aa 44 3e 9c 57 cc 00 a4 ac 0a b5 b9 0f 2b 6a 28 9c a3 b9 2f 87 c5 eb 81 f0 af 48 64 61 ae dc fe 44 24 2e d8 d0 04 76 34 f2 42 a7 4d 86 5c 92 59 86 96 64 f0 98 0f e7 8f a8 d7 c6 1b dc 76 37 e5 19 db 97 45 cf 5e 28 a9 8e 97 18 c
7 05 45 2a e0 67 98 19 75 a1 34 70 d9 d1 bd 10 53 38 e8 a2 0e c2 f8 6d 0f 86 ef 53 fd 62 60 68 ae 9f 03 db 31 8f 84 90 da 99 b1 6e cc 8c 29 c4 6f 6a 2c f0 28 51 e5 ea 7b 48 0d ed a8 8c 74 77 f8 df 3a 81 a8 11 31 fb 65 b1 97 37 d4 7e f9 41 20 da c8 a0 47 4f f4 9d 65 fd e1
18 02 e8 19 2f 17 b5 37 8d d1 23 74 9f 97 93 67 b3 1d 5b 55 87 bd ec ba bb cb 81 a9 e0 7a 8a 3a 0c 24 e5 73 a2 f2 6e f9 f5 a2 1d 30 75 3d cf ab dd 17 62 7f 25 4b ea a0 c9 93 74 9b af 88 7f e9 5d f4 83 5e a3 a4 63 8c 3d a4 31 4b 02 36 6a e9 51 8b 15 be f9 be eb de 06 3f
6f 79 43 56 a0 35 1f f5 d9 7a e5 3a 93 4e c2 9f 92 92 fd bf 99 75 02 d6 25 2b b2 72 69 10 9a 4a 19 94 c3 30 4e 78 b8 d7 84 5a 05 e8 ea 03 d4 c3 57 fd 82 e1 14 32 8f 1f 10 0d e2 3b 1e e2 81 c4 8f b8 49 91 fb 3f b4 cb e0 76 29 1d 97 2d ae e2 20 68 24 e5 46 32 77 31 7c 62 8
9 fd a9 e0 ba a9 a9 08 fc a0 a4 1e 39 14 be 4d 8c f6 78 27 31 02 e7 d5 99 06 15 fa fe 58 a0 ea 86 b6 5b e4 05 3f 71 f8 96 e0 8b c9 c8 ff 0b bc 58 87 ca 66 c0 d7 45 19 0e 50 8d 13 87 28 da 66 48 47 87 6b b0 00 35 95 18 88 5e e2 1f 01 89 7a ca 43 4b e8 9d 70 e1 cf 5f da 35
fd 00 1a 76 52 e5 00 66 f7 3c 28 5c e7 03 a4 9b 8f 96 b4 b4 7f 12 fb 66 72 4f fd bc 7c 7e 4d 43 33 1a e4 98 6b 79 b3 9b 53 87 91 a0 26 43 86 8c c9 37 e1 ce 08 ee 0e ed 02 29 3b a1 7e 09 73 da 16 3d 3c 5e 70 05 d4 14 47 eb 88 ca ed a9 bd e2 2b 65 5c ce 18 45 08 f6 b3 cf
a5 6f b8 db 9e 5a 9e 37 98 71 54 6d 99 4d 3c ed b8 18 b9 4e ea 57 38 b3 27 25 5a 6c 71 57 21 c9 a7 cb 03 00 4b 01 00 47 30 45 02 21 00 95 fd 10 17 a2 f6 97 19 60 0b 4a da 98 47 f9 d8 4f b0 26 b2 5b 48 d4 d0 7a 1a 09 c6 2b 4e 89 6f 02 20 06 d3 12 15 2c c2 7e 65 da cb 44 2
b bb 1b b7 37 6c 04 de f2 8b 31 84 ef 4f 9e ad 4c 53 91 e9 86 01 80
DEBUG: Computed 0 emulation prevention byte(s)
DEBUG: This NAL Unit (type SEI) was not hashed
Hash of P (primary): 41e83cdebb60f8f4e8ecf1b876d06a11111ef48a49a0a4c1f25f929252d4420f
** Message: 13:52:22.793: GOPPPPP signed

[myselfishani2]

This is the validation debug of the same file. Now the only issue is only one GOP is coming as invalid. Though public key is validated correctly.

DEBUG: Creating media signing from code version v1.0.2
DEBUG: Setting hash algo sha256 that has ASN.1/DER coded OID length 11
DEBUG: Received a AUD of size 2 B
DEBUG: This NAL Unit (type AUD) was not hashed.
DEBUG: Received a PPS/SPS/VPS of size 26 B
DEBUG: This NAL Unit (type PPS/SPS/VPS) was not hashed.
DEBUG: Received a PPS/SPS/VPS of size 4 B
DEBUG: This NAL Unit (type PPS/SPS/VPS) was not hashed.
DEBUG: Received a I (primary) of size 40701 B
DEBUG: NAL Unit will be hashed when hash algo is known.
DEBUG: Received a AUD of size 2 B
DEBUG: This NAL Unit (type AUD) was not hashed.
DEBUG: Received a P (primary) of size 7891 B
DEBUG: NAL Unit will be hashed when hash algo is known.
DEBUG: Received a AUD of size 2 B
DEBUG: This NAL Unit (type AUD) was not hashed.
DEBUG: Received a P (primary) of size 6638 B
DEBUG: NAL Unit will be hashed when hash algo is known.
DEBUG: Received a AUD of size 2 B
DEBUG: This NAL Unit (type AUD) was not hashed.
DEBUG: Received a P (primary) of size 7928 B
DEBUG: NAL Unit will be hashed when hash algo is known.
DEBUG: Received a AUD of size 2 B
DEBUG: This NAL Unit (type AUD) was not hashed.
DEBUG: Received a P (primary) of size 6202 B
DEBUG: NAL Unit will be hashed when hash algo is known.
DEBUG: Received a AUD of size 2 B
DEBUG: This NAL Unit (type AUD) was not hashed.
DEBUG: Received a P (primary) of size 7507 B
DEBUG: NAL Unit will be hashed when hash algo is known.
DEBUG: Received a AUD of size 2 B
DEBUG: This NAL Unit (type AUD) was not hashed.
DEBUG: Received a P (primary) of size 6150 B
DEBUG: NAL Unit will be hashed when hash algo is known.
DEBUG: Received a AUD of size 2 B
DEBUG: This NAL Unit (type AUD) was not hashed.
DEBUG: Received a P (primary) of size 7233 B
DEBUG: NAL Unit will be hashed when hash algo is known.
DEBUG: Received a AUD of size 2 B
DEBUG: This NAL Unit (type AUD) was not hashed.
DEBUG: Received a P (primary) of size 5726 B
DEBUG: NAL Unit will be hashed when hash algo is known.
DEBUG: Received a AUD of size 2 B
DEBUG: This NAL Unit (type AUD) was not hashed.
DEBUG: Received a P (primary) of size 7201 B
DEBUG: NAL Unit will be hashed when hash algo is known.
DEBUG: Received a AUD of size 2 B
DEBUG: This NAL Unit (type AUD) was not hashed.
DEBUG: Received a P (primary) of size 5920 B
DEBUG: NAL Unit will be hashed when hash algo is known.
DEBUG: Received a AUD of size 2 B
DEBUG: This NAL Unit (type AUD) was not hashed.
DEBUG: Received a I (primary) of size 39363 B
DEBUG: NAL Unit will be hashed when hash algo is known.
DEBUG: Received a AUD of size 2 B
DEBUG: This NAL Unit (type AUD) was not hashed.
DEBUG: Received a P (primary) of size 5662 B
DEBUG: NAL Unit will be hashed when hash algo is known.
DEBUG: Received a AUD of size 2 B
DEBUG: This NAL Unit (type AUD) was not hashed.
DEBUG: Received a P (primary) of size 8683 B
DEBUG: NAL Unit will be hashed when hash algo is known.
DEBUG: Received a AUD of size 2 B
DEBUG: This NAL Unit (type AUD) was not hashed.
DEBUG: Received a P (primary) of size 6307 B
DEBUG: NAL Unit will be hashed when hash algo is known.
DEBUG: Received a AUD of size 2 B
DEBUG: This NAL Unit (type AUD) was not hashed.
DEBUG: Received a P (primary) of size 8073 B
DEBUG: NAL Unit will be hashed when hash algo is known.
DEBUG: Received a AUD of size 2 B
DEBUG: This NAL Unit (type AUD) was not hashed.
DEBUG: Received a P (primary) of size 6077 B
DEBUG: NAL Unit will be hashed when hash algo is known.
DEBUG: Received a AUD of size 2 B
DEBUG: This NAL Unit (type AUD) was not hashed.
DEBUG: Received a P (primary) of size 7403 B
DEBUG: NAL Unit will be hashed when hash algo is known.
DEBUG: Received a AUD of size 2 B
DEBUG: This NAL Unit (type AUD) was not hashed.
DEBUG: Received a P (primary) of size 6159 B
DEBUG: NAL Unit will be hashed when hash algo is known.
DEBUG: Received a AUD of size 2 B
DEBUG: This NAL Unit (type AUD) was not hashed.
DEBUG: Received a P (primary) of size 7470 B
DEBUG: NAL Unit will be hashed when hash algo is known.
DEBUG: Received a AUD of size 2 B
DEBUG: This NAL Unit (type AUD) was not hashed.
DEBUG: Received a P (primary) of size 5952 B
DEBUG: NAL Unit will be hashed when hash algo is known.
DEBUG: Received a AUD of size 2 B
DEBUG: This NAL Unit (type AUD) was not hashed.
DEBUG: Received a I (primary) of size 39559 B
DEBUG: NAL Unit will be hashed when hash algo is known.
DEBUG: Validated GOP as MEDIA SIGNING NOT PRESENT
DEBUG: Expected NAL Units = -1
DEBUG: Received NAL Units = -1
DEBUG: Pending NAL Units = 22
DEBUG: Received a AUD of size 2 B
DEBUG: This NAL Unit (type AUD) was not hashed.
DEBUG: Computed 0 emulation prevention byte(s)
DEBUG: Computed 0 emulation prevention byte(s)
DEBUG: Received a SEI of size 1457 B
Hash of SEI: 752f877930e22f37a07508a4115813df861ce3a23e957d56c4518c1303a17e7f
VERIFYING HASH
hash: 752f877930e22f37a07508a4115813df861ce3a23e957d56c4518c1303a17e7f
signature (71 B): 304502210095fd1017a2f69719600b4ada9847f9d84fb026b25b48d4d07a1a09c62b4e896f022006d312152cc27e65dacb442bbb1bb7376c04def28b3184ef4f9ead4c5391e986
DEBUG: Verified SEI signature with result 1
DEBUG: Got Hash algorithm, re-registering NAL Units
DEBUG: This NAL Unit (type AUD) was not hashed.
DEBUG: This NAL Unit (type PPS/SPS/VPS) was not hashed.
DEBUG: This NAL Unit (type PPS/SPS/VPS) was not hashed.
Hash of I (primary): f92f896c8924ddf5ba42b5e2af5bbcf49bd0dd33d5ddf4a8a2dd784ca05b61fc
DEBUG: This NAL Unit (type AUD) was not hashed.
Hash of P (primary): b4b1a54b52dfe081ff942db195374f780e4be6af4dd68e5266e1c5b0048837fb
DEBUG: This NAL Unit (type AUD) was not hashed.
Hash of P (primary): df72c057dcac742515dd90f17f05a82dc6047d15b62ae7ffa6763d8c776b7b9a
DEBUG: This NAL Unit (type AUD) was not hashed.
Hash of P (primary): 067b0c1fe8ca1484936a57575d3bc7b2e39702f250cb65ef4168420d380dc5fe
DEBUG: This NAL Unit (type AUD) was not hashed.
Hash of P (primary): c98b4b0a6c659e715ea7207ed0145356b86e4f6e4e1016e8ab0807d70e3c47ec
DEBUG: This NAL Unit (type AUD) was not hashed.
Hash of P (primary): a1308639459d30f6e24bccd0916cede4035f9afa6dd9b756f25fedabc7567b7a
DEBUG: This NAL Unit (type AUD) was not hashed.
Hash of P (primary): 2578d5e301eb65e94668b0b667ecdd064ebfb56e324817e5415a9158424d4498
DEBUG: This NAL Unit (type AUD) was not hashed.
Hash of P (primary): cf978a7647bd7ef44ee01eb3b6e57489dbc0aaaf118b9b65706ee658e067d1e7
DEBUG: This NAL Unit (type AUD) was not hashed.
Hash of P (primary): 45d98750641a2adfb0184d22dec76034b86701e4d086d9036cc21a2eec3bf434
DEBUG: This NAL Unit (type AUD) was not hashed.
Hash of P (primary): ccfa856c3afd0d71f8dacc0b5804d10fdaf95acc58e0d084e9ad1403d23136f7
DEBUG: This NAL Unit (type AUD) was not hashed.
Hash of P (primary): 3709fd1e734fafd6ece9787a8617695019d2895120540571839ca7c8a992968b
DEBUG: This NAL Unit (type AUD) was not hashed.
Hash of I (primary): 4b02366ae9518b15bef9beebde063f6f794356a0351ff5d97ae53a934ec29f92
DEBUG: This NAL Unit (type AUD) was not hashed.
Hash of P (primary): 92fdbf997502d6252bb27269109a4a1994c3304e78b8d7845a05e8ea03d4c357
DEBUG: This NAL Unit (type AUD) was not hashed.
Hash of P (primary): fd82e114328f1f100de23b1ee281c48fb84991fb3fb4cbe076291d972daee220
DEBUG: This NAL Unit (type AUD) was not hashed.
Hash of P (primary): 6824e5463277317c6289fda9e0baa9a908fca0a41e3914be4d8cf678273102e7
DEBUG: This NAL Unit (type AUD) was not hashed.
Hash of P (primary): d5990615fafe58a0ea86b65be4053f71f896e08bc9c8ff0bbc5887ca66c0d745
DEBUG: This NAL Unit (type AUD) was not hashed.
Hash of P (primary): 190e508d138728da664847876bb000359518885ee21f01897aca434be89d70e1
DEBUG: This NAL Unit (type AUD) was not hashed.
Hash of P (primary): cf5fda35fd001a7652e50066f73c285ce703a49b8f96b4b47f12fb66724ffdbc
DEBUG: This NAL Unit (type AUD) was not hashed.
Hash of P (primary): 7c7e4d43331ae4986b79b39b538791a02643868cc937e1ce08ee0eed02293ba1

[myselfishani2]

Initial NAL units marked as invalid during authenticity validation even though later segments validate correctly.

** Message: 11:37:00.042: Latest authenticity result:
nalus : vvI_P_P_P_P_P_P_P_P_P_P_I_P_P_P_P_P_P_P_P_P_I_S
signed : P_P_P_P_P_P_P_P_P_P_P_P_P_P_P_P_P_P_P_P_P_P.
** Message: 11:37:00.134: Latest authenticity result:
nalus : I_P_P_P_P_P_P_P_P_P_P_I_P_P_P_P_P_P_P_P_P_I_SP_P_P_P_P_P_P_P_P_P_I_S
invalid : N_N_N_N_N_N_N_N_N_N_N_N_N_N_N_N_N_N_N_N_N_N...........P.
** Message: 11:37:00.218: Latest authenticity result:
nalus : I_SP_P_P_P_P_P_P_P_P_I_S
valid : ...........P.
** Message: 11:37:00.309: Latest authenticity result:
nalus : I_SP_P_P_P_P_P_P_P_P_P_I_S
valid : ............P.
** Message: 11:37:00.401: Latest authenticity result:
nalus : I_SP_P_P_P_P_P_P_P_P_P_I_S
valid : ............P.
** Message: 11:37:00.487: Latest authenticity result:
nalus : I_SP_P_P_P_P_P_P_P_P_I_S
valid : ...........P.
** Message: 11:37:00.578: Latest authenticity result:
nalus : I_SP_P_P_P_P_P_P_P_P_P_I_S
valid : ............P.
** Message: 11:37:00.668: Latest authenticity result:
nalus : I_SP_P_P_P_P_P_P_P_P_P_I_S
valid : ............P.
** Message: 11:37:00.752: Latest authenticity result:
nalus : I_SP_P_P_P_P_P_P_P_P_I_S
valid : ...........P.
** Message: 11:37:00.845: Latest authenticity result:
nalus : I_SP_P_P_P_P_P_P_P_P_P_I_S
valid : ............P.
** Message: 11:37:00.931: Latest authenticity result:
nalus : I_SP_P_P_P_P_P_P_P_P_I_S
valid : ...........P.
** Message: 11:37:01.024: Latest authenticity result:
nalus : I_SP_P_P_P_P_P_P_P_P_P_I_S
valid : ............P.
** Message: 11:37:01.115: Latest authenticity result:
nalus : I_SP_P_P_P_P_P_P_P_P_P_I_S
valid : ............P.
** Message: 11:37:01.198: Latest authenticity result:
nalus : I_SP_P_P_P_P_P_P_P_P_I_S
valid : ...........P.
** Message: 11:37:01.288: Latest authenticity result:
nalus : I_SP_P_P_P_P_P_P_P_P_P_I_S
valid : ............P.
** Message: 11:37:01.370: Latest authenticity result:
nalus : I_SP_P_P_P_P_P_P_P_P_I_S
valid : ...........P.
** Message: 11:37:01.454: Latest authenticity result:
nalus : I_SP_P_P_P_P_P_P_P_P_I_S
valid : ...........P.
** Message: 11:37:01.545: Latest authenticity result:
nalus : I_SP_P_P_P_P_P_P_P_P_P_I_S
valid : ............P.
** Message: 11:37:01.628: Latest authenticity result:
nalus : I_SP_P_P_P_P_P_P_P_P_I_S
valid : ...........P.
** Message: 11:37:01.715: Latest authenticity result:
nalus : I_SP_P_P_P_P_P_P_P_P_P_I_S
valid : ............P.
** Message: 11:37:01.802: Latest authenticity result:
nalus : I_SP_P_P_P_P_P_P_P_P_P_I_S
valid : ..........._.P.

[srivikramanm]

@bjornvolcker @bsriramprasad - Thank you for all the support provided till now, as of now, we are able to sign the media, however we are not able to validate. The first GOP is always showing error, could you please support here so that we complete the whole flow

cc: @myselfishani2

[bjornvolcker]

@srivikramanm and @myselfishani2
I'm still quite sure that the first "frame" you add for signing includes 3 NAL Units and not only 1. I have pushed to master a commit that not only debug prints the NALU type, but also the size. This will reveal if the I-frame is present or not. (The size will be way larger than the PPS+SPS).

Please redo the test and add the debug prints to the issue and I can analyze the first part.

[myselfishani2]

@bjornvolcker check the debug prints.

h264parse
DEBUG: Creating media signing from code version v1.0.2
DEBUG: Setting hash algo sha256 that has ASN.1/DER coded OID length 11
DEBUG: Received a PPS/SPS/VPS of size 38053 B
DEBUG: This NAL Unit (type PPS/SPS/VPS) was not hashed
DEBUG: Received a P (primary) of size 7298 B
Hash of P (primary): f8312c36f5ab431c0318101d755a734301038eba29d820318efb334bab23b5f2
DEBUG: Received a P (primary) of size 6235 B
Hash of P (primary): a13483c273e261cd89a014281039e2a6e08eb8cea6bdc97ff2b2e73f599fa151
DEBUG: Received a P (primary) of size 7317 B
Hash of P (primary): 2278d8ed324f6c8a3d0b1748424ae48ced3664e399eeb9d64377f3c67f97a651
DEBUG: Received a P (primary) of size 5635 B
Hash of P (primary): a7bb9f8107944c8f448e28108966c4e212f9ce5d9bd110dd239676ab720d1162
DEBUG: Received a P (primary) of size 6955 B
Hash of P (primary): 26fdff6861967384de72998637ab20ca35b50b4f7d7f00eaebe4ef369dbd0bf2
DEBUG: Received a P (primary) of size 5411 B
Hash of P (primary): 50e7f75996c2b67b7188c325252542b133dd9544a5f647cb185f7cd5392f8f17
DEBUG: Received a P (primary) of size 6632 B
Hash of P (primary): abda8062d4770ce6e60c551213e6334f05777dae70a76775f28549ff7edbf375
DEBUG: Received a P (primary) of size 5417 B
Hash of P (primary): 9d8810ba5913ba5ac8a26e35241b8ffd6ea93bb10f6bed6f8edff1aef039de94
DEBUG: Received a P (primary) of size 6577 B
Hash of P (primary): 8a08a56049222baa728246dfa4228aa1f8e0996bda87f6feab1aad781816026d
DEBUG: Received a I (primary) of size 37935 B
Current (partial) GOP hash: e97a44eeefeee0b67f517923762f06f422415e135924f2e20b63a75621581ab1
Hash of I (primary): 8248fd4b427cfd3f244a9cf08ddd6e6fffd8dce61e55633e316c1b0b64219aea
DEBUG: Received a P (primary) of size 7231 B
Hash of P (primary): 069e79a033f47e35f797d155f74a67b905454285d943b40d28151c2872a39533
DEBUG: Received a P (primary) of size 6533 B
Hash of P (primary): ca20511a2b6e453c7e9d16ac24a4b5839f8a1ea55b03d9b97a4f73a803b0473c
DEBUG: Received a P (primary) of size 7271 B
Hash of P (primary): 8a67d45c9d0a6d99c923649fcd3e51e34338a1bb2b1139cabec7b2a6e0ea7118
DEBUG: Received a P (primary) of size 5560 B
Hash of P (primary): bf459eacdaa4e5283b450b183a03d978f35687da4114e59cb5b50db101f3be20
DEBUG: Received a P (primary) of size 6654 B
Hash of P (primary): 5f686c89ef45f071a22c5d733bc80ba62924d143d2d53b500560023915b2e97c
DEBUG: Received a P (primary) of size 5304 B
Hash of P (primary): 22435406076b321de270178a08a37ffec06be50b298333e79daf7fde7648fd78
DEBUG: Received a P (primary) of size 6528 B
Hash of P (primary): 906e2f464b5ff9d4fdab0d6b411997ef7fb10c14f69385366d277039d983170e
DEBUG: Received a P (primary) of size 5181 B
Hash of P (primary): be1aa1aff8fd0a73d644f9346f95799b6dda3dd3c3c899b3a57ca3b6068f988e
DEBUG: Received a P (primary) of size 6488 B
Hash of P (primary): 3f23b98e0448db380dd58f930a57ba80af90a7cecf6413188a2a3ffc200e67ac
DEBUG: Received a P (primary) of size 5316 B
Hash of P (primary): faf350f0639390798c139d7e841f2e5df68815d6e0ee4603ee37a62bbfa69088
DEBUG: Received a I (primary) of size 39191 B
Current (partial) GOP hash: e0ed53a1d195993d101e418b1cdaf64f20c6d1bec5b950e644e685f1db97c261
DEBUG: Crypto tag has size 16
DEBUG: Tag 4 is of total size 19
DEBUG: Vendor info tag has size 36
DEBUG: Tag 5 is of total size 39
DEBUG: Certificate chain tag has size 562
DEBUG: Tag 6 is of total size 565
DEBUG: General tag has size 83
DEBUG: Tag 1 is of total size 86
DEBUG: Hash list tag has size 641
DEBUG: Tag 2 is of total size 644
DEBUG: Tag 7 is without payload
DEBUG: Signature tag has size 75
DEBUG: Tag 3 is of total size 78
DEBUG: Crypto tag has size 16
DEBUG: Vendor info tag has size 36
DEBUG: Certificate chain tag has size 562
DEBUG: General tag has size 83
DEBUG: Encoding GOP counter = 1
DEBUG: Hash list tag has size 641
DEBUG: Tag 7 is without payload
DEBUG: Computed -78 emulation prevention byte(s)
Hash of SEI: 084981350e11c2da88d70fdb171d97a1988f66bd725c7a223bcaabd9da53910d
SIGNING HASH
hash: 084981350e11c2da88d70fdb171d97a1988f66bd725c7a223bcaabd9da53910d
signature (70 B): 3044022028505cd6a3a2a763555522c9c262e31671be203c0cc28c71fa5a438c59fd974e0220234a4c2fb915345a1d5c9b26cb21a3662f1b0727719ba659c707a955317ee7ad
Hash of I (primary): b094635ce2e8d8e1194e977ef6e6e9935069ab3db8865c0967e3a149f86704e4
DEBUG: Signature tag has size 75
DEBUG: Computed 0 emulation prevention byte(s)
VERIFYING HASH
hash: 084981350e11c2da88d70fdb171d97a1988f66bd725c7a223bcaabd9da53910d
signature (70 B): 3044022028505cd6a3a2a763555522c9c262e31671be203c0cc28c71fa5a438c59fd974e0220234a4c2fb915345a1d5c9b26cb21a3662f1b0727719ba659c707a955317ee7ad

[bjornvolcker]

@myselfishani2
Here is the proof that the first added frame includes both the SPS, PPS and the I-frame. That is, 3 NAL Units that should be added separately and not as one chunk of data.

DEBUG: Received a PPS/SPS/VPS of size 38053 B
DEBUG: This NAL Unit (type PPS/SPS/VPS) was not hashed
DEBUG: Received a P (primary) of size 7298 B
Hash of P (primary): f8312c36f5ab431c0318101d755a734301038eba29d820318efb334bab23b5f2

So what happens is that the media-signing-framework, which assumes it is only one single NAL Unit detects only the first NAL of the three. That NAL is a SPS or PPS, which is not hashed. That means that the I-frame is not detected and hashed.
How can I see that?
The size of the added data chunk is 38053 B large. That is way more than a single PPS or SPS. These are in general 8 to 30 B large.

You need to make sure to add SPS + PPS + I-frame one-by-one.

[srivikramanm]

@bjornvolcker - We are using signer.exe and passing the Mp4 - is that approach correct? or itis better to use the open source API, build the lib and include the lib in our code?

[bjornvolcker]

If you have built and used the signer example application this looks like a GStreamer issue. I will check that.

Note that the example applications are meant to be used as examples of a correct integration. I hope you're not using the example application "signer" as is, because it uses an unsecure signing key and certificates present here in GitHub for test purposes.

Also, note that the signing side should be used to sign streams and not files. The example application takes a file because it is for test purposes easier to deal with files rather than streams.