[feat] Support swa for npu#135

Open

POI-WX wants to merge 9 commits intomainfrom

support_swa_for_npu

Commits on Oct 21, 2024

fix bug of rope for npu and support the interleaved option
POI-WX
committed

Commits on Oct 22, 2024

optimize when interleaved is True
POI-WX
committed
use fused rope op from mindspeed
POI-WX
committed

Commits on Oct 23, 2024

optimize
POI-WX
committed

Commits on Jan 8, 2025

using fused rms norm op with 8.0 RC3 software stack on npu
wangxing2
committed

Commits on Jan 9, 2025

optimize
wangxing2
committed
modify atol and rtol
wangxing2
committed

Commits on Jan 21, 2025

use the global attention mask and support sliding window local attention
wangxing2
committed
optimize code for npu
wangxing2
committed