Skip to content

InstructTime v2.1

Latest

Choose a tag to compare

@zhjai zhjai released this 02 Mar 13:13

What's New

Cross-Domain Autoregressive Pretraining

  • Added run_pretrain_universal.py for multi-domain joint pretraining across all five signal domains (ECG, EEG, FD, HAR, RWC)
  • Supports weighted domain sampling for balanced cross-domain training
  • Mixed-precision training with cosine warmup scheduling and early stopping
  • Deterministic reproducibility setup for consistent results

Bug Fixes

  • Fixed off-by-one error in average loss and metric calculation in TStokenizer Trainer class (loss_sum / idxloss_sum / (idx + 1))

Documentation

  • Updated README to reflect the correct three-stage training pipeline:
    1. TStokenizer training
    2. Cross-domain autoregressive pretraining (run_pretrain_universal.py)
    3. Supervised fine-tuning (Universal + Adaptation)
  • Added run_pretrain_universal.py to project structure

Changed Files

  • run_pretrain_universal.py (new)
  • TStokenizer/process.py
  • README.md