Enhance Calibration Coefficient Precision

[tylerkron]

Type: Feature
Priority: Medium
Epic: Enhanced Resolution & Range Support

Description

Update calibration handling to support higher precision coefficients needed for 18-bit resolution accuracy.

Acceptance Criteria

• Review calibration coefficient data types (float vs double)
• Ensure precision is adequate for 18-bit resolution (1 part in 262,144)
• Update calibration value storage and processing
• Validate calibration accuracy across full voltage range
• Add calibration precision validation
• Unit tests for high-precision calibration calculations

Precision Requirements

• 18-bit resolution requires ~0.0038% accuracy (1/262,144)
• Current float precision may be limiting factor
• Consider double precision for intermediate calculations

Files to Modify

• Daqifi.Desktop/Channel/AnalogChannel.cs (calibration properties)
• Daqifi.Desktop/Device/AbstractStreamingDevice.cs (calibration processing)

Value

Ensures maximum accuracy from 18-bit ADCs by maintaining precision throughout calibration chain

Testing Requirements

• Test calibration accuracy across full 18-bit range
• Compare single vs double precision calculations
• Verify calibration stability over temperature/time
• Test edge cases (very small/large calibration values)

Dependencies

• Can be done in parallel with other resolution/range work