Skip to content

Post-stratified estimation (stehman 2014)#436

Merged
adebowaledaniel merged 2 commits intomasterfrom
post-stratified-est
Oct 15, 2025
Merged

Post-stratified estimation (stehman 2014)#436
adebowaledaniel merged 2 commits intomasterfrom
post-stratified-est

Conversation

@adebowaledaniel
Copy link
Copy Markdown
Collaborator

This PR adds a new class for post-stratified estimation of map accuracy metrics, implementing Stehman’s stratified estimators. The class provides methods to compute accuracy metrics (user’s, producer’s, overall, area proportion), their standard errors, and a reporting function for summary output.

New functionality for stratified accuracy estimation:

  • Added StehmanStratifiedEstimators class in src/post_stratified_estimation.py to calculate stratified accuracy metrics for map evaluation, including user’s, producer’s, and overall accuracy, as well as area proportion.
  • Implemented methods to compute standard errors for all accuracy metrics and F1 score using error propagation, improving statistical rigor in reporting.

Reporting and usability improvements:

  • Provided a generate_report method to output a comprehensive DataFrame summary of all metrics and their standard errors for both crop and non-crop classes, supporting dataset and country metadata.

Copy link
Copy Markdown
Collaborator

@anatarano anatarano left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me! I will open an issue so that we can use the standard error to calculate the 95% confidence intervals.

@adebowaledaniel adebowaledaniel merged commit 2466fbd into master Oct 15, 2025
7 of 8 checks passed
@adebowaledaniel adebowaledaniel deleted the post-stratified-est branch October 15, 2025 17:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants