Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Incorporate estimated variance to overall, user's and producer's accuracy #1258

Open
EstefaPizarro opened this issue Dec 30, 2024 · 1 comment
Assignees
Milestone

Comments

@EstefaPizarro
Copy link

EstefaPizarro commented Dec 30, 2024

Describe the requested improvement
Reviewing the paper by Olofsson et al. (2014) reveals an element that could enrich the analysis of precision metrics and area estimation according to best practices (Equations 5, 6 and 7). This is the case of the estimated variance for overall, user and producer precision.

Associated sits API function
api_accuracy contains the functions for estimating accuracy and adjusted areas. Specifically, .accuracy_area_assess estimates the adjusted area and associated metrics. The code developed by FAO (https://gist.github.com/EstefaPizarro/cf00c66074581122405463c4500d5eec, from line 103) could be considered, the original repository of which is located at https://github.com/openforis/accuracy-assessment.git

In this particular script, the variance is estimated for the overall accuracy, and also for the producer and user case (considering the condition that the sampling and response design is pixel-based, according to Olofsson et al., (2014)).

Additional context
As an additional request, it would be interesting to have a visualization of the behavior of the adjusted area considering its 95% confidence interval. I leave a simple code developed (perhaps I can provide guidance so that it can be incorporated) to graph the mapped area, adjusted areas and their confidence interval for each class in a forecast estimate and area calculation.

Script to graphic confidence interval to area adjusted estimated
https://gist.github.com/EstefaPizarro/fe7813785d452a920c827f862de70a64

@EstefaPizarro EstefaPizarro closed this as not planned Won't fix, can't repro, duplicate, stale Dec 30, 2024
@EstefaPizarro EstefaPizarro changed the title Incorporates Incorporate estimated variance to overall, user's and producer's accuracy Dec 30, 2024
@EstefaPizarro EstefaPizarro reopened this Dec 30, 2024
@gilbertocamara gilbertocamara self-assigned this Jan 2, 2025
@gilbertocamara gilbertocamara added this to the version 1.5.2 milestone Jan 2, 2025
@gilbertocamara
Copy link
Contributor

Dear @EstefaPizarro many thanks for the suggestion. We will include this improvement in version 1.5.2

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: No status
Development

No branches or pull requests

2 participants