Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Post-process data validation #99

Open
aquemy opened this issue Oct 22, 2020 · 0 comments
Open

Post-process data validation #99

aquemy opened this issue Oct 22, 2020 · 0 comments
Labels
enhancement Enchancement of existing features

Comments

@aquemy
Copy link
Member

aquemy commented Oct 22, 2020

For each step, we should check data consistency and format.
For instance, we can check that each section is tagged after preprocessing. All documents that could not be parsed should be returned. At the end of the workflow, it is expected to have one single file with all cases that could not be properly processed, with the step and the reason. This document will serve to adjust and enhance the process, but also to display on the main website for users to know what cases they will not find in the final database.

@aquemy aquemy added the enhancement Enchancement of existing features label Oct 22, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement Enchancement of existing features
Projects
None yet
Development

No branches or pull requests

1 participant