CivicPy cache wrapper for fetching relevant checkpoints

[jsstevenson]

Idle thought while reviewing #302 -- given that our data pipeline is reliant on specific checkpoints of CivicPy data, it might be helpful to write a small function or two that fetches the cache pickle for a relevant date (eg when an analysis notebook or a test set was run) from a VICC S3 bucket and places it in the appropriate local file location. That way we can easily ensure that team members are working with the same data set, analyses are reproducible, etc.

[korikuzma]

@jsstevenson The civicpy cache can be found in s3://vicc-metakb/civicpy/

[jsstevenson]

Right, I'm thinking about a way to declare/ensure in code that you're using a specific date's checkpoint file. We could also just use bash calls in a jupyter notebook too of course.

[korikuzma]

@jsstevenson Yes, I like that! Just thought I'd post the location for whoever grabs the issue (not sure if everyone on the MetaKB team knew we also stored the civicpy cache in this bucket)

[jsstevenson]

@korikuzma sounds like a job for some documentation!

[korikuzma]

@jsstevenson #198 (comment)

[github-actions]

This issue is stale because it has been open 45 days with no activity. Please make a comment for triaging or closing the issue.