Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

sync azure blob storage to local? #39

Open
zackarno opened this issue Oct 3, 2024 · 1 comment
Open

sync azure blob storage to local? #39

zackarno opened this issue Oct 3, 2024 · 1 comment

Comments

@zackarno
Copy link

zackarno commented Oct 3, 2024

I was wondering if it is possible to sync azure blob storage to local with bowerbird?

I was reading the defining data sources section of the getting started guide and see there are some arguments for aws s3. These actually seem intended to sync your object storage from other sources. But I was wondering if there was a way to sync your object storage to local.

I have some large (temporally) COG stacks that just tend to cause a time out when running standard processing on them directly from remote object storage so I thought that bowerbird could be very useful for keeping a local copy synced for select data sources like this.

@raymondben
Copy link
Member

Sorry for a slow reply. Haven't done anything with Azure to date - do you have an endpoint that I can look at to see what might be required? (Is it a STAC catalog?)
For what it's worth, the S3 support in bowerbird currently does remote bucket -> local file system, or remote provider (http/ftp/whatever) -> remote bucket. But I can't remember off the top of my head if sourcing from a remote bucket will work with one that requires authentication.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants