Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🔱 apc-metadata-copy - can we copy CaDeT Views to APC? #6465

Open
3 tasks
tom-webber opened this issue Dec 24, 2024 · 0 comments
Open
3 tasks

🔱 apc-metadata-copy - can we copy CaDeT Views to APC? #6465

tom-webber opened this issue Dec 24, 2024 · 0 comments
Labels
spike investigation, discovery into a thing

Comments

@tom-webber
Copy link
Contributor

Context

The issue in this Slack thread was caused by Views not being copied over to APC.

The metadata-to-apc workflow triggered within the create-a-derived-table (CaDeT) repo copies the metadata to the destination account.
The terraform plan and apply workflow in the data-engineering-database-access repo runs on merged changes to the repo, and allocates permissions to databases and tables to quicksight users. That terraform apply is currently failing because it's trying to assign permissions to the analytical_platform_value_int database which it cannot find, *because the analytical_platform_value_int database consists of a single View, and so isn't picked up by the apc-metadata-copy workflow.
If you set up a workflow dispatch that calls the copy-metadata workflow and change the CaDeT code to include creating a Table within the analytical_platform_value_int database, it should create the database and the permissions assignment could then complete.

Proposal

Try adding views to the current metadata copy scripts (currently only looking at models matching the pattern model.mojap-derived-tables). See if that works?

Spike requirements

Data Engineer, 1 day

Definition of Done

  • Try adding views to the current metadata copy scripts
  • Test-run
  • Create new issue to productionise and add tests if it works
@tom-webber tom-webber added the spike investigation, discovery into a thing label Dec 24, 2024
@tom-webber tom-webber moved this to 👀 TODO in Analytical Platform Dec 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
spike investigation, discovery into a thing
Projects
Status: 👀 TODO
Development

No branches or pull requests

1 participant