[Bug] Cosmos does not honour the custom snowflake warehouse from the model yaml file

[saswatkumarsahoo]

Astronomer Cosmos Version

1.7.0

dbt-core version

1.8.6

Versions of dbt adapters

No response

LoadMode

DBT_LS_MANIFEST

ExecutionMode

VIRTUALENV

InvocationMode

SUBPROCESS

airflow version

1.9.1

Operating System

amazon linux

If a you think it's an UI issue, what browsers are you seeing the problem on?

No response

Deployment

Other Docker-based deployment

Deployment details

No response

What happened?

We are running the dbt models on airflow using cosmos package and our target data platform is Snowflake.
Snowflake credentials (account name, username, password, warehouse etc. ) are configured in the airflow connection and 95% of the time cosmos is able to fetch this connection from aifrlow connection and covert it to the dbt profile.

The warehouse is XS in the airflow connection. However for some bigger models we have a custom warehouse Medium/large etc. But Cosmos sometime does not use this cusom warehouse for the model and just use the default XS warehouse mentioned from the airflow connection.

This issue only happens randomly. So its not something that easily reproduceable.

Relevant log output

How to reproduce

This issue happens intermittently

Anything else :)?

This occurs intermittently

Are you willing to submit PR?

• Yes I am willing to submit a PR!

Contact Details

No response

[pankajkoti]

hi @saswatkumarsahoo it would be hard to identify the root cause if we're unable to reproduce this. Can you reconfirm that it's the same model that sometimes is able to use the custom database and at other times it is not able to use them? Otherwise, could you please recheck again the profile/profile_config settings is using the right connection for the ones which are not using the desired warehouse?