Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE REQUEST] Clean up start/end time usages in benchmark scripts #302

Open
lizziel opened this issue Feb 8, 2024 · 1 comment
Open
Labels
category: Feature Request New feature or request never stale Never label this issue as stale topic: Benchmark Plots and Tables Issues pertaining to generating plots/tables from benchmark output

Comments

@lizziel
Copy link
Contributor

lizziel commented Feb 8, 2024

Name and Institution (Required)

Name: Lizzie Lundgren
Institution: Harvard University

New GCPy feature or discussion

This is a non-urgent nice-to-have feature request. I noticed that the start/end benchmark dates passed to the benchmark run scripts are based on GC-Classic ref. This means the GCC ref start/end time in the benchmark config files need to be updated even if GC-Classic data is not being used, e.g. GCHP vs GCHP comparison only. This does not impact the normal GEOS-Chem benchmarks since we always set GCC ref for those and use the same years for GCC and GCHP. However, it does impact use of GCPy for comparing GCHP runs. In that case if the GCC entries are not updated and the GCHP data is for a different year, then GCPy will error out.

I have two ideas for fixing this:

  1. Ideally we would only pass config to the benchmark run scripts, and not config, start, and end as we do now. The start/end information is in config and so should not need to be passed separately. The GCC_vs_GCC, GCHP_vs_GCC, etc entries in config can be used to determine which start/end dates to use.
  2. There is some logic within run_benchmark (before the 1-yr scripts are called) that checks that the GCC ref start/end date spans one year. We could specify if the benchmark is one year within the config file to avoid having to determine which start/end entry to use (GCC or GCHP, ref or dev).
Copy link

stale bot commented Mar 17, 2024

This issue has been automatically marked as stale because it has not had recent activity. If there are no updates within 7 days it will be closed. You can add the "never stale" tag to prevent the Stale bot from closing this issue.

@stale stale bot added the stale No recent activity on this issue label Mar 17, 2024
@yantosca yantosca added never stale Never label this issue as stale category: Feature Request New feature or request topic: Benchmark Plots and Tables Issues pertaining to generating plots/tables from benchmark output and removed stale No recent activity on this issue labels Mar 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
category: Feature Request New feature or request never stale Never label this issue as stale topic: Benchmark Plots and Tables Issues pertaining to generating plots/tables from benchmark output
Projects
None yet
Development

No branches or pull requests

2 participants