Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MAINT, DOC: Modify Hyperband docs for first-time users #671

Draft
wants to merge 8 commits into
base: main
Choose a base branch
from

Conversation

stsievert
Copy link
Member

@stsievert stsievert commented May 23, 2020

What does this PR implement?
@ToddMorrill has a good example of Hyperband in dask/dask-examples#149. He's a first time user and has hit some road bumps.

This PR does the following:

  • More clearly showed errors while scoring models (as in BUG: clearly show error message while initing models #670).
  • Better names variables in HyperbandSearchCV.metadata (I'm open to suggestions!)
  • Adds some notes to Hyperband's documentation.
  • Warns the user about unbalanced chunks.
  • Adds a comparison with RandomizedSearchCV to HyperbandSearchCV.metadata.

Reference issues/PRs

TODO:

  • change n_models to n_params, and add note in documentation about it being approximate
  • (blog posts) change rule of thumb to evenly chunk dask array.

@stsievert stsievert marked this pull request as draft May 24, 2020 03:38
@stsievert stsievert changed the title MAINT: show errors while scoring models in model selection MAINT, DOC: Modify Hyperband docs for first-time users May 24, 2020
@stsievert
Copy link
Member Author

  • make clear that each partial_fit call sees one chunk of the data

Base automatically changed from master to main February 2, 2021 03:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant