Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Hi, a little bit confuse about your code, please give me some help. #1

Open
tbwxmu opened this issue Nov 24, 2019 · 2 comments
Open

Hi, a little bit confuse about your code, please give me some help. #1

tbwxmu opened this issue Nov 24, 2019 · 2 comments

Comments

@tbwxmu
Copy link

tbwxmu commented Nov 24, 2019

I noticed that they use the "Save and Load Checkpoints" to synchronize all models in different process in the PyTorch tutorial https://pytorch.org/tutorials/intermediate/ddp_tutorial.html
image

So, I want to know if there are some implicit synchronization mechanisms in your distributed_tutorial code.
@LearnedVector
Copy link

hello @tbwxmu did you figure this out?

@linminhtoo
Copy link

linminhtoo commented Jan 6, 2021 •
edited
Loading

Anyone has a solution for this?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@LearnedVector @linminhtoo @tbwxmu