Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Question about training #34

Open
wuqiyao20160118 opened this issue May 20, 2019 · 2 comments
Open

Question about training #34

wuqiyao20160118 opened this issue May 20, 2019 · 2 comments

Comments

@wuqiyao20160118
Copy link

I use your training code with pretrained AlexNet to train SiamRPN, but the performance is pretty bad when only using VID dataset. I use the test code provided by arbitularov. When testing your pretrained model on OTB2015, the success score is 0.577 and the precision score is 0.772. However when using the saved model produced during my training, the performance is worser (success rate is about 0.45 and the precision score is about 0.61). I'm wondering if the huge gap is origined from the lack of Youtube dataset or just the fluctuation of the training.

@HelloRicky123
Copy link
Owner

According to my experience, I can get about 0.53 AUC on OTB100 with only vid dataset and 0.63 AUC with vid and youtube-bb. So the gap is not small.

@wuqiyao20160118
Copy link
Author

Thanks for your reply. I have tried to add GOT-10k dataset into training. It seems that the performance improves a little, but it does not perform as well as yours. (Both success score and percision score improves 0.05.) Maybe Youtube dataset is better? Or I should switch some training configuration like learning rate and some other hyperparameters?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants