Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Have you compared the results with FaluBERT? #25

Open
LeMoussel opened this issue Aug 9, 2022 · 1 comment
Open

Have you compared the results with FaluBERT? #25

LeMoussel opened this issue Aug 9, 2022 · 1 comment

Comments

@LeMoussel
Copy link

LeMoussel commented Aug 9, 2022

Have you compared the results on the analysis of French sentiment with BERT, based on FlauBERT?

Rem: The CamemBERT algorithm seems to have learning problems with the Tensorflow library: Github Issue

@TheophileBlard
Copy link
Owner

Hi @LeMoussel !

No, I did no try to finetune FlauBERT. This model came a bit later and I was already satisfied with the results of CamemBERT.
I did not experienced any issue with the TF implementation, as my validation nicely converged to >97%.

I however compared the results they reported in their paper with those of my model in this section. On their FLUE task, my CamemBERT model (trained on movie reviews) performs better than FlauBERT, even though their model was specifically trained for this task. So I would say that both models have comparable performance, it's more about the dataset they are trained on.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants