Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Fix] Fixing experiments configurations, expanding dataset, rerun of experiments, reanalyzing results, updating imports #6

Merged
merged 10 commits into from
Sep 28, 2024
Merged

[Fix] Fixing experiments configurations, expanding dataset, rerun of experiments, reanalyzing results, updating imports #6

merged 10 commits into from
Sep 28, 2024

Conversation

Shekswess
Copy link
Owner

The tasks done for this PR are:

  • Fixing the configuration files for the experiments, specifically the LLM settings to make the systems more deterministic
  • Expanding the dataset with new paper
  • Rerunning the experiments
  • Analyzing the experiments and results
  • Updating imports and package requirements
  • Updating the README.md with missing information and new results

Shekswess and others added 10 commits September 26, 2024 00:07
@Shekswess
Updating the notebook for analyzing results by analyzing separately t…
1dcdc2b 
…he simple RAG pipelines and the mixture RAG pipelines plus the combined results
@Shekswess
Corrected and updated the config files to make LLM settings more dete…
d65e40b 
…rministic
@Shekswess
Added new pdf for the gpt-4o family models and updated the vector dat…
31bcb7c 
…abase
@Shekswess
Updating the requirements.txt file
2fddcc1
@Shekswess
Updating the LangChain imports with latest ones
0e5d0c3
@Shekswess
Updating the LLM Judge to be stricter and more deterministic and addi…
f5f178a 
…ng one more question for evaluation for the new paper
@Shekswess
Updating the notebook to have analysis for separate for Simple RAG, f…
513b183 
…or Mixture RAG and combined results + the results
@Shekswess
Updating the pipeline to take into considuration only the new results
4e152aa
@Shekswess
Updated the README.md with the new results and some missing informati…
158369b 
…on about the pipelines
@Shekswess @github-actions
Code formatted with ruff
1c15c95
@Shekswess Shekswess merged commit ede4d05 into main Sep 28, 2024
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@Shekswess