alekszievr a4ad1702ed Feat/cog 946 abstract eval dataset (#418) ... * QA eval dataset as argument, with hotpot and 2wikimultihop as options. Json schema validation for datasets. * Load dataset file by filename, outsource utilities * Use requests.get instead of wget		2025-01-14 11:33:55 +01:00
..
cloud	Add -y to setup_ubuntu_instance.sh commands and update EC2_README	2024-11-29 11:30:39 +01:00
test_datasets/initial_test	Updated evals, added falkordb	2024-05-20 14:41:08 +02:00
__init__.py	add test for linter	2024-05-25 22:18:07 +02:00
deepeval_metrics.py	ruff format	2025-01-05 19:09:08 +01:00
EC2_README.md	Add code formating to usermod command	2024-11-29 11:30:39 +01:00
eval_on_hotpot.py	Feat/cog 946 abstract eval dataset (#418)	2025-01-14 11:33:55 +01:00
eval_swe_bench.py	Fix: deleting incorrect repo path	2025-01-10 15:54:45 +01:00
eval_utils.py	ruff format	2025-01-05 19:09:08 +01:00
generate_test_set.py	Fix linter issues	2025-01-05 19:48:35 +01:00
official_hotpot_metrics.py	ruff format	2025-01-05 19:09:08 +01:00
qa_dataset_utils.py	Feat/cog 946 abstract eval dataset (#418)	2025-01-14 11:33:55 +01:00
simple_rag_vs_cognee_eval.py	Fix linter issues	2025-01-05 19:48:35 +01:00