alekszievr 4e3a666b33 Feat: Save and load contexts and answers for eval (#462) ... * feat: make tasks a configurable argument in the cognify function * fix: add data points task * eval on random samples instead of first couple * Save and load contexts and answers * Fix random seed usage and handle empty descriptions * include insights search in cognee option * create output dir if doesnt exist --------- Co-authored-by: lxobr <122801072+lxobr@users.noreply.github.com>		2025-01-22 16:17:01 +01:00
..
cloud	Add -y to setup_ubuntu_instance.sh commands and update EC2_README	2024-11-29 11:30:39 +01:00
test_datasets/initial_test	Updated evals, added falkordb	2024-05-20 14:41:08 +02:00
__init__.py	add test for linter	2024-05-25 22:18:07 +02:00
deepeval_metrics.py	Feat/cog 950 improve metric selection (#435)	2025-01-15 10:45:55 +01:00
EC2_README.md	Add code formating to usermod command	2024-11-29 11:30:39 +01:00
eval_on_hotpot.py	Feat: Save and load contexts and answers for eval (#462)	2025-01-22 16:17:01 +01:00
eval_swe_bench.py	Fix: deleting incorrect repo path	2025-01-10 15:54:45 +01:00
eval_utils.py	ruff format	2025-01-05 19:09:08 +01:00
generate_test_set.py	Fix linter issues	2025-01-05 19:48:35 +01:00
official_hotpot_metrics.py	Incremental eval of cognee pipeline (#445)	2025-01-17 14:16:48 +01:00
promptfoo_config_template.yaml	Feat/cog 950 improve metric selection (#435)	2025-01-15 10:45:55 +01:00
promptfoo_metrics.py	Feat: Save and load contexts and answers for eval (#462)	2025-01-22 16:17:01 +01:00
promptfoo_wrapper.py	Feat/cog 950 improve metric selection (#435)	2025-01-15 10:45:55 +01:00
promptfooprompt.json	Feat/cog 950 improve metric selection (#435)	2025-01-15 10:45:55 +01:00
qa_context_provider_utils.py	Feat: Save and load contexts and answers for eval (#462)	2025-01-22 16:17:01 +01:00
qa_dataset_utils.py	Feat/cog 950 improve metric selection (#435)	2025-01-15 10:45:55 +01:00
qa_eval_parameters.json	Feat: Save and load contexts and answers for eval (#462)	2025-01-22 16:17:01 +01:00
qa_eval_utils.py	Incremental eval of cognee pipeline (#445)	2025-01-17 14:16:48 +01:00
qa_metrics_utils.py	Run eval on a set of parameters and save them as png and json (#443)	2025-01-17 00:18:51 +01:00
run_qa_eval.py	Feat: Save and load contexts and answers for eval (#462)	2025-01-22 16:17:01 +01:00
simple_rag_vs_cognee_eval.py	Fix linter issues	2025-01-05 19:48:35 +01:00