cognee/evals
alekszievr 4e3a666b33
Feat: Save and load contexts and answers for eval (#462)
* feat: make tasks a configurable argument in the cognify function

* fix: add data points task

* eval on random samples instead of first couple

* Save and load contexts and answers

* Fix random seed usage and handle empty descriptions

* include insights search in cognee option

* create output dir if doesnt exist

---------

Co-authored-by: lxobr <122801072+lxobr@users.noreply.github.com>
2025-01-22 16:17:01 +01:00
..
cloud
test_datasets/initial_test
__init__.py
deepeval_metrics.py
EC2_README.md
eval_on_hotpot.py Feat: Save and load contexts and answers for eval (#462) 2025-01-22 16:17:01 +01:00
eval_swe_bench.py
eval_utils.py
generate_test_set.py
official_hotpot_metrics.py Incremental eval of cognee pipeline (#445) 2025-01-17 14:16:48 +01:00
promptfoo_config_template.yaml
promptfoo_metrics.py Feat: Save and load contexts and answers for eval (#462) 2025-01-22 16:17:01 +01:00
promptfoo_wrapper.py
promptfooprompt.json
qa_context_provider_utils.py Feat: Save and load contexts and answers for eval (#462) 2025-01-22 16:17:01 +01:00
qa_dataset_utils.py
qa_eval_parameters.json Feat: Save and load contexts and answers for eval (#462) 2025-01-22 16:17:01 +01:00
qa_eval_utils.py Incremental eval of cognee pipeline (#445) 2025-01-17 14:16:48 +01:00
qa_metrics_utils.py
run_qa_eval.py Feat: Save and load contexts and answers for eval (#462) 2025-01-22 16:17:01 +01:00
simple_rag_vs_cognee_eval.py