cognee/cognee
alekszievr 433264d4e4
feat: Add context evaluation to eval framework [COG-1366] (#586)
<!-- .github/pull_request_template.md -->

## Description
<!-- Provide a clear description of the changes in this PR -->

## DCO Affirmation
I affirm that all code in every commit of this pull request conforms to
the terms of the Topoteretes Developer Certificate of Origin


<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Introduced a class-based retrieval mechanism to enhance answer
generation with improved context extraction and completion.
- Added a new evaluation metric for contextual relevancy and an option
to enable context evaluation during the evaluation process.

- **Refactor**
- Transitioned from a function-based answer resolver to a more modular
retriever approach to improve extensibility.

- **Tests**
- Updated tests to align with the new answer generation and evaluation
process.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: lxobr <122801072+lxobr@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: Daniel Molnar <soobrosa@gmail.com>
Co-authored-by: Boris <boris@topoteretes.com>
2025-03-05 16:40:24 +01:00
..
api Feature/cog 1312 integrating evaluation framework into dreamify (#562) 2025-03-03 19:55:47 +01:00
eval_framework feat: Add context evaluation to eval framework [COG-1366] (#586) 2025-03-05 16:40:24 +01:00
exceptions ruff format 2025-01-05 19:09:08 +01:00
infrastructure Change data models for gemini (#600) 2025-03-04 14:09:28 +01:00
modules feat: entity brute force triplet search [COG-1325] (#589) 2025-03-05 11:17:58 +01:00
shared Change data models for gemini (#600) 2025-03-04 14:09:28 +01:00
tasks feat: entity brute force triplet search [COG-1325] (#589) 2025-03-05 11:17:58 +01:00
tests feat: Add context evaluation to eval framework [COG-1366] (#586) 2025-03-05 16:40:24 +01:00
__init__.py Change data models for gemini (#600) 2025-03-04 14:09:28 +01:00
base_config.py Update base_config.py 2025-01-16 13:19:43 +01:00
fetch_secret.py ruff format 2025-01-05 19:09:08 +01:00
low_level.py fix: custom model pipeline (#508) 2025-02-08 02:00:15 +01:00
pipelines.py feat: expose cognee.pipelines (#125) 2024-07-27 10:01:44 +02:00
root_dir.py ruff format 2025-01-05 19:09:08 +01:00