Commit graph

11 commits

Author SHA1 Message Date
Igor Ilic
8879f3fbbe
feat: Add gemini support [COG-1023] (#485)
<!-- .github/pull_request_template.md -->

## Description
PR to test Gemini PR from holchan

1. Add Gemini LLM and Gemini Embedding support 
2. Fix CodeGraph issue with chunks being bigger than maximum token value
3. Add Tokenizer adapters to CodeGraph

## DCO Affirmation
I affirm that all code in every commit of this pull request conforms to
the terms of the Topoteretes Developer Certificate of Origin


<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
    - Added support for the Gemini LLM provider.
    - Expanded LLM configuration options.
- Introduced a new GitHub Actions workflow for multimetric QA
evaluation.
- Added new environment variables for LLM and embedding configurations
across various workflows.

- **Bug Fixes**
    - Improved error handling in various components.
    - Updated tokenization and embedding processes.
    - Removed warning related to missing `dict` method in data items.

- **Refactor**
    - Simplified token extraction and decoding methods.
    - Updated tokenizer interfaces.
    - Removed deprecated dependencies.
    - Enhanced retry logic and error handling in embedding processes.

- **Documentation**
    - Updated configuration comments and settings.

- **Chores**
- Updated GitHub Actions workflows to accommodate new secrets and
environment variables.
    - Modified evaluation parameters.
    - Adjusted dependency management for optional libraries.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: holchan <61059652+holchan@users.noreply.github.com>
Co-authored-by: Boris <boris@topoteretes.com>
2025-01-31 18:03:23 +01:00
Igor Ilic
ff6d8cb367 test: change all actions to ubuntu-latest 2025-01-09 18:49:45 +01:00
Igor Ilic
ab29a6448d chore: update ubuntu version to 22.04 2025-01-08 16:02:58 +01:00
Igor Ilic
14adb6bead chore: Update poetry version in github actions 2025-01-08 15:08:32 +01:00
Igor Ilic
2e1480d8c0 chore: Remove if condition to allow gh actions to trigger on push to PR 2025-01-08 15:01:19 +01:00
vasilije
98cc84aa28 Fixes to our demo 2024-12-16 21:30:29 +01:00
Vasilije
604550ba75
Merge pull request #346 from topoteretes/fix-test-deduplication
fix: Resolve issue with test deduplication github action
2024-12-12 13:10:41 +01:00
Boris Arzentar
aa46bb3d64 fix: enable checks for dev 2024-12-12 12:46:26 +01:00
Igor Ilic
4811dd9375 fix: Resolve issue with test deduplication github action
Remove calling unused get docs github action

Fix
2024-12-11 17:20:14 +01:00
Igor Ilic
add6730b9e test: Add testing of dataset data table content
Add testing of dataset data table content

Test COG-505
2024-12-05 19:37:12 +01:00
Igor Ilic
813b76c9c2 test: Add test for text deduplication
Added end to end test for text deduplication

Test COG-505
2024-12-05 19:25:50 +01:00