Commit graph

26 commits

Author SHA1 Message Date
Igor Ilic
8879f3fbbe
feat: Add gemini support [COG-1023] (#485)
<!-- .github/pull_request_template.md -->

## Description
PR to test Gemini PR from holchan

1. Add Gemini LLM and Gemini Embedding support 
2. Fix CodeGraph issue with chunks being bigger than maximum token value
3. Add Tokenizer adapters to CodeGraph

## DCO Affirmation
I affirm that all code in every commit of this pull request conforms to
the terms of the Topoteretes Developer Certificate of Origin


<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
    - Added support for the Gemini LLM provider.
    - Expanded LLM configuration options.
- Introduced a new GitHub Actions workflow for multimetric QA
evaluation.
- Added new environment variables for LLM and embedding configurations
across various workflows.

- **Bug Fixes**
    - Improved error handling in various components.
    - Updated tokenization and embedding processes.
    - Removed warning related to missing `dict` method in data items.

- **Refactor**
    - Simplified token extraction and decoding methods.
    - Updated tokenizer interfaces.
    - Removed deprecated dependencies.
    - Enhanced retry logic and error handling in embedding processes.

- **Documentation**
    - Updated configuration comments and settings.

- **Chores**
- Updated GitHub Actions workflows to accommodate new secrets and
environment variables.
    - Modified evaluation parameters.
    - Adjusted dependency management for optional libraries.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: holchan <61059652+holchan@users.noreply.github.com>
Co-authored-by: Boris <boris@topoteretes.com>
2025-01-31 18:03:23 +01:00
Igor Ilic
46fec64195 test: Test ubuntu 24.04 2025-01-09 18:38:40 +01:00
Igor Ilic
41613436ca chore: Set fixed ubuntu version to 22.04 2025-01-08 15:57:07 +01:00
Igor Ilic
14adb6bead chore: Update poetry version in github actions 2025-01-08 15:08:32 +01:00
Igor Ilic
2e1480d8c0 chore: Remove if condition to allow gh actions to trigger on push to PR 2025-01-08 15:01:19 +01:00
vasilije
98cc84aa28 Fixes to our demo 2024-12-16 21:30:29 +01:00
Vasilije
5609bbccc8 removed issues 2024-12-11 13:13:19 +01:00
Igor Ilic
d254471023 test: Update gh actions so they can run outside of PR to main
Allow github actions to run on PRs that aren't targeting main

Test
2024-12-06 11:09:26 +01:00
Igor Ilic
13b79320b6 fix: Resolve issue with gh actions not installing optional packages
Add install of optional databases packages for database gh actions

Fix COG-595
2024-12-02 14:54:20 +01:00
Boris
52180eb6b5
feat: COG-184 add falkordb (#192)
* feat: add falkordb adapter

---------

Co-authored-by: hajdul88 <52442977+hajdul88@users.noreply.github.com>
2024-11-11 18:20:52 +01:00
Leon Luithlen
9192b04dc8 Change to AND operator and move from concurrency to run 2024-11-11 14:55:50 +01:00
Leon Luithlen
236a8c1d3f Move github actions if condition 2024-11-08 14:51:08 +01:00
Leon Luithlen
c2dfe25ef2 Try run-checks approach 2024-11-08 14:44:49 +01:00
Leon Luithlen
c62800c2f0 Remove automatic execution of test that require LLM inputs from merge requests onto main 2024-11-08 14:26:20 +01:00
Boris
a9433e9283
feat: add sqlalchemy as dlt destination (#137)
* feat: add sqlalchemy as dlt destination

* Fix the demo, update Readme

* fix: add 1.5 notebook

---------

Co-authored-by: Vasilije <8619304+Vasilije1990@users.noreply.github.com>
2024-09-21 15:58:28 +02:00
Boris
1c77337818
chore: remove unnecessary env variables (#136)
* chore: remove unnecessary env variables
2024-09-12 22:37:54 +02:00
Boris
94a674a088
feat: split document reader from chunker (#131)
* fix: abstract chunking into a separate class

* fix: yield merged text from text chunker

* fix: split python version tests

* fix: change postgres live check

* fix: remove unnecessary code

* fix: update checkout action

* fix: update setup-python action

* fix: add PG_USER env variable

* fix: make sure relationship_name is used everywhere

* fix: remove duplicate import
2024-08-19 14:36:10 +02:00
Boris Arzentar
ed6e8eb0d2 fix: wait for postgres to be ready before tests 2024-08-06 16:11:48 +02:00
Boris Arzentar
e492a18987 fix: add env variables to test workflows 2024-08-06 15:59:33 +02:00
Boris Arzentar
896a2ce953 fix: add postgres service to tests 2024-08-06 15:54:56 +02:00
Boris Arzentar
a590c6ae5b fix: run tests on ubuntu 2024-08-06 15:50:40 +02:00
Boris Arzentar
0dad12c6cf fix: upgrade buildx action 2024-08-06 15:48:50 +02:00
Boris Arzentar
3577be3d08 fix: change github actions names 2024-06-12 22:40:39 +02:00
Boris Arzentar
0603fa831c test: add github action running weaviate integration test 2024-06-12 22:36:57 +02:00
Vasilije
f5c0e274dd Add qdrant test 2024-06-12 22:07:56 +02:00
Vasilije
b6a2a40a2d Add qdrant test 2024-06-12 22:05:00 +02:00