fix: tiktoken upgrade (#587)

<!-- .github/pull_request_template.md -->

## Description
<!-- Provide a clear description of the changes in this PR -->

## DCO Affirmation
I affirm that all code in every commit of this pull request conforms to
the terms of the Topoteretes Developer Certificate of Origin


<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **Chores**
- Removed an outdated internal tracking reference to streamline
maintenance.
- Upgraded a key dependency to its latest stable release, delivering
enhanced performance and reliability for a smoother user experience.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
This commit is contained in:
Boris 2025-02-27 18:16:11 +01:00 committed by GitHub
parent d27f847753
commit e8ab5b4797
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
3 changed files with 353 additions and 342 deletions

@ -1 +0,0 @@
Subproject commit 130b84db9270734756d16918e5c86034777140fc

692
poetry.lock generated

File diff suppressed because it is too large Load diff

View file

@ -51,7 +51,7 @@ pypdf = "^4.1.0"
neo4j = {version = "^5.20.0", optional = true}
jinja2 = "^3.1.3"
matplotlib = "^3.8.3"
tiktoken = "0.7.0"
tiktoken = "0.9.0"
langchain_text_splitters = {version = "0.3.2", optional = true}
langsmith = {version = "0.2.3", optional = true}
langdetect = "1.0.9"