yangdx
|
f988a22652
|
Add token limit validation for character-only chunking
- Add ChunkTokenLimitExceededError exception
- Validate chunks against token limits
- Include chunk preview in error messages
- Add comprehensive test coverage
- Log warnings for oversized chunks
|
2025-11-19 18:32:43 +08:00 |
|