1. Dynamic metadata retrieval, refactored function 2. Load with using marshmallow, allows dynamic fields now 3. Added chunkers, different varieties 4. Fixed PDF loading so it is better standardized
7 lines
148 B
Python
7 lines
148 B
Python
from enum import Enum
|
|
|
|
class ChunkStrategy(Enum):
|
|
EXACT = 'exact'
|
|
PARAGRAPH = 'paragraph'
|
|
SENTENCE = 'sentence'
|
|
VANILLA = 'vanilla'
|