bb679c2dd7
* Update cognify and the networkx client to prepare for running in Neo4j * Fix for openai model * Add the fix to the infra so that the models can be passed to the library. Enable llm_provider to be passed. * Auto graph generation now works with neo4j * Added fixes for both neo4j and networkx * Explicitly name semantic node connections * Added updated docs, readme, chunkers and updates to cognify * Make docs build trigger only when changes on it happen * Update docs, test git actions * Separate cognify logic into tasks * Introduce dspy knowledge graph extraction --------- Co-authored-by: Boris Arzentar <borisarzentar@gmail.com>
133 lines
No EOL
3.4 KiB
Markdown
133 lines
No EOL
3.4 KiB
Markdown
# cognee
|
|
|
|
Deterministic LLMs Outputs for AI Engineers using graphs, LLMs and vector retrieval
|
|
|
|
|
|
<p>
|
|
<a href="https://cognee.ai" target="_blank">
|
|
<img src="https://raw.githubusercontent.com/topoteretes/cognee/main/assets/cognee-logo.png" width="160px" alt="Cognee logo" />
|
|
</a>
|
|
</p>
|
|
|
|
|
|
<p>
|
|
<i>Open-source framework for creating self-improving deterministic outputs for LLMs.</i>
|
|
</p>
|
|
|
|
<p>
|
|
<a href="https://github.com/topoteretes/cognee/fork">
|
|
<img src="https://img.shields.io/github/forks/topoteretes/cognee?style=for-the-badge" alt="cognee forks"/>
|
|
</a>
|
|
<a href="https://github.com/topoteretes/cognee/stargazers">
|
|
<img src="https://img.shields.io/github/stars/topoteretes/cognee?style=for-the-badge" alt="cognee stars"/>
|
|
</a>
|
|
<a href="https://github.com/topoteretes/cognee/pulls">
|
|
<img src="https://img.shields.io/github/issues-pr/topoteretes/cognee?style=for-the-badge" alt="cognee pull-requests"/>
|
|
</a>
|
|
<a href="https://github.com/topoteretes/cognee/releases">
|
|
<img src="https://img.shields.io/github/release/topoteretes/cognee?&label=Latest&style=for-the-badge" alt="cognee releases" />
|
|
</a>
|
|
</p>
|
|
|
|
|
|
|
|
If you need details, have a look at our <a href="https://topoteretes.github.io/cognee">documentation</a>
|
|
|
|
|
|
## 📦 Installation
|
|
|
|
With pip:
|
|
|
|
```bash
|
|
pip install "cognee[weaviate]"
|
|
```
|
|
|
|
With poetry:
|
|
|
|
```bash
|
|
poetry add "cognee[weaviate]"
|
|
```
|
|
|
|
## 💻 Usage
|
|
|
|
### Setup
|
|
|
|
```
|
|
import os
|
|
|
|
os.environ["WEAVIATE_URL"] = "YOUR_WEAVIATE_URL"
|
|
os.environ["WEAVIATE_API_KEY"] = "YOUR_WEAVIATE_API_KEY"
|
|
|
|
os.environ["OPENAI_API_KEY"] = "YOUR_OPENAI_API_KEY"
|
|
|
|
```
|
|
You can also use Ollama or Anyscale as your LLM provider. For more info on local models check our [docs](https://topoteretes.github.io/cognee)
|
|
|
|
### Run
|
|
|
|
```
|
|
import cognee
|
|
|
|
text = """Natural language processing (NLP) is an interdisciplinary
|
|
subfield of computer science and information retrieval"""
|
|
|
|
cognee.add(text) # Add a new piece of information
|
|
|
|
cognee.cognify() # Use LLMs and cognee to create knowledge
|
|
|
|
search_results = cognee.search("SIMILARITY", "computer science") # Query cognee for the knowledge
|
|
|
|
for result_text in search_results[0]:
|
|
print(result_text)
|
|
|
|
```
|
|
Add alternative data types:
|
|
```
|
|
cognee.add("file://{absolute_path_to_file}", dataset_name)
|
|
```
|
|
Or
|
|
```
|
|
cognee.add("data://{absolute_path_to_directory}", dataset_name)
|
|
|
|
# This is useful if you have a directory with files organized in subdirectories.
|
|
# You can target which directory to add by providing dataset_name.
|
|
# Example:
|
|
# root
|
|
# / \
|
|
# reports bills
|
|
# / \
|
|
# 2024 2023
|
|
#
|
|
# cognee.add("data://{absolute_path_to_root}", "reports.2024")
|
|
# This will add just directory 2024 under reports.
|
|
```
|
|
|
|
Read more [here](docs/index.md#run).
|
|
|
|
## Demo
|
|
|
|
Check out our demo notebook [here](https://github.com/topoteretes/cognee/blob/main/notebooks/cognee%20-%20Get%20Started.ipynb)
|
|
|
|
|
|
|
|
[<img src="https://i3.ytimg.com/vi/-ARUfIzhzC4/maxresdefault.jpg" width="100%">](https://www.youtube.com/watch?v=BDFt4xVPmro "Learn about cognee: 55")
|
|
|
|
|
|
|
|
|
|
|
|
## How it works
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
## 🚀 It's alive
|
|
|
|
<p>
|
|
Try it yourself on Whatsapp with one of our <a href="https://keepi.ai" target="_blank">partners</a> by typing `/save {content you want to save}` followed by `/query {knowledge you saved previously}`
|
|
For more info here are the <a href="https://topoteretes.github.io/cognee">docs</a>
|
|
</p> |