Introduction
Welcome to the dev portal for the sunholo project, which is the open-source component for the Sunholo Multivac.
sunholo is a library of helpful utilities for deploying GenAI applications on the cloud. It includes various python modules and functions that have been needed to help develop GenAI applications called VACs (Virtual Agent Computers) on the Multivac system. Whilst its primary purpose is to enable Multivac applications, it may also be useful for more general GenAI applications, for instance if you are looking for ways to manage many GenAI configurations.
Skills needed
To start using the package, a good background is:
- Basic Python skills
- Knowledge about GenAI models and components such as vectorstores
- Can deploy a GenAI application, such as a Langchain Langserve template or a LlamaIndex app.
- Familiar with cloud providers, in particular Google Cloud Platform
If you have the above, then you should be able to get some value from the sunholo package.
Getting started
sunholo is available on pip https://pypi.org/project/sunholo/
Minimal deps:
pip install sunholo
All dependencies:
pip install sunholo[all]
Sunholo CLI:
pip install sunholo[cli]
pip install sunholo[database]
Google Cloud Platform:
pip install sunholo[gcp]
OpenAI
pip install sunholo[openai]
Anthropic
pip install sunholo[anthropic]
HTTP tools
pip install sunholo[http]
Chunking and embedding pipeline
pip install sunholo[pipeline]
Tests via pytest
If loading from GitHub, run tests:
pip install pytest
pip install . --use-feature=in-tree-build
pytest tests
Legacy
Sunholo is derived from the Edmonbrain project, the original blog post you can read here: https://code.markedmondson.me/running-llms-on-gcp/ and owes a lot to Langchain ( https://github.com/langchain-ai/langchain )
