Skip to content

EdgeRag is a program that runs large language models and vector databases on your local device

License

Notifications You must be signed in to change notification settings

adammikulis/EdgeRag

Repository files navigation

EdgeRag

EdgeRag is a Retrieval Augmented Generative (RAG) Artificial Intelligence (AI) pipeline that is based on LLamaSharp and Microsoft's Kernel Memory. It uses Godot 4.2.1 mono and requires .NET8. You can run many popular models (llama, mistral, mixtral, phi) and add nearly any sort of document to the vector database to query.

Download a Mistral model from here: https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.2-GGUF

Download a Phi model from here: https://huggingface.co/TheBloke/phi-2-GGUF

About

EdgeRag is a program that runs large language models and vector databases on your local device

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages