Skip to content

Commit

Permalink
Fix Readme a bit
Browse files Browse the repository at this point in the history
  • Loading branch information
Harsh-br0 committed Aug 27, 2024
1 parent ec34dbb commit db8e355
Showing 1 changed file with 3 additions and 3 deletions.
6 changes: 3 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -19,11 +19,11 @@
### Models Used
- `sentence-transformers/all-mpnet-base-v2`
It is used for embedding vectors and this will run locally. Initally it will download the model into `models` directory.
It is used for embedding vectors and this will run locally. Initially it will download the model into `models` directory.
- `TinyLlama/TinyLlama-1.1B-Chat-v1.0`
It is the main LLM and being used through the HuggingFace Hub Inference API.
It is the main LLM that being used through the HuggingFace Hub Inference API.
> Note: Since it is using Inference API and a model locally, the setup would be too slow 😓. On my side, it took more than 2 mins exactly to add a document of 45+ pages to vector store and almost 1 min to process the messages with LLM.
> Note: Since it is using Inference API and a model locally, the setup would be too slow. On my side, it took more than 2 mins exactly to add a document of 45+ pages to vector store and almost 1 min to process the messages with LLM.

0 comments on commit db8e355

Please sign in to comment.