refactor: Update Llama app to use local model path instead of model ID

This commit updates the Llama app to use a local model path instead of a model ID. The model path is set to "/app/Models/Meta-Llama-3-8B-Instruct". This change improves the reliability and performance of the app by directly referencing the model file instead of relying on an external model ID.
This commit is contained in:
Simon Larsen
2024-06-18 21:41:29 +01:00
parent 095493cec9
commit 3f315be279
5 changed files with 19 additions and 24 deletions

View File

@@ -17,6 +17,8 @@ services:
extends:
file: ./docker-compose.base.yml
service: llama
ports:
- '8547:8547'
build:
network: host
context: .