mirror of https://github.com/OneUptime/oneuptime.git synced 2026-04-06 00:32:12 +02:00

Files

Simon Larsen 94956b045a refactor: Improve comments in code and update job function in app.py

This commit refactors the code by improving the comments in the code and updating the job function in app.py. The comments are now focused on code that is hard to understand, and unnecessary comments are removed. The job function is converted to an async function to support asynchronous processing, which improves the performance and responsiveness of the application. These changes enhance the readability and efficiency of the codebase.

2024-06-20 10:00:07 +00:00

Models

refactor: Update Dockerfile.tpl to use huggingface/transformers-pytorch-gpu image

2024-06-19 13:20:34 +00:00

app.py

refactor: Improve comments in code and update job function in app.py

2024-06-20 10:00:07 +00:00

Dockerfile.tpl

refactor: Update Dockerfile.tpl to use huggingface/transformers-pytorch-gpu image

2024-06-19 13:06:23 +00:00

Readme.md

enable gpu on llama docker

2023-10-18 12:07:37 +01:00

requirements.txt

refactor: Sanitize file path in CodeRepositoryUtil.getFileContent()

2024-06-20 10:26:16 +01:00

tsconfig.json

Update tsconfig.json files with resolveJsonModule option

2024-04-08 14:03:07 +01:00

Readme.md

Llama

Prepare

Download models from meta
Once the model is downloaded, place them in the Llama/Models folder. Please make sure you also place tokenizer.model and tokenizer_checklist.chk in the same folder.
Edit Dockerfile to include the model name in the MODEL_NAME variable.
Docker build

docker build -t llama . -f ./Llama/Dockerfile

Run

For Linux

docker run --gpus all -p 8547:8547 -it -v ./Llama/Models:/app/Models llama

For MacOS

docker run -p 8547:8547 -it -v ./Llama/Models:/app/Models llama

Run without a docker conatiner

uvicorn app:app --host 0.0.0.0 --port 8547