Suraj a46d0422cf Add note about LG3 finetuning notebook 1 年之前
..
llama_guard a46d0422cf Add note about LG3 finetuning notebook 1 年之前
prompt_guard d1d08f9b82 Update promptguard model-id 1 年之前
Purple_Llama_Anyscale.ipynb f53f17138b fix dead links after refactor 1 年之前
Purple_Llama_OctoAI.ipynb f53f17138b fix dead links after refactor 1 年之前
README.md 308026aad5 Adds tentative llamaguard HF model id, eos_token_id for model.generate 1 年之前
code_shield_usage_demo.ipynb 77156c7324 Minor file renames 1 年之前
input_output_guardrails_with_llama.ipynb a404c9249c Notebook to demonstrate using llama and llama-guard together using OctoAI 1 年之前

README.md

Meta Llama Guard

Meta Llama Guard models provide input and output guardrails for LLM inference. For more details, please visit the main repository.

Note Please find the right model on HF side here.

Running locally

The llama_guard folder contains the inference script to run Meta Llama Guard locally. Add test prompts directly to the inference script before running it.

Running on the cloud

The notebooks Purple_Llama_Anyscale & Purple_Llama_OctoAI contain examples for running Meta Llama Guard on cloud hosted endpoints.