Hamid Shojanazeri 808a3f7a0c Adding support for FSDP+Qlora. (#572) 9 mesi fa
..
llama_guard 808a3f7a0c Adding support for FSDP+Qlora. (#572) 9 mesi fa
Purple_Llama_Anyscale.ipynb f53f17138b fix dead links after refactor 1 anno fa
Purple_Llama_OctoAI.ipynb f53f17138b fix dead links after refactor 1 anno fa
README.md 28eea83a52 Spellcheck error fixed 9 mesi fa
code_shield_usage_demo.ipynb 77156c7324 Minor file renames 9 mesi fa
input_output_guardrails_with_llama.ipynb a404c9249c Notebook to demonstrate using llama and llama-guard together using OctoAI 1 anno fa

README.md

Meta Llama Guard

Meta Llama Guard and Meta Llama Guard 2 are new models that provide input and output guardrails for LLM inference. For more details, please visit the main repository.

Note Please find the right model on HF side here.

Running locally

The llama_guard folder contains the inference script to run Meta Llama Guard locally. Add test prompts directly to the inference script before running it.

Running on the cloud

The notebooks Purple_Llama_Anyscale & Purple_Llama_OctoAI contain examples for running Meta Llama Guard on cloud hosted endpoints.