Cyrus Nikolaidis
883def17f0
Prompt Guard Inference for long strings
|
1 年之前 | |
|---|---|---|
| .. | ||
| llama_guard | 1 年之前 | |
| prompt_guard | 1 年之前 | |
| Purple_Llama_Anyscale.ipynb | 1 年之前 | |
| Purple_Llama_OctoAI.ipynb | 1 年之前 | |
| README.md | 1 年之前 | |
| code_shield_usage_demo.ipynb | 1 年之前 | |
| input_output_guardrails_with_llama.ipynb | 1 年之前 | |
README.md
Meta Llama Guard
Meta Llama Guard and Meta Llama Guard 2 are new models that provide input and output guardrails for LLM inference. For more details, please visit the main repository.
Note Please find the right model on HF side here.
Running locally
The llama_guard folder contains the inference script to run Meta Llama Guard locally. Add test prompts directly to the inference script before running it.
Running on the cloud
The notebooks Purple_Llama_Anyscale & Purple_Llama_OctoAI contain examples for running Meta Llama Guard on cloud hosted endpoints.