瀏覽代碼

[OctoAI] Introducing a Video Generation use case featuring Llama3 (#496)

Hamid Shojanazeri 11 月之前
父節點
當前提交
ccab291ce5
共有 3 個文件被更改,包括 706 次插入1 次删除
  1. 698 0
      recipes/use_cases/MediaGen.ipynb
  2. 5 1
      recipes/use_cases/README.md
  3. 3 0
      scripts/spellcheck_conf/wordlist.txt

文件差異過大導致無法顯示
+ 698 - 0
recipes/use_cases/MediaGen.ipynb


+ 5 - 1
recipes/use_cases/README.md

@@ -14,4 +14,8 @@ This step-by-step tutorial shows how to use the [WhatsApp Business API](https://
 This step-by-step tutorial shows how to use the [Messenger Platform](https://developers.facebook.com/docs/messenger-platform/overview) to build a Llama 3 enabled Messenger chatbot.
 
 ### RAG Chatbot Example (running [locally](./chatbots/RAG_chatbot/RAG_Chatbot_Example.ipynb) or on [OctoAI](../llama_api_providers/OctoAI_API_examples/RAG_Chatbot_example/RAG_Chatbot_Example.ipynb))
-A complete example of how to build a Llama 3 chatbot hosted on your browser that can answer questions based on your own data using retrieval augmented generation (RAG). You can run Llama2 locally if you have a good enough GPU or on OctoAI if you follow the note [here](../README.md#octoai_note).
+A complete example of how to build a Llama 3 chatbot hosted on your browser that can answer questions based on your own data using retrieval augmented generation (RAG). You can run Llama2 locally if you have a good enough GPU or on OctoAI if you follow the note [here](../README.md#octoai_note).
+
+## [Media Generation](./MediaGen.ipynb): Building a Video Generation Pipeline with Llama3
+
+This step-by-step tutorial shows how to use leverage Llama 3 to drive the generation of animated videos using SDXL and SVD. More specifically it relies on JSON formatting to produce a scene-by-scene story board of a recipe video. The user provides the name of a dish, then Llama 3 describes a step by step guide to reproduce the said dish. This step by step guide is brought to life with models like SDXL and SVD.

+ 3 - 0
scripts/spellcheck_conf/wordlist.txt

@@ -1314,3 +1314,6 @@ AgentExecutor
 LangGraph
 langgraph
 vectorstore
+MediaGen
+SDXL
+SVD