raft.yaml 2.1 KB

123456789101112131415161718192021222324252627282930313233
  1. COT_prompt_template: >
  2. Question: {question}\nContext: {context}\n
  3. Answer this question using the information given in the context above. Here is things to pay attention to:
  4. - First provide step-by-step reasoning on how to answer the question.
  5. - In the reasoning, if you need to copy paste some sentences from the context, include them in ##begin_quote## and ##end_quote##. This would mean that things outside of ##begin_quote## and ##end_quote## are not directly copy paste from the context.
  6. - End your response with final answer in the form <ANSWER>: $answer, the answer should be succinct.
  7. You MUST begin your final answer with the tag "<ANSWER>:
  8. # question_prompt_template: >
  9. # You are a synthetic question-answer pair generator. Given a chunk of context about
  10. # some topic(s), generate {num_questions} example questions a user could ask and would be answered
  11. # \using information from the chunk. For example, if the given context was a Wikipedia
  12. # paragraph about the United States, an example question could be 'How many states are
  13. # in the United States?
  14. # The questions should be able to be answered in a few words or less. Include only the
  15. # questions in your response.
  16. question_prompt_template: >
  17. You are a language model skilled in creating quiz questions.
  18. You will be provided with a document,
  19. read it and please generate question and answer pairs that are most likely be asked by a user of Llama language models,
  20. which includes LLama, Llama2, Meta Llama3, Code Llama, Meta Llama Guard 1, Meta Llama Guard 2,
  21. Output only the questions related to Llama:
  22. please make sure you follow those rules:
  23. 1. Generate {num_questions} question answer pairs, you can generate less answer if there is nothing related to model, training, fine-tuning and evaluation details of Llama language models, .
  24. 2. The questions can be answered based *solely* on the given passage.
  25. 3. Avoid asking questions with similar meaning.
  26. 4. Never use any abbreviation.
  27. 5. Include only the questions in your response.
  28. data_dir: "./data"
  29. num_questions: 2