Seonglae ChoDataset
Task description (meta prompt)
task_descript Summarizing or rewriting Wikipedia's randomly extracted, imperfect passages into structured text, enabling a language model to perform open-domain, single-hop, short-answer question answering
Summarizing or rewriting Wikipedia's randomly extracted, imperfect passages into structured text, enabling a language model to perform open-domain, single-hop, short-answer question answering
Summarizing or rewriting Wikipedia's randomly extracted, imperfect passages into structured text, thereby aiding another language model to perform open-domain, single-hop, short-answer question answering
Summarizing or rewriting Wikipedia's randomly extracted, imperfect passages into structured text, thereby aiding another language model to perform open-domain, single-hop, short-answer question answering
Initial prompt
initial_inst Rewrite the given passages to be easier for the reader answering the given question. The rewrited text should be half the total length of the original passages. Your response must be at least 200 words long. The given passages are related about the question topic. Use only information in the document. Reduce the noise unrelated to answer the question. Remove unrelated phrases and sentences to answer the question. Find the evidences that support the answer to the question and retain them. Print only the rewrited texts The final answer for this question is contained is the passages so maintain the exact span of answer smaller than 5 words.
Condense the provided passages to focus on key elements directly answering the question. Your summary should be a third of the original passages' length and at least 100 words. Highlight critical information and evidence supporting the answer. Avoid generalizations or unrelated details. Ensure the final answer is present in the summary, keeping the exact span of the answer to under five words. Present the summary in a clear, bullet-point format for each key element related to the question. Aim for a balance between conciseness and completeness.
Your task is to rewrite the provided passages to enhance their specificity and precision in relation to the question. In your rewrite, you should: - Align the text closely with the key aspects of the question. - Your summary should be a half of the original passages' length and at least 150 words. - Prioritize information most likely to contain or support the answer. - Utilize summary tokens efficiently to cover relevant information comprehensively. - Ensure the rewritten text is clear, readable, and facilitates quick understanding. - Actively remove content that does not contribute to answering the question. - Understand the intent of the question and summarize to make it easier to find an answer according to the intent. Focus on maintaining the exact span of the answer to be smaller than 5 words, ensuring the most relevant and specific information is included in the rewrite.
Scorer
- EM reader
scorer_llm_name == == "gsm8k" extract_final_answer_by_prompting_again = True
중요한 부분: retrieval 추가해야함
Result
Score | Prompt | Initial |
40 | Refine the given passages to improve their precision and clarity in answering the question. The rewritten text should be half the length of the original passages. Your response must be at least 200 words long. The given passages pertain to the question topic. Use only the information provided in the document. Exclude any irrelevant phrases and sentences. Identify and keep the evidence that supports the answer. Print only the rewritten text. Make sure the exact span of the answer is smaller than 5 words. | ㅤ |
41 | Your task is to summarize and rewrite the given passages in a precise and clear manner, specifically addressing the question. The rewritten text should be approximately half the length of the original passages. Your response must be at least 200 words long. The given passages are directly related to the question topic. Utilize only the information provided in the document. Remove any unrelated phrases or sentences. Retain and present the evidence that supports the answer to the question. Print only the rewritten texts. Ensure that the exact span of the answer is smaller than 5 words. | ㅤ |
42 | In order to improve the precision and clarity of the provided passages in relation to the question, please rewrite them following the guidelines below:
- The rewritten text should be half the length of the original passages.
- Your response should be at least 200 words long.
- Ensure that the revised text remains directly related to the topic of the question.
- Utilize only the information provided in the document.
- Remove any irrelevant phrases or sentences that do not contribute to answering the question.
- Identify and retain evidence that supports the answer.
- Only include the rewritten text in your response.
- Make sure the exact span of the answer is smaller than 5 words.
By following these guidelines, you can create a more concise and precise version of the passages that effectively address the question. | ㅤ |
43 | Your task is to rewrite the provided passages to enhance their specificity and precision in relation to the question. In your rewrite, you should:
- Align the text closely with the key aspects of the question.
- Your summary should be a half of the original passages' length and at least 150 words.
- Prioritize information most likely to contain or support the answer.
- Utilize summary tokens efficiently to cover relevant information comprehensively.
- Ensure the rewritten text is clear, readable, and facilitates quick understanding.
- Actively remove content that does not contribute to answering the question.
- Understand the intent of the question and summarize to make it easier to find an answer according to the intent.
Focus on maintaining the exact span of the answer to be smaller than 5 words, ensuring the most relevant and specific information is included in the rewrite. | O |
43 | The following instructions will guide you in rewriting the provided passages to improve their precision and clarity in addressing the question:
- Your rewritten text should be half the length of the original passages.
- Your response should be at least 200 words long.
- Ensure that the rewritten text remains focused on the topic of the question.
- Use only the information provided in the document.
- Eliminate any phrases or sentences that are unrelated to answering the question.
- Identify and retain evidence that supports the answer to the question.
- Print only the rewritten text.
- Make sure that the exact span of the answer is smaller than 5 words.
By following these instructions, you will create a revised version of the passages that is more concise and precise, helping to address the question with clarity and accuracy. | ㅤ |
43 | Rewrite the given passages to enhance their precision and clarity in answering the question. Your rewritten text should be approximately half the length of the original passages. Your response should be at least 200 words long. Ensure that the revised text is directly related to the topic of the question. Use only the information provided in the document. Eliminate any irrelevant phrases or sentences. Identify and retain evidence that supports the answer. Print only the rewritten text. Make sure the exact span of the answer is limited to less than 5 words. | ㅤ |
44 | Your task is to rewrite the provided passages to enhance their specificity and precision in relation to the question. In your rewrite, you should:
- Align the text closely with the key aspects of the question.
- Your summary should be a half of the original passages' length and at least 150 words.
- Prioritize information most likely to contain or support the answer.
- Utilize summary tokens efficiently to cover relevant information comprehensively.
- Ensure the rewritten text is clear, readable, and facilitates quick understanding.
- Actively remove content that does not contribute to answering the question.
- Understand the intent of the question and summarize to make it easier to find an answer according to the intent.
Focus on maintaining the exact span of the answer to be smaller than 5 words, ensuring the most relevant and specific information is included in the rewrite. | O |
44 | ㅤ | ㅤ |
44 | ㅤ | ㅤ |
44 | ㅤ | ㅤ |
44 | ㅤ | ㅤ |
44 | ㅤ | ㅤ |
44 | ㅤ | ㅤ |
44 | ㅤ | ㅤ |
44 | ㅤ | ㅤ |
44 | ㅤ | ㅤ |
44 | ㅤ | ㅤ |
44 | ㅤ | ㅤ |
45 | Revise the given passages to make them more concise and focused on answering the question accurately. The rewritten text should be half the length of the original passages. Your response should be at least 200 words long.
Ensure that the revised text is related to the topic of the question.
Only include information from the document.
Eliminate irrelevant phrases and sentences that do not contribute to answering the question.
Identify and retain evidence that supports the answer to the question.
Only include the revised text in your response.
The final answer to the question is within the passages, so keep the exact answer span under 5 words. | ㅤ |
45 | Rewrite the given passages to enhance their precision, clarity, and relevance in addressing the question. Ensure that the rewritten text is approximately half the length of the original passages. Your response must be at least 200 words long. Only use information provided in the document. Remove any unrelated phrases or sentences. Identify and retain evidence that supports the answer. Print only the rewritten text. Make sure the exact span of the answer is smaller than 5 words. | ㅤ |
45 | Rewrite the provided passages to enhance their precision and clarity in addressing the question. Your rewritten text should be approximately half the length of the original passages. Your response should be at least 200 words long. Make sure that the revised text is directly related to the topic of the question. Use only the information provided in the document. Exclude any irrelevant phrases or sentences. Identify and retain evidence that supports the answer. Print only the rewritten text. Ensure that the exact span of the answer is smaller than 5 words. | ㅤ |
45 | To enhance the precision and clarity of the given passages in relation to the question, please rewrite them following these guidelines:
- The rewritten text should be half the length of the original passages.
- Your response should consist of at least 200 words.
- Ensure that the rewritten text remains relevant to the question topic.
- Use only the information provided in the document.
- Eliminate any phrases or sentences that are not related to answering the question.
- Identify and retain evidence that supports the answer.
- Only include the rewritten text in your response.
- Make sure the exact span of the answer is smaller than 5 words.
By following these guidelines, you can create a more concise and precise version of the passages, which will help address the question accurately and effectively. | ㅤ |
46 | Condense the provided passages to focus on key elements directly answering the question. Your summary should be a third of the original passages' length and at least 100 words. Highlight critical information and evidence supporting the answer. Avoid generalizations or unrelated details. Ensure the final answer is present in the summary, keeping the exact span of the answer to under five words. Present the summary in a clear, bullet-point format for each key element related to the question. Aim for a balance between conciseness and completeness. | O |
46 | Rewrite the given passages to be more concise and clear in answering the question. The rewritten text should be half the length of the original passages. Your response must be at least 200 words long. The given passages are related to the question topic. Use only information from the document. Remove any unrelated phrases and sentences. Find the evidence that supports the answer and retain it. Print only the rewritten texts. Make sure the exact span of the answer is smaller than 5 words. | ㅤ |
46 | Rewrite the provided passages to enhance their precision and clarity in addressing the question. The rewritten text should be approximately half the length of the original passages. Your response must be at least 200 words long. Ensure the revised text is directly related to the question topic. Utilize information solely from the document. Eliminate any irrelevant phrases and sentences. Identify and retain supporting evidence for the answer. Only include the rewritten texts in your response. Ensure the exact span of the answer is limited to under 5 words. | ㅤ |
46 | Your task is to rewrite the given passages to increase their accuracy and clarity in answering the question. The rewritten text should be half the length of the original passages. Your response should be at least 200 words long. The given passages are relevant to the question topic. Only use information from the document. Eliminate irrelevant phrases and sentences. Identify and retain evidence that supports the answer. Print only the rewritten texts. Make sure the exact span of the answer is smaller than 5 words | ㅤ |
46 | Your task is to rewrite the given passages to enhance their precision and clarity in addressing the question. The rewritten text should be approximately half the length of the original passages. Your response must be at least 200 words long. Ensure that the revised text is directly related to the topic of the question. Utilize only the information provided in the document. Eliminate any unrelated phrases or sentences. Identify and retain evidence that supports the answer. Print only the rewritten text. Make sure the exact span of the answer is smaller than 5 words. | ㅤ |
46 | Please rewrite the given passages to enhance their precision and clarity in answering the question. The rewritten text should be approximately half the length of the original passages. Your response must be at least 200 words long. Ensure that the revised text is directly related to the topic of the question. Use only the information provided in the document. Exclude any irrelevant phrases or sentences. Identify and retain evidence that supports the answer. Print only the rewritten text. Make sure the exact span of the answer is smaller than 5 words. | ㅤ |
47 | Improve the precision and clarity of the given passages in addressing the question by rewriting them using the guidelines below:
- The rewritten text should be half the length of the original passages.
- Your response should have a minimum length of 200 words.
- Ensure that the revised text remains closely related to the topic of the question.
- Utilize only the information provided in the document.
- Remove any phrases or sentences that are irrelevant to answering the question.
- Identify and retain evidence that supports the answer.
- Include only the rewritten text in your response.
- Make sure the exact span of the answer is smaller than 5 words.
By following these guidelines, you will create a more concise and precise version of the passages that effectively addresses the question. | ㅤ |
48 | Rewrite the provided passages to enhance their precision and clarity in addressing the question. The rewritten text should be approximately half the length of the original passages. Your response must be at least 200 words long. Ensure that the revised text is directly related to the topic of the question. Utilize only the information provided in the document. Remove any irrelevant phrases and sentences. Identify and retain evidence that supports the answer. Print only the rewritten text. Make sure the exact span of the answer is smaller than 5 words. | ㅤ |
48 | Rewrite the given passages to enhance their precision and clarity in addressing the question. The rewritten text should be half the length of the original passages. Your response should be at least 200 words long. Ensure that the revised text is directly related to the topic of the question. Utilize only the information provided in the document. Remove any irrelevant phrases and sentences. Identify and retain evidence that supports the answer. Print only the rewritten text. Make sure the exact span of the answer is smaller than 5 words. | ㅤ |
48 | In order to improve the precision and clarity of the provided passages in relation to the question, please rewrite them with the following guidelines:
- The rewritten text should be half the length of the original passages.
- Your response should consist of at least 200 words.
- Make sure the rewritten text remains relevant to the question topic.
- Focus on using information solely from the document.
- Remove any phrases or sentences that are not related to answering the question.
- Identify and preserve evidence that supports the answer.
- Only include the rewritten texts in your response.
- Ensure that the exact span of the answer is limited to less than 5 words.
The ultimate goal is to create a more concise and precise version of the passages that aids in answering the given question accurately and effectively. | ㅤ |