{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b6acd626-870a-5386-9180-79070547bea2","task_key":"default--validation--2102","task_revision_id":"1","upstream_id":"2102","short_description":"HellaSwag validation 2102","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to cope with your parents' custody battle (for kids ) [title] Recognize that it isn't your fault that your parents are having problems. [step] You are not the cause. They may not love each other anymore, but they love you, and that's why they are in this custody battle.\",\"endings\":\"['No matter what you think, your parents are fighting to uphold their rights and responsibilities. [title] Understand that actions can affect your consequences.', \\\"If you are in your parents' custody battle, your parents are not the reason why they are fighting. [substeps] They are fighting because they are angry with you.\\\", 'Your friends could provide you a little moral support and that could be helpful. [title] Your parents feelings are not your responsibility.', 'However, appreciate that by recognizing what your parents are arguing about, you know that your perspective is the only way you can do better in this situation. Try your best to understand their perspective so that you have a better chance of changing your mind about custody.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}