{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7e0e71a6-2bf2-5b0d-9ec6-94b57dcc7c40","task_key":"default--validation--24298","task_revision_id":"1","upstream_id":"24298","short_description":"HellaSwag validation 24298","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to grow taller faster (kids ) [title] Eat healthily. [step] Food can give you the energy to get through the day, but it also helps your body grow. Getting the vitamins and minerals your body needs by eating healthy, regular meals and snacks can help you grow taller faster.\",\"endings\":\"['Food also helps your brain process new information, and it will help your body stop the binging. [title] Aim for about 200 calories a day.', '[substeps] Eat fresh fruits and vegetables to get the most more nutrients. High on carbohydrates and fiber, they make your body grow faster.', 'Also, good foods also can help you manage your weight. Limiting sugar or saturated fats, like those found in sugary or high-fat foods like low fat milk and yogurt, can help you get taller faster.', '[substeps] Have breakfast, lunch, dinner, and two healthy snacks every day. This makes sure that your body has enough energy to get you through your day and encourages it to grow.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}