{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"62c45dbc-997f-5b81-bedb-d7c21208700e","task_key":"default--validation--3736","task_revision_id":"1","upstream_id":"3736","short_description":"HellaSwag validation 3736","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to choose microwave safe containers [title] Be aware of potential health hazards. [step] Some microwavable containers, especially those made of plastic, can be potentially harmful to your health. Others, like glass or plastic dishes, are better for your health.\",\"endings\":\"['Informing yourself about the potential dangers of certain types of microwave-safe containers may help you make a safer choice. Some of the potential health hazards are : [substeps] \\\" endocrine disruption, \\\" which mimics human hormones.', 'Read your label carefully to make sure that these containers are not safe for use in a microwave. Here are some general safety dangers listed below : [substeps] If the containers you use are made of glass or plastic, they could easily melt under intense oven weather.', 'Always check the contents of your container before purchasing items to avoid these dangers. Common health hazards include : [substeps] Seals on the lid can cause respiratory distress.', \\\"Avoid anything containing a lid or case-this will prevent exposure to heat. Don't use fish food, for example, because it might harbor a lot of germs.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}