{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"95a9ead3-a138-5e30-9fde-8e779519a8ba","task_key":"default--validation--25655--variant-3e80fe4cd95e","task_revision_id":"1","upstream_id":"25655--variant-3e80fe4cd95e","short_description":"HellaSwag validation 25655","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to calculate the weight of a body of water [title] Assess the shape of the body of water. [step] You need to calculate the volume of the particular body of water you are interested in. To do this, you need a rough estimation of the total area of the surface of the body which you will then multiply by the depth.\",\"endings\":\"['This will ensure the various weights of water in the body of water it is when you will calculate the volume of the body of water. [substeps] The easiest way to do this is by using a meter.', '[substeps] If you are looking at a rectangular swimming pool, you will simply use length times width to find the area. If the body of water is more of a circular lake or pond, you will want to use an equation for the area of a circle.', \\\"[substeps] You don't need to calculate the volume-anything less is appropriate. For example, if the surface of the body of water is eight metres (2000 meters), add eight metres.\\\", 'If the area you are in is named or designed in such a way that it is seldom seen on a map, multiply by 25 to get the volume of the body. [title] Multiply the volume of the body of water by 20 to get the volume of the body of water.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}