{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"909b32fe-7820-5ae5-8614-2ccb3ca47e5c","task_key":"default--validation--27472","task_revision_id":"1","upstream_id":"27472","short_description":"HellaSwag validation 27472","config":"default","split":"validation","body":"{\"activity_label\":\"Sports and Fitness\",\"ctx\":\"[header] How to photograph underwater [title] Purchase a waterproof point-and-shoot camera to take basic pictures. [step] Point-and-shoot cameras are great for beginners because you don't have to change many settings. They come with automatic settings you can experiment with, but for the most part these cameras are very straightforward and easy to use.\",\"endings\":\"['[substeps] Larger lenses (these lenses swivel off the sides of the camera) take a lot of pressure, so take some time to carefully monitor the areas being photographed. [title] Take it a step further by using an area with relatively little water.', 'You can find these cameras at photography studios or on sites like ebay. [substeps] The basic point and shoot camera is one with a wide aperture and a flash.', 'You can purchase either a digital waterproof camera or a disposable point-and-shoot. [substeps] Popular camera brands like olympus and nikon make point-and-shoot cameras for underwater photography.', 'How you look at them can affect the dynamic shots you film. [substeps] In most photographs, your image is situated between the rays you are shooting.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}