{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"18072b17-3e91-52c7-9830-ff3c5281403e","task_key":"default--validation--26578","task_revision_id":"1","upstream_id":"26578","short_description":"HellaSwag validation 26578","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to remove watch band links [title] Measure the watch band. [step] Before you set about removing any watch links, it is necessary to measure your watch band so you know exactly how many links you will need to remove. To do this : [substeps] Position the watch on your wrist exactly the way you intend to wear it.\",\"endings\":\"['If you want it to look more comfortable and easy to take off, start by measuring the distance from the watch band to one of the holes on the side of your wrist. You will need to measure halfway up your wrist.', 'When you are satisfied with the way it is positioned, turn your wrist over so that the watch band clasp side is facing up. With the watch band on your wrist, gather the slack in the band and hold the links together to simulate them being removed.', 'On a regular watch band, it will just slide off without you opening your eyes. Use a tape measure to measure the distance between the top of the band and the back of your watch band.', 'Place one end of a tape measure around the neck of the watch and measure the distance between the neck and the bottom. You will find this distance on either side of the watch band.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}