{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"998e8ace-4fe9-518d-aabe-1e6ce2540ba3","task_key":"default--validation--13985","task_revision_id":"1","upstream_id":"13985","short_description":"HellaSwag validation 13985","config":"default","split":"validation","body":"{\"activity_label\":\"Work World\",\"ctx\":\"[header] How to set up an ergonomically correct workstation [title] Adjust chair height so that your feet are flat on the floor. [step] This will keep your knees and hips at roughly the same height. To find this height, stand by the chair and raise or lower the seat pan to just below your elbows bent between 90 and 110 degrees.\",\"endings\":\"['[substeps] The more your legs are off the floor, the less your back will strain to support yourself. By sitting at this height, you can avoid the strain on your back and hips.', 'Take care that your elbows are not winged out, but instead hang with your upper arms at a comfortable, fairly vertical alignment. Your forearms should be parallel to the ground and your wrists in a neutral position.', 'Your hips should be completely level with your legs and feet. [substeps] Raise or lower the seat pan so that your tailbone is parallel with the floor.', '[substeps] In some cases, you may find that you need to raise or lower the seat pan while you are wearing your socks. This will make learning this step easier and gives you much more control over the height of your workstation.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}