{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"14667f27-e193-5017-9dd5-cc71d8afd002","task_key":"default--validation--16906","task_revision_id":"1","upstream_id":"16906","short_description":"HellaSwag validation 16906","config":"default","split":"validation","body":"{\"activity_label\":\"Cars & Other Vehicles\",\"ctx\":\"[header] How to diagnose an alignment problem [title] Eliminate tire problems. [step] Before attempting to diagnose a front end alignment problem, you need to be sure your tires are not causing steering problems you may be experiencing. [substeps] Check the air pressure on all four tires, making sure to inflate them to the recommended pressure.\",\"endings\":\"['This will ensure that the tires are properly inflated. In other words, take your tires to your mechanic, your more experienced tire specialist or a friend or family member to have the tires inflated.', 'If the pressure in the tires is very low, you should look for a range of other variables while trying to diagnose your rear end alignment problem. [title] Check the portion of your tire where tire pressure jumps up.', 'Give both tires space to be inflated in one spot or another. Having equal amounts of space in one spot provides good results.', \\\"You should find the manufacturer's recommended inflation pressure on the label attached to the driver's side door. Check to see that the tread (or tire pattern) and tire size are the same on both front wheels.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}