{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b9cd50d5-10ba-59e7-9fa9-0257c02c582f","task_key":"default--validation--17313","task_revision_id":"1","upstream_id":"17313","short_description":"HellaSwag validation 17313","config":"default","split":"validation","body":"{\"activity_label\":\"Cars & Other Vehicles\",\"ctx\":\"[header] How to change a cv axle [title] Remove the vehicle's hubcap. [step] Before so much as jacking up the vehicle, you need to remove the axle nut. Start by removing the hubcap for the respective wheel of the cv axle to be replaced.\",\"endings\":\"['The easiest way to remove the wheel is by prying off the hubcap. Pull the hubcap off the wheel to reveal the axle nut and unscrew it with a phillips head screwdriver.', \\\"If you can't get the number right, break off the hubcap. [substeps] In most vehicles there will be a hole around the wheel that you can remove with the phillips screwdriver.\\\", '[substeps] You also need to remove the wheel nut, which clips the wheel to the axle of the vehicle. If the wheel nut is not removed yet you will need to remove some other parts of the vehicle before you can replace it.', 'For vehicles with rims, you may simply have a cap at the center of the wheel rather than a hubcap. [title] Remove the cotter pin from the axle nut.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}