{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"de742452-534a-51d8-b609-5f85031834b1","task_key":"default--validation--45842","task_revision_id":"1","upstream_id":"45842","short_description":"HellaSwag validation 45842","config":"default","split":"validation","body":"{\"activity_label\":\"Holidays and Traditions\",\"ctx\":\"[header] How to kickflip on a tech deck [title] Begin by placing your fingers on the board in the starting position. [step] Many tricks begin with the index finger placed right behind the front wheels and the middle finger slightly behind the back wheels. Become comfortable with your fingers in this position as it will be the standard finger position for most tricks, such as the ollie, kickflip, heelflip and impossible.\",\"endings\":\"['[title] Position your hands a bit further apart from each other. [step] Your fingers should be about 1 to 2 inches (2.5 to 5.1 cm) apart.', '[title] Start by rolling the board to your left. [step] This will be the direction that you will go to do the kickflip.', '[substeps] Before attempting to begin, learn how to do a kickflip with both hands. Make sure your hand is closest to the board in your starting position.', '[substeps] Get comfortable with the \\\" kickflip \\\" technique by placing your index fingers on either side of the deck in the starting position. Kick the back wheels with the forefingers in the starting position.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}