{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7c5bd2ce-01ae-5123-b99a-fd4e8b90a308","task_key":"default--validation--34679","task_revision_id":"1","upstream_id":"34679","short_description":"HellaSwag validation 34679","config":"default","split":"validation","body":"{\"activity_label\":\"Sports and Fitness\",\"ctx\":\"[header] How to tighten skateboard trucks [title] Know that truck tightness is a matter of personal preference. [step] At the end of the day, there is no \\\" perfect \\\" amount to tighten your trucks. The tighter you turn the trucks, the more difficult the board is to turn.\",\"endings\":\"['[substeps] In some cases, the trucks themselves break when you lift heavy metals up and down, causing serious injury. You want to be able to tell if your trucks are not tightening correctly if the tension seems loose, uncomfortable, or strong while manipulating them.', 'You can also decrease your trucks by squeezing different numbers of bolts to provide greater stability. [substeps] Most trucks need at least 12 bolts per 1 inch (2.5-8 mm) of space between them.', '[substeps] All trucks tighten at varying levels of tension. Turning the trucks at a fixed or perfect range generally results in improved performance.', \\\"Too loose and you won't feel like you're stable, and your turns will be wide and difficult to control. The spot right in the middle of these extremes, your perfect tightness, is based on your own style and preference.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}