{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2bc1c4de-04c6-5122-a27f-d49fb605e8a6","task_key":"default--validation--5828","task_revision_id":"1","upstream_id":"5828","short_description":"HellaSwag validation 5828","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to understand istps and embrace your own inner istp personality [title] Read up to understand your type. [step] Istp stands for a type that is characterized by introversion, sensing, thinking, and perception. Each characteristic roughly correlates to a different way in which a person relates to the world.\",\"endings\":\"['[substeps] Opposites tend to be characterized by incompatibility and some expressions of disorientation. An introvert has trouble accepting himself, feeling some absurd thought, expressing himself, or responding in the same way an introvert would.', \\\"However, generally, according to istp's regimen, everything will differ from person to person. Jot down your thoughts and ideas so that you have a better context for understanding istps.\\\", \\\"Next we'll explore each characteristic individually and what each means for you. [title] Understand that you tend more towards introversion over extroversion.\\\", '[substeps] A more systemic approach may be used for street noise, mass confusion, and fatigue. An intuitive approach will apply for many communities that do not have enough street noise.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}