{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f5eeb5be-93ba-5337-ad67-a0b489e97d7e","task_key":"default--validation--49217","task_revision_id":"1","upstream_id":"49217","short_description":"HellaSwag validation 49217","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to use a front kick for self defense [title] Know your limits. [step] Unless you are trained, you should leave your jackie chan moves in the gym. The type of front kick most people imagine (flying at the attacker's torso) is more likely to bring disaster on yourself than your attacker.\",\"endings\":\"[\\\"Plus, your fists just have to make contact with the attacker's face and attack head-on. [substeps] If you're short on space to escape, just go for the head-on.\\\", 'Practice different kicks like the one jackie chan kick on-to-protect yourself from oncoming attacks. [title] Make sure you allow others to control you.', \\\"See things from jackie chan's perspective. [title] Position your legs so that they are over your toes.\\\", 'The average person does not have the kick speed to pull this off. Put in some time practicing and get a sense of your capabilities, asking a martial artist for advice if possible.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}