{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"38057f23-e2ca-514a-89b5-ce1df34e82eb","task_key":"default--validation--4229","task_revision_id":"1","upstream_id":"4229","short_description":"HellaSwag validation 4229","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to widen your logic and knowledge [title] Don't practice ad hominem. [step] Ad hominem attacks happen by placing doubt on someone's character or attributes to discredit their arguments. When someone does this, they are undermining someone's case without providing logical evidence as to why.\",\"endings\":\"['The truth of ad hominem attacks is in creating doubt of their own. [substeps] In order to force someone to believe that their internal reasoning is incorrect or that someone else is right, you must use the phrase.', 'Instead, they attack facts, beliefs, and experiences, and build up false ideas. This is only a way of putting value on something by attacking a fact despite having only a theoretical opinion on it.', 'It is important to listen to information and disconnect it from feelings you may have for that person. This will allow you to pull out the facts and stay logical.', \\\"[substeps] An ad hominem may target all character types in a relationship, but won't include every single character in a relationship. [title] Maintain your own perspective and invent obstacles.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}