{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"174bcdeb-e1f9-5b69-9509-da9c86bd2e64","task_key":"default--validation--30388","task_revision_id":"1","upstream_id":"30388","short_description":"HellaSwag validation 30388","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to react if your husband calls you fat [title] Take a moment to breathe before responding. [step] When someone says something rude or insulting, it can hit a nerve, particularly when that someone is your husband. Take a minute to breathe deeply and gather your thoughts.\",\"endings\":\"[\\\"[substeps] If your husband thinks he's being rude by calling you fat, he's not being blunt enough. He's trying to hurt and upset you by letting you know that he doesn't like you or that you aren't being taken seriously.\\\", \\\"[title] Appreciate how your husband's words and actions are influencing how you respond. [step] Your husband's words are not only influencing how you react, but also filling the void that his words or actions provide.\\\", 'See if you are in this situation the right way, as this is a way to neutralize or calm the resentment and embarrassment the offense will bring. [title] Evaluate what is truly offending you.', '[substeps] Consider stepping away and saying, \\\" i need a moment after what you just said. \\\" avoid engaging in further conversation until you\\\\'ve stepped away and had some space.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}