{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"332420d7-060c-5775-a492-b7fd92419a40","task_key":"default--validation--13902","task_revision_id":"1","upstream_id":"13902","short_description":"HellaSwag validation 13902","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to adopt a child as a single man [title] Make an informed decision. [step] As a single man, you must realize the difficulties involved because of both your gender and your marital status. Recent trends make adopting children by single men more acceptable, but men are likely the most prejudiced against demographic among people looking to adopt.\",\"endings\":\"['[substeps] Research which countries will allow a single man to adopt a child. Not all countries are open-minded to the possibility of having one parent let alone it being a man.', '[substeps] If you feel like you must adopt a child by just being single, do it. Agree on a group meeting to discuss the logistics and come to an agreement regarding time and space for adoption.', 'Work to come up with a plan that addresses these characteristics, among other factors. Keep in mind the dividends you will face with adopting.', 'The american academy of pediatrics recommends that single men who have had two or three children over the past two years only adopt a child like one. [substeps] This does not mean you should be single alone.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}