{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ac4204e9-6348-5f6b-9478-714454a47016","task_key":"default--validation--6283","task_revision_id":"1","upstream_id":"6283","short_description":"HellaSwag validation 6283","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to explain cross dressing to a child [title] Educate yourself on cross dressing behavior. [step] Before you discuss cross dressing with your child, it is best to first educate yourself about the behavior. This is so you can report accurate information to your child, instead of misleading them.\",\"endings\":\"['Write down as many details as you can remember and talk about it before your child shows interest in cross dressing. [substeps] You may also look into buying an object like a basketball.', \\\"[substeps] Cross dressing can be defined as people who wear clothing and/or adornment, i.e., accessories and make up, that is traditionally associated with the opposite sex. In other words, it occurs when a male wears a dress or make up, or when a female wears a men's haircut or a suit.\\\", \\\"[substeps] Describe the behavior in a clear, concise way, which will help them grasp the meaning. Talk about the behavior more often if you think your child may gain information from the fact that he's cross dressing.\\\", \\\"This can help the child get an overall understanding of what is expected of them in addition to knowing the appropriate attire. In the first place, consult your child's school doctor before they begin their physical care regimen.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}