{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d59eaace-81e8-5878-940c-0139e13e8dd8","task_key":"default--validation--10542","task_revision_id":"1","upstream_id":"10542","short_description":"HellaSwag validation 10542","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to deal with sharing a room with your sibling [title] Create physical boundaries. [step] For some siblings, it's enough to name what in the room belongs to which person. Others need physical reminders of the separation such as labels, dividers or even duct tape.\",\"endings\":\"['The room belongs to both of you, but being clear on which part is yours and which part is theirs will give you one less thing to argue about. If boundaries are a real issue, consider stringing a curtain across the room to divide it in half and give the illusion of privacy.', 'Make this an important part to establishing boundaries so that the two of you can effectively communicate things. [substeps] For example, maybe your sibling sleeps in his room and has problems getting out of bed, but you allow them to check their closet or keep things in the right place.', 'For more parent-friendly children, you can choose to give all of your room an individual designation. [substeps] If you have two boys and one sister at home, both of you need to make up a separate space.', \\\"The simple act of creating boundaries allows you to let your sibling know it's their space and not yours. [substeps] Oftentimes, siblings talk about what's the spot in the same room they are sharing.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}