{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ea89a529-d779-5d9f-a3fd-c140a22d7f0f","task_key":"default--validation--38578","task_revision_id":"1","upstream_id":"38578","short_description":"HellaSwag validation 38578","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to deal without a mother (teen girl ) [title] Strive to trust others, despite your misgivings. [step] Trust consists of the major building blocks of any relationship. However, the fact that your mother is not in your life may cause you to become distrustful of others.\",\"endings\":\"[\\\"This may be very hard as you have grown up without a bond with your mother, and that's where we often learn to trust others. [substeps] Make a true effort to trust others and open yourself up to be more vulnerable.\\\", 'This is why you should have relationships with other adults, younger people, and strangers. Learning to trust others may be especially important if you grow up in a household where your mother tends to make the key decisions in your daily life, such as whether you have kids, or about your job options.', 'Focus on starting to live by the values you have set for yourself. Give your mom a reason to be around during tough times.', \\\"If you still haven't fully trusted your mother, your trust may be misplaced entirely. [substeps] Trust is not such an important organ in a teen girl's development.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}