{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8d178e90-5206-582b-813d-1d590d7e60d9","task_key":"default--validation--37716--variant-d5dad37e7bb0","task_revision_id":"1","upstream_id":"37716--variant-d5dad37e7bb0","short_description":"HellaSwag validation 37716","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to teach civility to kids [title] Tell your child what civility is. [step] Explain that civility is about treating people with respect. Along with being polite, civility is also listening to others without being rude, even if you don't agree with them.\",\"endings\":\"['If the children understands this, they will be more likely to respond in kindness. For example, tell your child \\\" civility is an act of giving and receiving even though others tell me it\\\\'s childish.', \\\"Bing civil means respecting other people's boundaries and personal space, letting people speak without interruption, and respecting others' decisions. Civility is also treating other people properly even if you don't necessarily get along with them.\\\", '[substeps] For example, you might say to your child, \\\" civility is always respecting other people. When i\\\\'m sitting down with someone, i have something to say so i\\\\'m being respectful.', 'Being respectful means apologizing to others, showing gratitude and appreciation to other people, and asking for help when you need it. [substeps] For example, you may sit down with your child and say, \\\" i know this is disappointing, but you don\\\\'t have to be rude to me or to anyone else.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}