{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b9f9b554-d8e4-5e49-ab7f-bb68c606ccf0","task_key":"default--validation--47436","task_revision_id":"1","upstream_id":"47436","short_description":"HellaSwag validation 47436","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to teach kids patience [title] Acknowledge the child's struggle. [step] Let your child know that patience isn't easy and that what they are doing is difficult. You can even help them learn how to verbalize this difficulty and their frustrated emotions.\",\"endings\":\"['For a young kid, this may be helpful, but for adults, it is not. [substeps] Support the child by being their advocate.', 'This can help them understand that waiting is hard for everyone, not just them. [substeps] For example, you might say, \\\" i understand that it is difficult to wait.', 'What they choose to say is entirely up to them. [substeps] Relax at the edges of the conversation.', '[substeps] Let your child do this by saying, \\\" if you were to lay down now, you would be very sad. I would love to help, but that\\\\'s not what we do, we do what we say we will.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}