{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"631d1a34-ccff-5cdc-9cd6-aedef6201abf","task_key":"default--validation--26995","task_revision_id":"1","upstream_id":"26995","short_description":"HellaSwag validation 26995","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to stop a child from whining [title] Take a deep breath and try to stay calm. [step] Try not to let your child's whining drive you crazy. Inhale slowly, do your best to maintain a reasonable mindset, and keep your frustration in check.\",\"endings\":\"[\\\"Remember, your child will do what they are supposed to do and you may be frustrated with them for not putting in the effort. Think critically about how much you appreciate and admire your child for doing what they've always wanted to do.\\\", '[title] Keep reminding yourself that whining is not a punishment. [step] There is nothing more frustrating than requesting a time-out and being forced to address all negative behavior in your child.', \\\"[substeps] You'll have better luck dealing with your child's whining and addressing any legitimate needs if you keep your cool. [title] Avoid yelling or showing that you're overwhelmed.\\\", 'Resist any impulse to chase after your child when he or she is whining. Be calm and remind yourself that you are helping the child talk through his or her problems.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}