{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cac4d56f-3739-54df-862a-4d6117c54db9","task_key":"default--validation--2583--variant-92675181a639","task_revision_id":"1","upstream_id":"2583--variant-92675181a639","short_description":"HellaSwag validation 2583","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to improve your child's behavior [title] Communicate your expectations for your child's behavior clearly. [step] Children need to know what you expect from them. Sit your child down in a quiet place and explain to him/her what kinds of behaviors you want to see, using clear detail.\",\"endings\":\"['[substeps] Talk in a calm voice and be firm. Tell your child how you expect consistency and to trust your words.', \\\"No one wants to be told that their behavior is childish, angry, or disrespectful for whatever reason. [substeps] Don't ask your child to be calm or nice around you.\\\", 'Focus on correcting one behavior at a time. Giving your child a long list of items for improvement can be overwhelming.', 'Let him/her know that in some instances he/she is expected to behave. Do not pick or hold back behaviors that your child expresses.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}