{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a6d9ded1-d7c0-5047-8995-7e3c6c0ed489","task_key":"default--validation--14472","task_revision_id":"1","upstream_id":"14472","short_description":"HellaSwag validation 14472","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to raise children who think for themselves [title] Demonstrate with your own behavior how to make choices. [step] You can teach your children to think for themselves by showing them at every possible opportunity how you make decisions. Stand behind the choices you make, and express your reasons for making them, which will help them understand why you chose the way you did.\",\"endings\":\"[\\\"You can show them that you aren't afraid to make the right choices, but you don't have to take them lightly. [substeps] When you leave the room and start lecturing, think for yourself.\\\", \\\"[substeps] For example, if you say you did nothing you would probably have listened to others and stood your ground. However, never stand for saying you did something you said, and don't let your exact behavior alter your decision making.\\\", \\\"[substeps] If someone teases you, don't get upset and respond with actual harm. This can make it very frustrating for your child.\\\", \\\"[title] Allow your children time to play freely. [step] Unobstructed play is crucial to raising children to think for themselves and for the children's development because it forces them to decide what to play with and how.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}