{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a075656a-44d5-5c68-b85b-075fb1071b5a","task_key":"default--validation--29452","task_revision_id":"1","upstream_id":"29452","short_description":"HellaSwag validation 29452","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to handle small kids [title] Make tasks fun. [step] Since small children are constantly making messes and dirtying their clothes, it's easy to feel like your house is always a wreck. If you want your child to help you keep things tidy, make chores or simple tasks into a game.\",\"endings\":\"['Avoid just telling your child that he has to clean something up. You may need to help him or get him started.', \\\"You can also play music while they work so they get excited about the task. [substeps] For example, if they're worried about burning a gaslight, encourage them to put their house on fire, and in turn have them put theirs on fire.\\\", '[substeps] For example, if you have a dirty clothes basket in the closet, ask your kid to clean it. Another idea is to make all toys in a bag orderly and ready to go.', 'Show your kids how fun this game can be at home or at school. Get them in the habit of putting dishes in the sink instead of the toilet.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}