{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"54c686ef-09ec-5078-9113-677b65604cb9","task_key":"default--validation--50111","task_revision_id":"1","upstream_id":"50111","short_description":"HellaSwag validation 50111","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to teach kids to tell time [title] Practice counting to 60. [step] Kids need to be able to count to 60 (in the correct order) in order to tell time. Have your child write down the numbers 1 through 60 on a piece of paper.\",\"endings\":\"['This will be the starting time for your counting trick. [substeps] With a digital drawing, this is a good place to start.', 'As they write each number, have them recite the number as well. Post this piece of paper on a wall and have them recite the numbers regularly.', 'As they get older, they can count to 60 instead. However, they will always be counting to 60.', \\\"This will help them learn to read quickly and accurately. After you've told them the first two numbers, ask the child what the next numbers are.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}