{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5a73e9c8-c2f1-594d-aa28-728ace667d16","task_key":"default--validation--37502","task_revision_id":"1","upstream_id":"37502","short_description":"HellaSwag validation 37502","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to improve your ability to learn quickly [title] Identify your learning style. [step] By determining your learning style, you can determine the best techniques to help you retain information more effectively. Many people have multiple learning styles while some people may just have one dominant style.\",\"endings\":\"['Recognize how you train for one of these styles so you can get the most out of it. [substeps] For example, if you are learning how to knit, how do you knit? Knit you.', '[substeps] Give yourself lessons in one teaching style. Learn to decide between teaching another style or teaching a different style that you are more comfortable with.', 'It is up to you to find the two styles that suit you best. [substeps] Some teachers prefer you to have two learning styles, which should be described in this section.', 'Figure out which style works best for you. [substeps] Auditory learners pick up information by listening to it.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}