{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d551a75c-031f-514a-9c50-390a9328c7a8","task_key":"default--validation--10464","task_revision_id":"1","upstream_id":"10464","short_description":"HellaSwag validation 10464","config":"default","split":"validation","body":"{\"activity_label\":\"Work World\",\"ctx\":\"[header] How to become a certified daycare provider [title] Get in contact with the department of child services for your state to determine the laws and requirements within your locality. [step] Rules and regulations differ from state to state, so make sure that you are aware of the ones applicable to you. For instance, there are some states which may not even require a license anymore, depending on the circumstances.\",\"endings\":\"['[title] Go through the paperwork that the department of child services sends through mail. [step] Make sure that everything is filled out completely, honestly, and to the best of your ability.', 'Because of this fact, it is always important to answer every question you might have before applying for a license. [title] Start a daycare agency in your area.', '[title] Keep track of your eligibility to work in daycare. [step] In general, children who have completed childcare, even those without a license, are considered custodial adults.', '[substeps] You must submit a written application required by law to become a daycare provider. These applications are often less competitive than others and require more than just an acceptance letter.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}