{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9bedcd44-9f4e-5435-83d1-89a0f4f7c205","task_key":"default--validation--4940","task_revision_id":"1","upstream_id":"4940","short_description":"HellaSwag validation 4940","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to apply nail tips [title] Gather your materials. [step] Anyone can apply nail tips at home, but you will need to have some special materials before you get started. To apply nail tips to your natural nails, you will need : [substeps] Nail tips nail adhesive gel nail clipper nail file [title] Follow the safety instructions included with your nail tips.\",\"endings\":\"['[step] Make sure to follow all safety instructions exactly. Once you have your nails just where you want them to be, even if they are a little off, it is highly recommended to clean it up beforehand.', '[step] Some nail tips come with instructions for how to apply them, but you should be able to follow those instructions exactly. Some nails may need to be reapplied immediately after exposure, so check with your local hardware store or nail salon.', '[step] The safety instructions will vary from person to person but will give a general picture of the step you will need to make to apply the nail tips. [substeps] Use caution when applying the nail tips to your natural nails.', '[step] Your nail tips and nail adhesive should come with some instructions for proper use and safety. Read these instructions carefully and follow any safety precautions for the product.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}