{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"63ad6957-de87-5fc9-8ead-1f4dcdd845b1","task_key":"default--validation--50114","task_revision_id":"1","upstream_id":"50114","short_description":"HellaSwag validation 50114","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make a bunny ears headband [title] Choose a headband. [step] To make a bunny ears headband, you need to start with the right headband. A plastic style will work fine, but a metal band is sturdier so you don't have to worry about it breaking.\",\"endings\":\"[\\\"Look for a headband that's approximately 1-to 2-inches wide (2.5-to 5-cm). [substeps] It doesn't matter what color the headband that you use is.\\\", '[substeps] For more detailed measurements, you can search the internet for a headband design and basic instructions. Alternatively, you can find a coloring book, paper towel, paper towels, scissors, or any other craft supplies you may use to make your headband.', '[substeps] For a soft look, use a pair of either clear rubber bands or elastic bands. You may also consider using fabric headbands, but you may want to use clear clips to prevent them from getting damaged.', \\\"If you decide to make a bunny ears headband, you'll need to shape the headband to your liking using either scissors or carving a design onto it. Here are other templates you might consider using for your headband : [substeps] Round shapes.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}