{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"121a7448-9ee0-554d-9ea1-3889034c61a9","task_key":"default--validation--17706","task_revision_id":"1","upstream_id":"17706","short_description":"HellaSwag validation 17706","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make baby headbands [title] Measure the head. [step] Before you can make the headband you will need to know the appropriate size. This can be done by measuring the individual or by using generalized measurements based on age or weight.\",\"endings\":\"['If measuring in person, you will want to measure the circumference of the head, in roughly the same place that you intend the headband to go. This will usually be just above the ears.', '[title] Cut the headband out of insulating plastic pieces. [step] Separate several pieces (and label the pieces in ascending order by size).', 'The smallest sections in the head will typically be the best. [substeps] For example , 3-7 inches, felt or fuchsia headbands would be ideal for a baby headband; however, children of any age may find larger headbands more appropriate, especially for smaller babies and younger infants.', 'You\\\\'ll need to be able to accurately measure body length and circumference. If you\\\\'d prefer to use a 3 \\\" (7.6 cm) headband, simply measure your head from upper your forehead down to the back of your head.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}