{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e1e48e92-ff8b-5503-a364-b243555d2be7","task_key":"default--validation--22016","task_revision_id":"1","upstream_id":"22016","short_description":"HellaSwag validation 22016","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to dress celtic [title] Research the ancient celts. [step] Search for artistic depictions of them on image search engines such as google images or pinterest. Viewing these images will inform you of the basics of what you may be looking for if you're going for a more archaic celtic look and will give you ideas if you're simply looking to put a celtic spin on regular modern clothing.\",\"endings\":\"['[title] Go for the androgynous look. [step] Look at your knee-length middle shorts and plain dress pants, while still wearing sandals.', '[title] Look up the six celtic nations--ireland, scotland, isle of man, wales, cornwall and brittany. [step] Figure out if there is a particular nation out of these you want to incorporate into your wardrobe.', '[title] Wear leggings and a quilted dark colored skirt (if you wear one). [step] This summer dress looks always cohesive, unless the beginning of winter brought that pointless denim skirt all its own.', \\\"[substeps] For example, visit canelcun's shop for all the dresses that have patterns and styles in the background. You can search for the bride's dress too.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}