{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0993d972-fcb6-582e-a0e6-264468212af8","task_key":"default--validation--25328","task_revision_id":"1","upstream_id":"25328","short_description":"HellaSwag validation 25328","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to conceal bags under your eyes [title] Choose your concealer. [step] To combat the blue and gray color under your eyes, choose an orange or peach colored concealer. Orange is the complementary color to blue, which means when orange is applied to a blue area, the colors \\\" cancel \\\" one another out.\",\"endings\":\"[\\\"Apply the concealer in a v-shape along the hairline, around your eyes, and around the outside edges of your eyes. [title] Don't forget to exfoliate.\\\", 'Pick a color that is only one or two shades darker than your skin-otherwise, the concealer will be visible against the normal color of your skin. Concealers come in liquid and stick form.', 'A pale blue concealer will look similar to the peachy shade, but it looks brighter. Peach concealer is a darker color than orange concealer, and fades into the grey or beige coating, respectively.', 'To disguise the purple-and-blue problem area, opt for a light color concealer. [substeps] For the best results, choose concealer that is the same color as your skin tone.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}