{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c4dc0d7e-6a36-56c0-893b-55b26677ccb7","task_key":"default--validation--32043","task_revision_id":"1","upstream_id":"32043","short_description":"HellaSwag validation 32043","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to create a picture memorial [title] Locate several of your favorite photographs of this person across a span of time. [step] If they were in your kindergarten class, graduated high school with you and were your best friend well into your 80s, you should have plenty of choices. If you've only known the person for a short time, ask friends and family members for contributions.\",\"endings\":\"['[substeps] With your photos, consider monopolizing a particular set of photographs of this person. This, in turn, gives the photos a sense of closeness.', '[title] Embed some of your favorite art and music elements with the photos. [step] If you can use excel = tabs [title] Find some flashy, fun tags to line the photo with.', 'Camera roll considerations include arranging various props, cameras or side and lens decisions. [substeps] Arranging materials ahead of time is perhaps the most important determining how to arrange your photographs.', 'If you do not want to use the original photo, copy the pictures at the neatest quality you want. [title] On a large, clean, dry surface lay out your pictures and try to narrow down your initial selections.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}