{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c7219f42-cfdf-5f66-a492-cc9f04625c06","task_key":"default--validation--42200","task_revision_id":"1","upstream_id":"42200","short_description":"HellaSwag validation 42200","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to make a themed calendar with microsoft powerpoint [title] First find a theme you want. [step] Themes can be anything you are interested in or that you like. The theme of this calendar is going to be \\\" frozen [substeps] Make sure you have images and maybe quotes for the theme you chose.\",\"endings\":\"['[title] Create a template that will represent all of the themes that will be coming up over the upcoming months. [step] Decide how you will print the template if you have a computer, printer, or smart phone.', 'You may want to use a lot of pieces though and make up a theme that works. Make sure you have duplicates that you have saved online so you have these when you are done.', '[title] Open microsoft powerpoint and make your background. [step] Backgrounds are important they can be the same for every month or different for every month.', 'Categorize your theme and freeput all of your themes, in small sizes and just enough to fit your images or quotes. Keep the images small so they are easy to find.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}