{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f59be9ba-250c-5d22-a639-88ae366caee5","task_key":"default--validation--28877","task_revision_id":"1","upstream_id":"28877","short_description":"HellaSwag validation 28877","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to dress up in a pencil skirt with color blocking [title] Choose the colors. [step] If you are dressing up an outfit in color blocking for the first time, it is necessary to keep in mind that bright colors are quite difficult to carry off at the first time. [substeps] Start off by picking out a clothing item of any neutral color (beige, black, white, cream or any of their shades).\",\"endings\":\"['It would be better if you choose the top to be of this color. Make sure the top is flowy or loose as this just balances out the outfit and makes it wearable on a daily basis.', 'You can also go monochrome for this! Give yourself a lip liner and add metallic eyeshadow if you desire. [title] Express your newly bent waist with your pencil skirt.', 'Color blocking can be difficult if you have a particular color playing against a whole color scheme of the dress. [title] Pick a t-shirt that covers your skin.', \\\"Keep in mind that, while all colors can work as a color blocking accessory, not all're appropriate. For example, in an office setting, you might look especially inappropriate wearing the dress that goes, boring.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}