{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d798698b-8a23-5562-ac94-8c98c83f12f7","task_key":"default--validation--50517","task_revision_id":"1","upstream_id":"50517","short_description":"HellaSwag validation 50517","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to work out your fashion style [title] Wear clothes that flatter your shape. [step] The first thing to do to look effortlessly stylish is to make sure that you're wearing clothes that are good for your body type. Since effortless style is supposed to be subtle, you'll need your clothes fitting well in order to get the elegant, expensive look from your clothing.\",\"endings\":\"['[substeps] Wear dresses and tailored shirts that fit and accentuate your shape instead of showcasing your body. Make sure that all of your designs are subtle and that your designs cover as much of your body as possible.', \\\"Don't get all maxi skirts and t-shirts trying to hang below your bust. Just keep them fit when they're show! [substeps] Choose a color that suits your skin tone and body type.\\\", 'You want clothes that make you look thinner and the perfect height, with everything in proportion. [title] Find your colors and play with it.', \\\"[substeps] For example, if you're petite, your clothing should fall just below your chest and come up to your waist. If you're taller, have your clothes tailored to your height and maturity level.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}