{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"19a52e12-6269-532c-8543-c94825495802","task_key":"default--validation--40424","task_revision_id":"1","upstream_id":"40424","short_description":"HellaSwag validation 40424","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to have an alluring scent [title] Follow good hygiene. [step] Without basic hygiene you can't expect to smell alluring, or even the slightest bit sweet. Start with a clean, fresh base daily so you have something to work with.\",\"endings\":\"['Shower daily, brush your teeth two times a day, apply deodorant when required, clean your hands and wash your hair on a regular basis. Basically, just follow the typical hygiene rules, easy as pie.', '[substeps] Do not use body odor as a breeding ground for fragrances. Allow your hair to air dry, use a dust mop, and change your clothes frequently.', 'Make sure you always apply a good sunscreen and/or a good scent supplemental deodorant and all the accessories you think will instantly attract, showcase or highlight this lovely scent. So if you wear your hair greasy, make sure you get your hair healthy, and always shower every day.', \\\"Your hygiene pack doesn't have to be elaborate enough or special enough to fool the eye. Leave a few simple notes with your scent on so it doesn't take up too much space.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}