{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"87196f30-332a-5453-963a-9633194e722e","task_key":"default--validation--19858","task_revision_id":"1","upstream_id":"19858","short_description":"HellaSwag validation 19858","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make short legs look longer [title] Wear clothes that fit. [step] Fitted pants and tops that seem custom made for your body will make you look long and lean. If you're petite, shop in the petite section of stores to boost your chances of finding clothes that fit properly.\",\"endings\":\"[\\\"[substeps] Baggy and ill-fitting clothes will only make you look frumpy, and will do nothing to lengthen your legs. Avoid buying clothes that don't fit you perfectly.\\\", 'This is a fine location for height-conscious people to look, but avoid gaudy clothes that show interest in the female genitalia. [title] Accentuate the things that help you look.', \\\"[substeps] For instance, if you weigh 13, you should accentuate your body's inner thighs by wearing items high enough so that your thighs are above your hips. If you don't particularly want to highlight your curves, pick short skirts or dresses that fall nicely and that hug your waist without drapes.\\\", 'Your wardrobe should also remind you that a bit of your figure is confined in all different ways and only when clothing accentuates or constricts these curves you can look the part. [substeps] Wear vertical stripes to make your legs look shorter.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}