{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2112ef88-1980-5a52-8a13-91df2b4df972","task_key":"default--validation--16823","task_revision_id":"1","upstream_id":"16823","short_description":"HellaSwag validation 16823","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to look thinner [title] Wear clothes that fit. [step] You should always start by wearing clothes that fit. Clothes that are too small or too big will both make you look bigger than you are.\",\"endings\":\"['Try not to buy clothes that are too tight, too baggy, or big enough that you feel extra small. You can always cut some holes or wear any type of clothes that are too baggy.', 'If you feel very small in your clothes, you could hesitate to wear clothes that are too big and further hinder your growth and build, which helps you to appear thinner. [substeps] If you have a large mid-section, wear a short dress, to show that you are not an inch taller than yourself.', \\\"Clothes should not be tight because this creates and emphasizes the appearance of fat rolls. Clothes should also not be too loose, because the added bulk and hiding of your form will only make it look like you're got more under there than you do.\\\", 'Try to find clothing that is either too large or too small for you. [substeps] Exercise and buy size and style your clothes accordingly.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}