{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a5915000-f424-591c-b5b1-a83ce46687c6","task_key":"default--validation--7745","task_revision_id":"1","upstream_id":"7745","short_description":"HellaSwag validation 7745","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to cope when you hate your hair [title] Determine your facial shape. [step] Different types of hairstyles suit different types of people depending on their facial shape. To find your facial shape, choose the following option that applies most closely to you : [substeps] Square/round/oval shaped face-the width of your forehead, cheekbones and jaw are the same.\",\"endings\":\"['Diamond shaped face-your cheekbones are the widest part of your facial shape. Pear shaped face-your jaw is the widest part of your face.', \\\"For round faces, you need height (at least a minimum of 5'6 for women), even if your peers are shorter than you. Square/round faces have a wide jawline and traditionally emphasize these features with volume.\\\", 'Pixie-shaped face-the shape of your forehead, cheekbones, jawline and chin are the same shape. Oblong face-the shape of your face, cheekbones, noses, chin and jaw are very similar.', \\\"You can also take control of your hair by highlighting it here and there. Cupid's bow hair-this would be commonly used for this look, but it's not always noticeable.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}