{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1b39edf7-46b5-5cec-ae90-30961a00f7cd","task_key":"default--validation--42870","task_revision_id":"1","upstream_id":"42870","short_description":"HellaSwag validation 42870","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get a haircut for curly hair [title] Choose a hair cut which will suit the shape of your face. [step] In addition to your curl pattern and your hair texture, various cuts will look different on you depending on the shape of your face. Pull your hair away from your face and take a self-portrait or trace the shape of your face on a mirror.\",\"endings\":\"['[title] Search the internet to find hairstyles suited to your type. [step] Patterns can be hard for many to identify, and usually agencies will use pictures as reference during a fashion search.', '[substeps] The exact type of style you choose will depend on how curly you want your hair to be. Ask a hairstylist if a special will cut your hair for you or other people.', '[substeps] If your hair looks good, and hair has been styled so it fits your shape, wear it. If you prefer a more voluminous look, split the hair into two sections.', '[substeps] If your forehead is the widest part of your face, you likely have an oval face. If your cheeks are the widest part of your face, you may have a round face shape.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}