{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1a089f8d-ac94-5382-a3a9-87eae1ca4f2b","task_key":"default--validation--22757","task_revision_id":"1","upstream_id":"22757","short_description":"HellaSwag validation 22757","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make your nose look smaller [title] Understand how contouring and highlighting work. [step] You can use makeup that is slightly darker/lighter than your natural skin tone to make your nose appear slimmer. Keep in mind, however, that it won't physically make your nose smaller.\",\"endings\":\"['Just shading can make it bigger and limber. [substeps] Contouring your nose is an inexpensive approach, but once you get it there is no point in retaking it.', 'It will be drawn into different areas of your face and will only create shadows and other imperfections that might make it appear bigger. [substeps] Contouring should be used sparingly and only does so when you really need it.', \\\"It'll simply mean that your nose area will be for makeup to focus on. People with thin noses will often have deeper blemishes, and people with large, dramatic faces will usually not have full noses at all.\\\", 'Also, if you have a very long nose, contouring will not make your nose look shorter in side view. [title] Choose the right shading and highlighting makeup.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}