{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7f09ba44-0b26-506a-ace0-22cc36535ef8","task_key":"default--validation--36125--variant-66f942598286","task_revision_id":"1","upstream_id":"36125--variant-66f942598286","short_description":"HellaSwag validation 36125","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make lips look smaller [title] Determine your skin color choices. [step] This is a step you want to get reasonably accurate early on. [substeps] Go to a pharmacy, department store, salon, or similar business with a make-up counter.\",\"endings\":\"[\\\"Consult with the clerk and/or palette samples to get a sense of what color the skin around the problem lip (s) is--and identify the names of the make-up colors you will need. Make sure what you choose won't inadvertently offset your skin tone while you are trying to help the appearance of your lips.\\\", 'Look for things like a soft pink blush for pale skin, or a deep red lip for brighter lips. Try on labels and of course, go for pink, green, or peach colored lipstick.', 'A good rule of thumb is that even if you have dark skin, other people will be able to tell you if their color matches your complexion. Measure the distance from your mouth to the top of your cheekbone.', \\\"Have someone take a close look at you and have your face checked to see if it has blush applied all over the areas with unnatural shade. If you're using lip-liner, ask for a clear lip liner like paris bronzer for the most flawless look.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}