{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"353e4cb9-9677-53d3-afad-50eb82a1f2fb","task_key":"default--validation--43103","task_revision_id":"1","upstream_id":"43103","short_description":"HellaSwag validation 43103","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to choose a revlon foundation [title] Determine your skin type. [step] Is your skin shiny, acne-prone and oily? Is it flaky and dry? Is it aging, with lines and wrinkles? You will need to consider your skin type when choosing what foundation to wear. [title] With your skin type in mind, decide what form of foundation you would most like : [step] Liquid, crème compact, or powder.\",\"endings\":\"['Liquid foundation tends to be easiest to apply and blend and is well suited to nearly all skin types. However, it is not portable for touch-ups and can be messy.', 'This is the foundation you wear most often and generally results in the most coverage. Too little foundation will make your skin look unhealthy and bulky.', 'Be aware that liquid foundations are uneven and so are powder foundations. If you are going for a more balanced look, a powder foundation is likely your best bet.', 'Different foundations will create different chemical properties, so it is recommended to begin with a little foundation to see which you prefer. [title] Choose a foundation that matches your face shape.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}