{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"85c52b9a-6c2d-5b19-b994-3d38079377c7","task_key":"default--validation--15611","task_revision_id":"1","upstream_id":"15611","short_description":"HellaSwag validation 15611","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to use tinted moisturizer [title] Distinguish between tinted moisturizer and foundation. [step] Tinted moisturizer and foundation are both water-based products that contain moisturizing agents, oil, and pigment (to give some coverage). But, tinted moisturizers contain more moisturizing agents than foundation and generally offer lighter coverage.\",\"endings\":\"[\\\"[substeps] Depending on the makeup line, tinted moisturizers and foundations can be almost indistinguishable so you'll need to experiment with products. Tinted moisturizers come in a bunch of different formulas, so look for one that is right for you.\\\", 'The foundation is usually made with synthetic materials, like cotton or linen. Foundations also tend to come in a range of shades, such as creams, pastels, and earth tones.', '[substeps] Tinted moisturizers are usually applied over the face and naturally look less surface-like than foundation. Foundation comes in both water-based and oil-based types.', 'Apply your tinted moisturizer or foundation to your face instead. [substeps] Tinted moisturizers provide the most coverage, but they tend to dry out most of the time.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}