{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"991579ec-dd08-5430-ad47-cda319795897","task_key":"default--validation--5325","task_revision_id":"1","upstream_id":"5325","short_description":"HellaSwag validation 5325","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to moisturize before makeup [title] Choose a moisturizer appropriate for your skin type. [step] You can get moisturizer oil-free, extra heavy, or anywhere in between. Oil-free or light moisturizers are best for people with oily, combination, or normal skin.\",\"endings\":\"['Heavy moisturizers will stop the oil buildup from running through your pores, causing problems. Lighter moisturizers should get people with oily, combination, or normal skin some moisture.', \\\"Light moisturizers can damage your skin and leave it looking dry and translucent. [substeps] Black is a good choice for oily, combination, or acne-prone skin because it is light in color and won't transfer to oily skin.\\\", 'Darker products, however, may be best for those with combination skin. In order to determine if a product will help your oily skin, you should check labels for particular products.', 'Heavier moisturizers are often necessary for dry skin, but they can be a slippery base for makeup. [substeps] Heavy moisturizers add a dewy effect to your appearance.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}