{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4682899d-ba76-5544-a06f-3c36e066e1ce","task_key":"default--validation--19201","task_revision_id":"1","upstream_id":"19201","short_description":"HellaSwag validation 19201","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get rid of laugh lines [title] Use moisturizers daily. [step] Using moisturizer can help hydrate your skin and reduce the appearance of fine lines and wrinkles, including those around your mouth. For the best results, use skin moisturizer that contains collagen, which can help plump up and repair your skin.\",\"endings\":\"['[substeps] Look for a moisturizer that has a spf, such as spf 30, or including spf 30-35 with spf 15. Health professionals recommend against using products containing any higher ph than 70 or higher.', '[title] Apply skin exfoliants on a regular basis. [step] Exfoliating can help remove dead skin cells to reveal the healthier, younger skin cells that lie beneath and reduce fine lines caused by laughing and smiling.', '[substeps] The best moisturizer is calamine lotion (pho) and spf. Apply the moisturizer every night before you go to bed.', '[substeps] Turn off the faucet and let the water run for a minute. Set your carrier oil or bentonite oil on a towel, and splash water on your face.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}