{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"99314e11-3f57-5c7c-b5c1-addbdd76dfa2","task_key":"default--validation--6791","task_revision_id":"1","upstream_id":"6791","short_description":"HellaSwag validation 6791","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to purify your skin quickly [title] Wear a clay mask. [step] There are a vast number of specialist products available to buy in your local supermarket or drug store than can help you to purify your skin. Everybody's skin is different, so there is no fixed guarantee of what treatments will work for which people.\",\"endings\":\"['Shop around; once you have a good idea of what doctors have recommended, just download some manmade masks. Look for masks that shape, shade, and tint your skin : [substeps] Polymer clay clay, which is available from beauty supply shops and can be found at most drug stores.', 'One of the most common ways to purify your skin is by applying a clay mask. [substeps] You will find a number of possible options, two ingredients to look out for a bentonite and kaolin.', 'In the worst case scenario, you may see that your skin is too tender for a purifying treatment. If this is the case, consider taking a warm bath beforehand.', 'The american red cross recommends that you use oil or essential oils daily for seven days after treatment. In addition, you can use a specialized clay mask to keep your skin moisture-free.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}