{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9dd3de48-ad9b-55d6-8e6d-f40931d5e570","task_key":"default--validation--11394","task_revision_id":"1","upstream_id":"11394","short_description":"HellaSwag validation 11394","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make a tinted moisturizer [title] Use foundation and moisturizer products. [step] You can make tinted moisturizer at home using professional products in your makeup bag. Use your regular foundation and a high quality facial moisturizer.\",\"endings\":\"[\\\"Also be sure to apply : [substeps] Olive oil olive oil foundation moisturizer lotion or sponge facial moisturizer [title] Find beauty supplies that say sunscreen. [step] What good they do you if they aren't sunscreen? Nothing complements sunny weather, which makes tinted moisturizers more difficult to keep in place.\\\", 'If you do not have a professional liquid foundation, you can use your regular moisturizer. The products can help the moisturizer stick to your face better.', 'As your skin will be hydrated before you apply the moisturizer, use a spritz of foundation before you take off your makeup. Make sure that you incorporate several spritzes of body oil and cream into your makeup to improve its shine.', 'Combining products you already use will ensure your skin does not react badly to the tinted moisturizer. [substeps] You can use powdered mineral foundation or liquid foundation to make the tinted moisturizer.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}