{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7fe7a206-1ed2-5499-b26b-f98406565f4a","task_key":"default--validation--31407","task_revision_id":"1","upstream_id":"31407","short_description":"HellaSwag validation 31407","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to get rid of acne [title] Wash your face twice daily with a benzoyl peroxide cleanser. [step] Benzoyl peroxide is one of the most effective acne treatments. It is found in many face washes.\",\"endings\":\"['To use it, gently put a cup of benzoyl peroxide over your acne and leave it on for five to nine minutes. Then rinse it off with warm water.', 'You can combine the two without bleaching your face. [substeps] For example, you might use a pea-sized amount of benzoyl peroxide for both scalp and face cleansers.', 'Wash your face when you wake up in the morning and before going to bed at night. [substeps] If you can find 1, use a face wash that contains exfoliating particles to help smooth your skin.', \\\"It's a very effective acne-reducing cleanser. Use it only lightly while you are in the shower or bath.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}