{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bcef6598-5960-516f-bd88-ce48159eab20","task_key":"default--validation--5150--variant-2eb511a20d7d","task_revision_id":"1","upstream_id":"5150--variant-2eb511a20d7d","short_description":"HellaSwag validation 5150","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to create a flawless face [title] Moisturize your face. [step] You can buy any face-scrub or you can create one on your own. Mix one t/b.p of greek coffee , 2 t/b.s, of natural yogurt, one tea-spoon of natural honey, one tea-spoon of sugar and just a little amount of lemon.\",\"endings\":\"[\\\"Don't forget to moisturize your lips by creating a scrub of honey and sugar. [title] Apply an eye cream and a day cream.\\\", 'Make sure to keep the moisturizer on all day. Use a gentle cleanser after you have finished it to keep your skin soft.', 'Rub each item 1-2 times daily until skin shines. This spreads the moisturizer evenly evenly from the neck, forehead and cheeks to the bridge.', 'Mix well or dilute according to your likes (or spf! ). Apply to your face in a sweep for 10 seconds.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}