{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"622aa790-b7ba-5318-95f2-6349df307937","task_key":"default--validation--9242","task_revision_id":"1","upstream_id":"9242","short_description":"HellaSwag validation 9242","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make natural face cleansers [title] Consider using honey to clean your face. [step] Honey is a natural exfoliant, so it helps get rid of dead skin cells without the harsh, abrasiveness of salt and sugar scrubs. It also makes a great moisturizer, and leaves your face feeling soft and smooth.\",\"endings\":\"['[substeps] For oily skin, take a little melted butter or olive oil and use a little honey. Mix honey with three to four tablespoons of honey and your solution.', 'While honey is a great alternative to the conventional facial cleanser, you can treat dry, brittle skin with honey. Honey is able to soak into your skin naturally, causing the skin around your face to moisturize itself, saving you the moisture inside.', 'Honey is also a sure form of exfoliating body scrubs. [title] Rub a body scrub or sugar scrub into your skin.', 'Lastly, honey is also a natural antiseptic. This means that it not only helps remove toxins from your skin, but it also helps kill any acne-causing bacteria.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}