{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"20ef65c4-0e0f-5c4d-95a4-a90501df8c7b","task_key":"default--validation--46521","task_revision_id":"1","upstream_id":"46521","short_description":"HellaSwag validation 46521","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to keep your makeup from going bad [title] Recognize that makeup has an expiration date. [step] Many people keep beloved-and half-used-cosmetics in a drawer, cabinet, or makeup bag. But that favorite blush or lip gloss may be years old and a goopy, bacteria-laden mess.\",\"endings\":\"['Makeup can usually be put in the drawer for about 7-10 days after it is packaged. This is what you used to finish it off on its last day of use.', 'Most cosmetics have a specific shelf life based on if it comes in liquid or powder form. Understanding that each of your products expires at some point can prevent infections, keep them performing well on your face, and help streamline your routine.', \\\"Any old makeup after that-and an unwanted applicator bag-will go bad. Not because it's old (or doesn't look great) or since just because you've used it before will produce a foul odor.\\\", \\\"This is a surefire sign that some makeup has passed out of storage. All that's left is a minimum of three years old.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}