{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0137c058-9af6-5e71-9741-a052430b9284","task_key":"default--validation--12850","task_revision_id":"1","upstream_id":"12850","short_description":"HellaSwag validation 12850","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make an avocado mask [title] Peel, pit, and mash half of an avocado in a small bowl. [step] Use the back of a fork to smoosh the avocado up well, and to get rid of any lumps. Avocado is great for the skin, because it is full of healthy fats and oils.\",\"endings\":\"['[substeps] The avocado can be used at breakfast, lunch, or as a base for smoothies. [title] Season the avocado with olive oil and ground pepper, then set it aside.', 'Lemon is best for the skin because it is naturally rich, but using avocado will give you an olive-like result. [substeps] Bananas are great for the skin because they are super smooth and creamy, and they are very ripe.', \\\"If you have very clean skin, the avocado will not clog your pores. The slices of avocado will not clog your pores; they simply shouldn't.\\\", 'These fats and oils help moisturize and nourish your skin. [substeps] Save the other half of the avocado for eating later, or for another mask.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}