{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0242b1fb-8e4f-5ee6-b8bf-b67cd444d766","task_key":"default--validation--15741","task_revision_id":"1","upstream_id":"15741","short_description":"HellaSwag validation 15741","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to use green tea for skincare [title] Drink at least two to three cups of green tea daily. [step] Green tea is a rich source of antioxidants, which neutralize skin-damaging free radicals. Because of this, regular consumption of green tea can slow down the signs and symptoms of aging skin.\",\"endings\":\"['Instead, aim to consume enough green tea per day for any of the following daily activities : [substeps] Drink 4-5 cups of green tea per day. Avoid over-consuming green tea as it is too alkaline and dehydrates the skin.', 'Check the tea package for detailed instructions on how much to drink and how frequently to use it. [substeps] Green tea cups are available in capsule form and have a 3-way clasp that helps to keep the tea in place.', \\\"It's recommended to drink at least two to three cups of green tea every day. [substeps] Green tea supplements are natural moisturizers that are believed to help dry out body cells and reduce wrinkles.\\\", 'Drinking as little as two to three cups each day can have positive effects. Green tea can be purchased in ready-to-use tea bags or you can buy loose green tea leaves from specialty shops and health markets.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}