{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3aae6808-dd81-5131-8488-407a35fc7cd1","task_key":"default--validation--17063","task_revision_id":"1","upstream_id":"17063","short_description":"HellaSwag validation 17063","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to reduce body hair growth [title] Start waxing. [step] Waxing can be painful, but it is quite effective at reducing body hair growth. Since the hair is removed from the root, the hair grows back finer, thinner, and slower.\",\"endings\":\"['The wax is temporary, but hair grows back to the desired length within a day. When waxing, the hair works best against very coarse hairs.', '[substeps] Waxing can be effective on all genital areas of body hair including your vaginal area. However, you cannot use it on more than one area.', 'Waxing can be done at home for children, who use waxing products designed to keep their hair clean. It is also necessary for individuals with any hair condition, such as acne or hair breakage.', 'You can either buy wax to apply yourself at home or go to a spa or salon to get a professional wax treatment. [substeps] There are two different kinds of wax.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}