{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"87c6f6f1-abd7-570e-b6c5-f4008e3626e6","task_key":"default--validation--34790","task_revision_id":"1","upstream_id":"34790","short_description":"HellaSwag validation 34790","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to rejuvenate the skin [title] Know your skin type. [step] How you care for your skin will depend on your particular skin type. There are five basic skin types.\",\"endings\":\"['[substeps] Oily skin: this skin type is particularly dry. Oily skin can dry out easily, but with the proper application of the bleaching treatment you should be able to get by with very good skin.', \\\"[substeps] Don't pick more than one. And don't use more than two.\\\", '[substeps] Oily skin: get at least 70 hours of sun every day. This can be achieved by a combination of sun exposure and exercise.', '[substeps] Normal skin is clear and not particularly sensitive. Dry skin is flaky or rough.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}