{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"26c14fb9-687f-5804-a487-794ed852c7a7","task_key":"default--validation--42740","task_revision_id":"1","upstream_id":"42740","short_description":"HellaSwag validation 42740","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to trim your eyebrows [title] Brush your eyebrow hairs up. [step] Use a spoolie brush to brush the top of your eyebrows straight upward in a repetitive sweeping motion. All of the hairs that extend up out of the eyebrow when you do this need to be trimmed.\",\"endings\":\"[\\\"[title] Hold the hairs in place with the brush. [step] Use some nail cutting scissors or hair cutting shears to cut the excess length that's sticking out of the top of the brush.\\\", \\\"When the hairs reach your brows, brush them up with a spoolie brush. Brush away any hair that can't be trimmed.\\\", 'The purpose of this action is to prevent your eyebrows from drooping down below. [substeps] Be very gentle when brushing the hairs up.', 'This small lift when you brush and they move up indicates your brows have been trimmed. [substeps] There is an area of the upper eyebrow closest to your brow, usually the top of the arch.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}