{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"183a14b3-8d69-51de-973d-56c6d49ef31f","task_key":"default--validation--8123","task_revision_id":"1","upstream_id":"8123","short_description":"HellaSwag validation 8123","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to use a brow brush [title] Pick out brow brushes. [step] There are three basics brow brushes: the spoolie, the mascara brush, and the slanted brow brush. Each brush has a distinct shape and serves a different purpose.\",\"endings\":\"['[substeps] The spoolie brush is designed to brush against your eyebrows and center them over your brows. The angled brush prevents your brows from being too short, and instantly accentuates the tenderness and shape of your face.', '[substeps] The spoolie produces red pigment and is made for putting on foundation. The pointed brow brush produces white pigment and should be used in both colors.', 'You can also choose one based on the artistry you are interested in. So your brow brush can be used as a liner brush for the s-brush, or you can choose one to use for blush.', '[substeps] The spoolie brush is essentially a mascara applicator. This spiraled-bristle brush is used to shape your brows and blend your eyebrow filler.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}