{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c9e6d33a-376a-508d-8745-51357b8f16a0","task_key":"default--validation--27178","task_revision_id":"1","upstream_id":"27178","short_description":"HellaSwag validation 27178","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to care for your indian hair extensions [title] Keep the hair clean. [substeps] We suggest that you wash the hair at least once to twice a week with warm or cold water. Wash the hair immediately after swimming, spa, exercise, and etc.\",\"endings\":\"['Due to heat absorption results from the chemicals produced in the hair. You must also rinse out debris when you wash.', 'When dirt and sweat accumulate, hair tangles. Too much leave-in conditioners and other hair care products will create a build up on the hair and will cause it to tangle faster.', '[title] Curl or squeeze the hair for use in braids or extensions. [step] Curl only the roots and only add hair extensions.', 'This clean, well kept water prevents the hair from getting damaged and can also help cut down on frizz from irritation. [title] Wash and condition the hair at least once to once a week.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}