{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"33239b0b-e2fe-5556-b9ff-e9c5556c0391","task_key":"default--validation--32444","task_revision_id":"1","upstream_id":"32444","short_description":"HellaSwag validation 32444","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to grow out your natural hair color [title] Grow your roots at least 1-2 inches. [step] The first step in growing out your natural hair color, is simply that: grow your hair. Wait anywhere from 2-4 months to allow your hair to grow an inch or two.\",\"endings\":\"['[substeps] Although growing your hair longer allows it to receive more sunlight, it may stop growing as the months go on. The result will be shorter and darker hair.', \\\"Once you've achieved that length, your hair will be thicker, and the color will deepen. It will keep until the roots reach your scalp.\\\", \\\"Make sure your roots don't flat out after waiting longer, as this will result in frizzy roots. [title] Wash hair with shampoo and conditioner every other day.\\\", '( if you can stand it, let it grow even longer). You need a base of natural hair at the roots to start with.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}