{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"96d12d1a-3c49-5358-b8d2-813eaec2a541","task_key":"default--validation--42900","task_revision_id":"1","upstream_id":"42900","short_description":"HellaSwag validation 42900","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to prevent keloid and hypertrophic scars [title] Identify the risk factors for keloid scar formation. [step] Keloid scars are more commonly found on the arms, upper chest, and upper back. They grow beyond the borders of the original abrasion and appear as red, raised nodules.\",\"endings\":\"['Keloid scars will usually take on the appearance of a raised scar when self-sewn onto the body, from which the scars are more visible. If your scars are recent, older scars may appear as they are and you want to avoid them.', 'These nodules are easily seen in unsupported black circles and from afar; however, discoloration and dark splotches are particularly common. Even though blacks and whites are sometimes called keloid scars, the scars are especially common in areas that have chemical dermatitis.', 'They may appear yellow, purple, or greenish. Keloid scars are temporary, but should rarely return.', 'Keloids are the result of an overgrowth of dense fibrous tissue that usually develops after healing of a skin injury. You can also develop a keloid scar from a cut, a piercing, or acne.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}