{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1af7727e-1a29-5ac4-9305-310b6dda3b48","task_key":"default--validation--34823","task_revision_id":"1","upstream_id":"34823","short_description":"HellaSwag validation 34823","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to grow nape hair [title] Avoid abrasive fabrics. [step] If you wear heavy, coarse materials close to your nape hair, this can cause it to become damaged and break. Try to keep your hair up and away from anything that could potentially harm your nape hair.\",\"endings\":\"['Avoid hair creams, shampoo, gels, and conditioners that you may also wash out of your hair. [substeps] Since nape hair can be tough to style, it may benefit not to wash.', 'If your hair is prone to damage due to excessive friction, try to avoid products that used to fill in hairline and shoulder injuries. [substeps] If you neglect to step properly and to keep your hair in place, your hair will be damaged even more.', '[substeps] Silk silk scarves are especially prone to breakage. If you do have to wash your hair regularly, consider dampening your silk scarf with water.', \\\"Direct contact with abrasive fabrics can cause damage over time, so it's important to keep this in mind all year long. [substeps] This is especially important during the colder months of the year when you are more likely to wear heavy fabrics near your nape hair-like heavy coats, sweaters, and scarves.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}