{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6ee996e4-bc0f-5ee4-add7-dc0a447d668b","task_key":"default--validation--29559","task_revision_id":"1","upstream_id":"29559","short_description":"HellaSwag validation 29559","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to dye men's hair [title] Choose a subtle color change. [step] Unfortunately, obviously dyed hair can be a source of embarrassment for men in many societies. To avoid this, stick with colors close to your natural hair color, at most one or two shades lighter or darker.\",\"endings\":\"['If possible, try to pick off a flavor that you\\\\'re going for in order to brighten your hair color. [substeps] Many women are stylists and their hair can turn out brighter and healthier if they\\\\'re following the \\\" girl theme \\\" that happens during the holiday season.', \\\"You don't have to dye every single strand of your hair a deep, rich color-that would totally ruin your style. [substeps] If possible, have your friend or acquaintance pick out any hair you like: this way, you're actually not having to choose two hues of hair.\\\", \\\"Aim for a dye one or two shades darker than the final result you're going for, to allow for fading. [substeps] If there are natural reddish tones in your hair, find a dye with warm tones.\\\", \\\"Many women who dye their hair do so not yet realize how their hair looks like; women who don't dye their hair should at least take the cake out of their hair when they dye. [substeps] In a wash, the dye will be applied carefully to the roots, in order to hold them back.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}