{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a802aced-c664-5271-bf7b-3837b15654ff","task_key":"default--validation--21515","task_revision_id":"1","upstream_id":"21515","short_description":"HellaSwag validation 21515","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to wash out hair dye [title] Fade your hair color with the vitamin c method. [step] This is widely reported to fade color quickly and without causing too much damage to your hair. [substeps] Crush vitamin c tablets with a pestle and mortar or in a plastic baggie with a rolling pin or hammer.\",\"endings\":\"['Crush the tablets on a rolling pin until they are light and dust evenly onto your hair. Divide your hair into two halves, and roll them between your palms until each half is covered in 1 ounce of the paste.', 'Move the crushed tablets to a small bowl and add a tablespoon of water to make a paste. Apply the paste to your hair and leave in for about 30 minutes, then rinse with warm water.', 'They should be pulverized in 1 tablespoon, then crushed by rolling an exfoliating brush and water. Use smaller amounts to soften darker hair and more often to \\\" mash \\\" lighter hair.', 'Squeeze the tablets, turn them upside down, and store in the shower or to serve as a paste. Add a couple of drops of your favorite essential oil or conditioner and a little dish detergent to the water.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}