{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"35c2e4e6-15bb-5ba6-bc33-251372dc4e14","task_key":"default--validation--14109","task_revision_id":"1","upstream_id":"14109","short_description":"HellaSwag validation 14109","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to remove black hair dye [title] Use color removing kits. [step] Drugstore kits are designed for the removal of any unwanted hair color. There are a variety of these kits on the market, each of which contain different chemicals and instructions.\",\"endings\":\"['Most kits include a shampoo and cold rinse option. [substeps] Some kits may require a homemade shampoo and run-through.', 'Head store kits are available at pharmacies, but also online, and cost only a few dollars. [substeps] It is also possible to create a wig using the kit you need.', '[substeps] Look for extra strength as black hair dye is the most difficult dye to remove. Consider your length and how heavy the color dye is that you used.', 'Some kits contain spritz binding agents, which might release unwanted hair from the dye. Pre-up kits are usually good options based on how you want to remove unwanted hair.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}