{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f6f8518d-8a65-54f0-9a85-e370f4995cb1","task_key":"default--validation--1670","task_revision_id":"1","upstream_id":"1670","short_description":"HellaSwag validation 1670","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to dye your hair denim [title] Purchase a bleaching kit. [step] If you have naturally blonde hair or very light brown hair, you can skip the bleaching process. Blue dye will layer over your existing color, so it will hardly show up if you have darker hair.\",\"endings\":\"['[substeps] Shop online or in bulk online for hair dye kits if you have recently dyed your hair. This is called altering the color of your hair, as restoring the color to it is one of the fastest ways to get blue dye.', 'You can dye your hair just as you would your hair going to another hair color. The only difference is that if you dye your hair purple it will just show up on your wig to school.', \\\"You can find bleaching kits at beauty supply stores, and they will have everything you need to bleach your hair, so they're great for amateur colorists. The kits will come with bleach powder, developer, a mixing bowl, and a brush.\\\", 'Luckily, you can also choose a kit with six colors that complement your current color. This will make the dyeing process possible.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}