{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"389215c3-38ea-5564-8496-bdd1b5c6941f","task_key":"default--validation--6569","task_revision_id":"1","upstream_id":"6569","short_description":"HellaSwag validation 6569","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to use a loofah [title] Obtain a loofah. [step] Loofahs are usually the color of pale straw, with a slightly herbaceous scent. They come in many shapes and sizes, and are often sold as either cylinders or sliced discs.\",\"endings\":\"['Loofahs are most effective for soiling, in which case, you can apply loofahs to your body and sit on some of the things that naturally occur in the unscented area, such as your feet and hands. Massage the loofahs in between your feet.', 'You can also find loofahs from other natural sources, such as waterfalls, rivers, and hammocks. [substeps] A loofah is a similar sharpening device to a razor or knife, and is made with a specialized steel blade.', 'The texture of a loofah is rough when dry, but once you add hot water it becomes soft and supple. [substeps] Loofahs are available at most stores that sell body care accessories, including drugstores.', 'They are low maintenance, and can range from sizes of 7-8 a cup, but they can be kept in the water for a long time and can vary greatly in quality. [title] Start by setting up the loofah onto a kitchen towel and gently drying it.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}