{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4067d393-7186-5964-94b1-7b4508fe4cb0","task_key":"default--validation--15350","task_revision_id":"1","upstream_id":"15350","short_description":"HellaSwag validation 15350","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to curl hair with toilet paper [title] Get a roll of toilet paper. [step] You will need a standard roll of toilet paper, preferably toilet paper that is thick and durable. A thicker, more durable toilet paper will make it easier to curl and tie the toilet paper into your hair without the risk of tearing or ripping of the toilet paper.\",\"endings\":\"['[substeps] Take a small roll of toilet paper and tear off a piece that is about 2 inches (5.1 cm) wide and 4 inches (10 cm) long. This will be the four toilet paper strips you use for this project.', '[substeps] You can also use paper towels or paper napkins if you do not have access to toilet paper. You will need to tear the paper towels or napkins into thin strips, about as wide as a piece of toilet paper.', 'The toilet paper should be about 2 inches in diameter and dry to hold together while the paper is folded. [substeps] This method of curling hair is quick and easy, but keep in mind that the volume and thickness of the toilet paper will be slightly different on the first try.', 'These rolls are available for around $12, so make sure you have a roll of toilet paper that is that thick and strong enough for your hair to hold together. [substeps] Since toilet paper rolls all come with holes, you will need one that is durable.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}