{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ff4de032-1209-5fc8-b5f6-8e5fb26204e5","task_key":"default--validation--45610","task_revision_id":"1","upstream_id":"45610","short_description":"HellaSwag validation 45610","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to cut a bob [title] Get good cutting shears for hair. [step] If you decide to cut your own hair at home, you should look for cutting shears that are made for hair and that are high quality. You can find good cutting shears online or at beauty supply stores.\",\"endings\":\"['Cut the hands off of the shears before you begin to cut. This will keep you from nicking your skin after cutting the scissors and also slow down from cutting your dreads.', '[substeps] Always cut hair that is already split into smaller pieces. If you notice a significant amount of split hair, cut off some of it to prevent it from getting in the way.', 'Using good quality shears will make it easier to cut your hair at home. [substeps] You should look for cutting shears that have a stainless steel blade and a blade that is sharpened.', \\\"Long, thick scissors should work fine for a bob about 4 inches (10 cm) long. If you can't get a good pair of scissors, you can ask your barber for a substitute.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}