{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d7894039-e9e1-5a0a-a2cd-89bc1efa7b09","task_key":"default--validation--34898","task_revision_id":"1","upstream_id":"34898","short_description":"HellaSwag validation 34898","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to sneak tampons and pads into the bathroom [title] Store tampons and pads in several different locations. [step] This makes sneaking your stash into the bathroom more convenient based on where you are and who you're with. For example, if spending the day at school or work, store tampons and pads in your purse, desk, backpack, pencil case, lunch box, and car.\",\"endings\":\"[\\\"[title] Pretend you're hunting for something else. [step] This tricks people into thinking you're looking for items other than feminine products.\\\", 'You can also sneak them into the locker if you are at home, but that will be quicker. [title] Change your tampons and pads often.', '[title] Take plenty of hygiene items with you. [step] Long days on the bus and across a crowded parking lot can make sneaking tampons and pads hard.', 'Put the backs on your tampons and pads in plain sight to avoid having to keep them in your locker. [title] Eliminate the use of your bag or backpack or any other inconvenient places.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}