{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4737433d-ef42-5c10-b91d-d512229561cd","task_key":"default--validation--21252","task_revision_id":"1","upstream_id":"21252","short_description":"HellaSwag validation 21252","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to dispose of tampons [title] Never flush tampons down the toilet. [step] Once you have removed your tampon, you should dispose of it properly. This means never letting the tampon simply fall into the toilet and then flushing the tampon down the drain.\",\"endings\":\"['This will clog the drain of the toilet and could damage the plumbing. [title] Wrap the tampon in a piece of toilet paper.', 'It also means never holding it there longer than 15 seconds. [title] Wash and sanitize your hands.', 'Follow the safety and sanitary practices of your school and your workplace for safe disposal. [substeps] Be sure that nobody has witnessed you flushing any tampons down the toilet.', 'Wait a few days after you remove the tampon to flush any other tampons down the toilet properly. [substeps] Even if you have replaced your tampon, do not flush.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}