{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ad410976-c4ca-5e17-bd53-fb724851ef78","task_key":"default--validation--20253","task_revision_id":"1","upstream_id":"20253","short_description":"HellaSwag validation 20253","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to dry yourself after a shower [title] Keep a clean towel handy. [step] You may not like to think about it, but your bathroom towel is one of the most bacteria-ridden items in your home. Bacteria grows on organic material and in damp places, making your bathroom towel a perfect breeding ground for the bacteria it collects from your skin.\",\"endings\":\"[\\\"To make sure you don't wind up with bacteria on your bathroom towel, check the underside of your towel to see if there is any bacteria on the towel. If there is, don't use the towel.\\\", 'Spreading this bacteria can lead to skin infections and illness. Follow these steps to take care of your towels : [substeps] Never share towels with other members of the household.', \\\"If you feel your house is not hygienic and you do not want to throw away that towel, consider laying some type of plastic or paper towel in a rough corner between your sink and the toilet. That way, bacteria can't get anywhere in the bathroom.\\\", 'Every day, turn your towels into toilet paper and throw them in the trash when you take a shower. [substeps] If you notice a sign of a bacterial buildup on your bathroom towel, use bleach to take your towel to your local cleaners.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}