{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5b87fe9e-df65-5193-93fd-ddbadf75b75c","task_key":"default--validation--20992","task_revision_id":"1","upstream_id":"20992","short_description":"HellaSwag validation 20992","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to stay fresh [title] Jump in the shower. [step] To stay fresh, start your day by cleansing your body. Your unique body chemistry will determine how often you need to bathe.\",\"endings\":\"['When showering, always fill the bathtub with water. Add warm water from the faucet to make sure to add enough water to saturate your pubic hair.', 'Warm water can last longer at first, but after that you may need to follow that up by subadding hot water to clean yourself. A warm shower can be especially important if you are currently wearing spandex.', 'Many people take a shower every morning, but if you play sports or live in a really humid climate, twice a day might help you stay fresher. If you live in a temperate place and your skin is on the dry side, every other day might be best.', 'Establish a routine in which you shower, taking shower or bathing in the morning or at night. [substeps] If you have a hard time incorporating a routine into your job or lifestyle, think about splitting a morning shower into several smaller days like that or setting aside a specific time for showering to sleep.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}