{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fdd25320-9ace-59f5-b3e9-1949b08b14fa","task_key":"default--validation--28869","task_revision_id":"1","upstream_id":"28869","short_description":"HellaSwag validation 28869","config":"default","split":"validation","body":"{\"activity_label\":\"Sports and Fitness\",\"ctx\":\"[header] How to acclimate to hot weather [title] Start with light recreational activities. [step] When you're first getting used to the heat, it's best to take things nice and easy until you know how you'll respond. Go for a brisk walk, toss a football around or take care of a little yard work.\",\"endings\":\"[\\\"Just be careful not to overdo it-being out for too long can quickly leave you feeling drained. [substeps] You may not be ready to jump right into your normal routine if you've recently relocated somewhere warmer.\\\", \\\"Then find somewhere that's more comfortable and quiet, and stay there for the duration of the day. [substeps] You could take your dog for a hike around the neighborhood, share a cup of tea together in the backyard, or play video games online.\\\", 'Start slowly with lower levels of activity like cooking, gardening or just going for a run. Get creative and move around an area or just let loose and have fun doing small things.', \\\"Start with light, fun activities that release high-tension and increase endorphins, which can greatly improve your mood. [substeps] Cycling, swimming and tennis are all great choices of exercise the first few times you're out in the heat.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}