{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a65d17b3-7bbf-5ba6-9d67-ad61bd974b01","task_key":"default--validation--16399","task_revision_id":"1","upstream_id":"16399","short_description":"HellaSwag validation 16399","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to start walking for exercise [title] Find a good place to walk. [step] Generally, the locations for walking have a flat terrain, straight path, smooth surface and minimal traffic. The convenient choice would be the neighborhood around your block, but if the road is too steep, curvy or just not what you're looking for, you might want to consider other areas around your town.\",\"endings\":\"[\\\"[substeps] Bicycle routes are typically also good options. If you're a beginner, the chances are good you'll find a local trail that's easy to follow.\\\", '[substeps] Ensure you are wearing appropriate footwear as walking puts a bit of pressure on your feet which can cause pain. Also, be sure you are wearing the correct footwear for the weather.', '[substeps] If possible, find a public park. You might even want to stop in an actual parking lot in your neighborhood.', '[substeps] You want a place that has a lot of traffic, not an area where people might be stopping. This can take a bit of time and effort, so find a safe and distraction free area to walk.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}