{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a11cbd98-49bb-50bc-9ea1-26e7b6aeb184","task_key":"default--validation--39021","task_revision_id":"1","upstream_id":"39021","short_description":"HellaSwag validation 39021","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to choose a walker or rollator [title] Choose a walker if you need stability. [step] Walkers are a basic form of mobility aid that provides the user with support in moving. Walkers come in many sizes, shapes, and have a wide variety of features.\",\"endings\":\"[\\\"That being said, walkers are easier on your feet than rollators since they have a tendency to slide around less. [substeps] Rollators may be more difficult to move because they're only for people who have stabilized themselves over time.\\\", \\\"Make sure that your walker is as comfortable as possible, if you don't like walkers, or don't like how your body works. [substeps] Walkers are also known as floor walkers and impact walkers.\\\", 'Some walkers have bike pads to prevent them from falling when you need them. More features are included in the walker variety, but most walkers will have the controls plugged into the back of the vehicle.', \\\"Some may even have wheels, but the wheels won't generally rotate. [substeps] Walkers most often have aluminum frames, are height adjustable, and require you to lift it to move it.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}