{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"448a8edf-6e6d-5994-831d-6391fb17a338","task_key":"default--validation--46868","task_revision_id":"1","upstream_id":"46868","short_description":"HellaSwag validation 46868","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to love your blind or visually impaired child [title] Buy toys that appeal to the other senses. [step] Choose toys that are interesting for a blind child, such as toys that make noise and have different textures. Blind children can learn fundamentals like cause and effect through touch and sound, so let them explore things through touch.\",\"endings\":\"['For example, you might have stickers from cartoon characters. Just choose one item and let it explore you.', '[substeps] For instance, play fetch or count how many people walk by. Make sure that your child uses her hands most of the time, especially when reaching for things instead of your hands.', \\\"Look for toys that have a lot of moving parts, textures, and sounds to appeal to their senses of touch and sound. [substeps] Choose sturdy toys that don't have small parts so that they won't break and become hazardous for your child.\\\", 'One of the main things to consider when buying toys is its size and shape. Sensory perceptions affect the size and shape of a certain object.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}