{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"49002849-1bf6-54d2-a3e1-db56cf7d0b1b","task_key":"default--validation--5835","task_revision_id":"1","upstream_id":"5835","short_description":"HellaSwag validation 5835","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to make a child feel valued [title] Spend time together. [step] This basic step is a building block for teaching a child to feel you value her as an individual. Find ways to spend special time alone with your child.\",\"endings\":\"['Instead of having \\\" mom and dad \\\" on your front porch, ask her to help you draft a curriculum for each week of school and the day before you get to school. Invite her to sit and watch a sport you both enjoy.', \\\"[substeps] Whether it's spending at home playing together, with your dog or reading a book together, take a day every week to spend with your child and spend quality time together. Be prepared for social pressures-couples can toss potential spouses aside and have fun while watching a movie or watching a tv show.\\\", \\\"This will foster respect and closeness, and allow you to learn more about what your child wants and needs. [substeps] Activities you do with your child don't have to be complicated.\\\", 'Look for opportunities to spend time with your child. If you spend time alone, ask your child to join you.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}