{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f6b4046c-0f9f-570c-b415-adb82c8a2066","task_key":"default--validation--24304","task_revision_id":"1","upstream_id":"24304","short_description":"HellaSwag validation 24304","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to bond with long distance grandkids [title] Connect with grandchildren based on their interests. [step] Rather than trying to force conversation with a shy grandchild or playing sports with one who's uncoordinated, maximize success by playing to their interests. Figure out what each grandchild enjoys and use that to strengthen your bond with them.\",\"endings\":\"['[substeps] Use photos or favorite music to spice up a one-on-one bonding session. Likewise, use text messages or touch-screen games to make these kinds of sessions stronger.', '[substeps] Ask your grandchildren about their hobbies and interests. Nod your head as much as necessary and see how the grandchild responds.', 'This way, the children can enjoy hobby-related activities with each other. [substeps] For instance, perhaps one grandchild shares an interest in photography and expects to be the most adventurous, while the other refers to learning to knit, embroidery, sewing, and other new skills.', '[substeps] Use both face-to-face and long-distance check-ins to focus on their individual hobbies, passions, and talents. This allows you to recognize and appreciate the differences between each grandchild.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}