{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f0c8eac8-216d-544f-9868-ab4c25d8fde3","task_key":"default--validation--46516","task_revision_id":"1","upstream_id":"46516","short_description":"HellaSwag validation 46516","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to become someone your child wants to confide in [title] Be available. [step] In order for your child to feel comfortable confiding in you, they have to have the opportunity. If you're always chatting on the phone with friends, locked into the television, or away at work, you'll miss chances to communicate.\",\"endings\":\"['[substeps] Think similarly to professors and establish some \\\" office \\\" hours for your children when you remove distractions and focus on them. You can use this time to do chores together, engage in fun activities, or share details about your individual days.', \\\"You'll need to be available to your child at all times. [substeps] During the times that they feel comfortable, become available.\\\", \\\"By being available, you're providing extra comfort to your child and suggesting they feel less pressured to talk. [substeps] Speak to your child about your wellbeing at every opportunity.\\\", \\\"Ideally, you'll offer to make time for your child only when they need it. [substeps] Try asking for time off just to vent, if the situation is really overwhelming.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}