{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"53ad9108-a86b-55c7-b93d-93b235612a30","task_key":"default--validation--1084--variant-45a10dcc073f","task_revision_id":"1","upstream_id":"1084--variant-45a10dcc073f","short_description":"HellaSwag validation 1084","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to encourage your teen to procrastinate less [title] Encourage them to set priorities. [step] Remind your teen to do important tasks first, then move onto smaller or less important ones. Have them write down everything they need to do, then number them in order of importance.\",\"endings\":\"['That way, your teen will know how to attack the list of things that needs to get done. [substeps] You can help your teen set priorities on weekly basis, or help them tackle their homework this way each day after school.', \\\"This will help encourage them and help them achieve their goals without feeling like they're giving up. A healthy teen would set priorities that fit within their needs, not ones you're always rushing to get done or procrastinating.\\\", 'This helps them try to stay accountable for tasks. [substeps] For example, your teen might have to complete a certain number of exams on the first day of school.', 'For example, say, \\\" prioritize everyday, \\\" or \\\" prioritize everything so nothing goes wrong. \\\" [title] Save the bigger things, like food.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}