{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7472b178-acaa-5570-a626-974dbfa23a93","task_key":"default--validation--924--variant-c957517fea90","task_revision_id":"1","upstream_id":"924--variant-c957517fea90","short_description":"HellaSwag validation 924","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to deal with difficult teenagers [title] Spend quality time together. [step] Connection between the teenager and parent or guardian is a strong protective factor against harm such as emotional distress, risky sexual behaviors, and substance use. [substeps] Schedule regular family activities like eating dinner together or having game nights.\",\"endings\":\"['Schedule holiday hours, vacations, and social events with the teenager or partner before the teen or guardian takes over. You might ask your teen to babysit a few nights a week for an hour.', \\\"If their parents or guardians aren't very close, you can play board games with them or watch a movie together. Some teens who are raised in extremely restrictive environments may develop addictions like alcohol.\\\", \\\"You can also get to know the individual person more openly than if you didn't already. Get a hand in all their decisions, especially if that person expressed knowledge of teen problems.\\\", 'Spend face-to-face time on a weekly basis. Take your teen out to lunch or dinner without the rest of the family.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}