{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"26a162f3-bb25-54bb-a4f5-3d16050c2009","task_key":"default--validation--46908","task_revision_id":"1","upstream_id":"46908","short_description":"HellaSwag validation 46908","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to discipline your kids as divorced parents [title] Keep the rules relatively stable. [step] A divorce can upend children's lives. If you introduce a bunch of new, extremely restrictive (or extremely lax) rules following a divorce, you'll only add to their stress, confusion, and unhappiness.\",\"endings\":\"[\\\"You'll be surrounding your children's faces with different rules so they have no sense of which rule is the right one to follow, and you'll open up the doors to overcrowding and inreason. [substeps] They might not agree to a rule at first.\\\", 'When the courts are involved, you should choose with caution what to enforce. [substeps] If you personally handle kids as well as your whole family, consider arguing that a majority of the rules are fair and consistent.', \\\"Talk to your child about the rules so they know what is expected of them. [substeps] Always try to keep your rules and additions predictable-your child needs to understand that you need to consistently stay consistent with them, and you're not allowing them to relax.\\\", 'Once your divorce is finalized, carry over as many of the rules as possible from the time before you and your spouse divorced. [substeps] If you do decide to change a rule, then make sure that you evaluate your reasons for the rule change.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}