{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e6132d18-0881-5973-a596-a217957ea931","task_key":"default--validation--1722","task_revision_id":"1","upstream_id":"1722","short_description":"HellaSwag validation 1722","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to understand a teenager [title] Communicate your expectations to them clearly. [step] Slowly support your teen in developing their independence as they mature. For example, let your younger teen choose how to decorate their room and style their hair.\",\"endings\":\"['Older teens may be able to use the car, attend activities without an adult, or hold a part-time job. [substeps] A controlling parent may face increased conflict with a teen who seeks independence.', \\\"Don't try to control them or set everything on your shoulders. [substeps] Keep in mind that teen independence isn't stupid and vague; it's simple.\\\", \\\"You can help guide their perception of their house style by reminding them that you want to be a model of their style. [substeps] Listen to your teen's cues when they're developing their independence.\\\", 'Or, for example, if your teen attempts to convert furniture into chaos, consider whether your teen is mature enough at this point to move out. Maybe, as time goes on, the teen is more aware of the need to put everything back in order.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}