{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2f05ee46-1a19-51ab-8fcb-f81e49e5f877","task_key":"default--validation--41566","task_revision_id":"1","upstream_id":"41566","short_description":"HellaSwag validation 41566","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to deal with depression in teenage girls [title] Watch for signs of irritability that last for longer than two weeks. [step] Irritability is one of the most common signs of teen depression. This can be a general' cranky' mood that can also come with mood swings that lead her into sadness.\",\"endings\":\"[\\\"Feel free to participate in any occasional social interaction that provides this mood fluctuation. You can cry or act angry if it's appropriate for you and when the mood swings subside quickly, stop talking to the girl.\\\", 'These usually include them following a high level of passive-aggressive style or exhibiting non-verbal behaviors like keying. These behaviors would indicate that they are using you for their own benefit.', '[substeps] If your teen is generally available on weekends, she will most likely talk about it with you. Because you often ask her how she feels in the shower or on her phone, she may feel uncomfortable or defensive when talking to you.', \\\"She might' snap' at you more often than usual and may seem generally unhappy. She may also suddenly spiral into deep sadness, or cry often out of both annoyance and sadness.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}