{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3e4ef78d-1948-5829-9c74-22d4c9b81954","task_key":"default--validation--43457","task_revision_id":"1","upstream_id":"43457","short_description":"HellaSwag validation 43457","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to help a teen through depression [title] Notice any dramatic changes in mood or behavior. [step] When going through puberty, teenagers may experience changes in mood. But if you see a noticeable change in your child's behavior, trust your instincts and talk with them about what they're feeling.\",\"endings\":\"['[substeps] Notice if your teen seems unmotivated to take care of themselves. Poor hygiene (not bathing, not changing clothes, being unable to get out of bed) and changes in sleep patterns are often early indicators of depression.', 'Get an idea of what your child is doing now and why. [substeps] For example, they may get angry more easily in the mornings when they wake up.', \\\"If they stop being moody and enter into depression like they did when they were younger, it's a good sign. [substeps] Teens with depression may go into a mood change? No, wait two to three days before going through puberty.\\\", '[substeps] For example, your teenager may suddenly seem jealous or low with the friends they used to hang out with. They may also start getting heated when addressing the awkwardness from a previous meeting of acquaintances.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}