{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fc1e7035-9bae-532f-8548-25f4ec972130","task_key":"default--validation--11241","task_revision_id":"1","upstream_id":"11241","short_description":"HellaSwag validation 11241","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to handle emotionally needy parents [title] Ask yourself if you always feel like the parent. [step] If your parents' neediness is something new, you need to take their overall health into consideration. New behaviors indicate that something has changed in their lives.\",\"endings\":\"['Ultimately, your parents may want or need extra emotional support because of their. When thinking about this, consider : [substeps] Do they have a medical problem? A recent diagnosis of a potentially life-threatening disease may cause a parent to seem more emotionally needy.', 'People with social anxiety disorder (ptsd) tend to feel guilty. If your parents ask you about how you feel, you may be more easily persuaded to see this behavior as a sign of neglect or some other serious cause.', \\\"If you're the moody, wasteful parent, this can put a damper on their day. [substeps] A missing child is always a big concern for your family.\\\", \\\"For example, your parents are no longer accountable for your homework or chores, and they might be getting bored with you. [substeps] If you haven't done anything that (or you) tends to drive your parents too crazy, take a little bit of time to decide how you feel about the list.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}