{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ccd0e2ab-7a03-5e85-9f02-109311da7ade","task_key":"default--validation--32544","task_revision_id":"1","upstream_id":"32544","short_description":"HellaSwag validation 32544","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to stop making excuses for toxic parents [title] Take a step back from your parents. [step] Get some space so you can gain perspective on your parent's behavior and your relationship with them. If you're around toxic or abusive behavior all the time, you may get used to it.\",\"endings\":\"['Give yourself a few minutes to breathe before jumping into a more draining conversation. [substeps] Take a moment to sort the information into fresh, concrete terms.', \\\"[substeps] Asking people to keep your distance can help you to find a second perspective. If you don't know what to say, ask questions.\\\", \\\"Taking a break can help you get a clearer-eyed look at what's wrong. [substeps] If you still live with your parents, creating some distance can be tough.\\\", \\\"Try to put yourself in their shoes, and see how you can make a change in yourself. [substeps] Just as many parents try their hand at parenting, they don't always resolve conflicts tactfully and maturely.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}