{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"963714a1-7655-59c8-aa50-16c4735e5880","task_key":"default--validation--9171","task_revision_id":"1","upstream_id":"9171","short_description":"HellaSwag validation 9171","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to disagree with your parents as an adult [title] Accept that you and your parents may have different opinions. [step] When you're interacting with your parents, remember that they may have different ways of thinking about work, money, family, and life. They may also have different political, social, and religious views than you.\",\"endings\":\"[\\\"Focus more on acceptance and tolerance than on arguments. [substeps] You can't control how others act, but you can control how you act.\\\", '[substeps] Recognize that they may have different thoughts about your worldview. Chances are, they may differ in certain aspects.', 'Though these differs from how you see them, remember that they may view certain political issues as discriminatory. [substeps] If your parents have differing political viewpoints and you disagree, accept that.', \\\"You don't have to agree with everything your parents say or do to get along. [substeps] For example, you may disagree with your spouse and agree that she or he's a snob.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}