{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"61bb883d-2886-5b60-99c7-7756e6978196","task_key":"default--validation--1237","task_revision_id":"1","upstream_id":"1237","short_description":"HellaSwag validation 1237","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to be a happier mom [title] Talk to your kids more. [step] Try to put yourself in your children's shoes. If you can understand what they are thinking, what they might be going through, you can be a mother that values her child's opinion, and respects them.\",\"endings\":\"[\\\"Take advantage of your sweet, loving heart as a mother by having conversations with your children about their feelings. Research shows that you're not only happier when you laugh.\\\", \\\"Not only are you likely to see them in a positive light, but you might also find that you find yourself taking some time to consider all your children's emotions. Start out with little ones, but expose your kids to the bigger things in life in general.\\\", \\\"Getting parental support can be a wonderful thing you can do for them, and could lead to them becoming a happier parent. [substeps] If you're parents aren't able to buy a crib, for example, ask them for input and recommendations.\\\", 'This is how you earn respect back, in turn. [substeps] As your kids get older, you may find that they talk less and less, or let you in just a little less than they used to.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}