{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"00efac29-2557-55e4-99fa-46c46ec957b7","task_key":"default--validation--49903","task_revision_id":"1","upstream_id":"49903","short_description":"HellaSwag validation 49903","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to get kids to start trying new foods [title] Dress up your food. [step] No, it doesn't mean that you have to put a bonnet on a piece of celery. Try spreading peanut butter on a piece of celery with raisins on top of that.\",\"endings\":\"['Doing that can make your child less wild. The chocolate cake, raw milk, cinnamon curls, and peanut butter can all work.', \\\"Breakfast is best! And dinner is more enjoyable, especially with ingredients like butter. [title] Boys : [step] If you set the table and catch your guest's attention, he'll see that you made a meal for him.\\\", 'Tell the kids that it is \\\" ants on a log. \\\" you could also give them raw veggies instead of cooked.', \\\"You can wear a hat with graphic-shaped objects or costume name your dog! [title] It's best that your children eat some healthy, and not sodas. [step] It's not a big deal, but sometimes kids are loud or even hold over drinks, especially beverages like water.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}