{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"80163229-4a0f-5180-8562-3f71068811e5","task_key":"default--validation--5153","task_revision_id":"1","upstream_id":"5153","short_description":"HellaSwag validation 5153","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to get your kids to eat food that they don't like [title] Consider children's tastes. [step] When you're cooking, don't necessarily make meals geared towards your kids. However, consider their tastes in addition to yours when planning and cooking meals.\",\"endings\":\"[\\\"[substeps] Make a couple of offerings you know your kids will like if you're trying a new recipe. For example, if you're making meatloaf for the first time, consider having sides you know your kids will eat such as potatoes, pasta, or cut veggies.\\\", 'You may want to try different foods so there is no competition. And, try to aim for something your kids love.', \\\"[substeps] If you're making grilled beef, pumpkin pie, and salami sandwiches, it is fine for the meals to be grilled and then eaten with your kids as the main main course. However, if you're making chicken, turkey, or beef sandwich recipes, the best choices are grilled or grilled chicken.\\\", '[substeps] For example, when you make meals intended for young people, you might include different elements like vegetables and fruit. While you could also include vegetables while you cook, focusing on veggies is definitely a good idea.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}