{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f78db3f4-d706-5092-b003-65cad0977411","task_key":"default--validation--29621","task_revision_id":"1","upstream_id":"29621","short_description":"HellaSwag validation 29621","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to get your kids to eat food that they don't like [title] Consider children's tastes. [step] When you're cooking, don't necessarily make meals geared towards your kids. However, consider their tastes in addition to yours when planning and cooking meals.\",\"endings\":\"[\\\"[substeps] For example, if your whole family lives in one big house, consider your children's palate, tastes, and preferences. Ask them and figure out what they like and dislike about serving food they don't like.\\\", '[substeps] Giving your kids a choice of meal setting and keeping your meals organized and prepared is the best way to ensure they have a variety of options. Try allowing your kids to try some foods that they are not familiar with.', \\\"[substeps] Don't be afraid to have your own tastes in food as well. Having a taste for something may help your kids connect with these tastes and help them pick out foods based on them.\\\", \\\"[substeps] Make a couple of offerings you know your kids will like if you're trying a new recipe. For example, if you're making meatloaf for the first time, consider having sides you know your kids will eat such as potatoes, pasta, or cut veggies.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}