{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"65e9fbcf-3d42-5dad-bc22-73b96a44eac0","task_key":"default--validation--3419","task_revision_id":"1","upstream_id":"3419","short_description":"HellaSwag validation 3419","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to keep kids interested in caring for their new dog [title] Share \\\" fun \\\" responsibilities. [step] Depending on the age of your children, you should encourage them to help with chores that they may consider fun, like walking or exercising the dog. These activities teach your children responsibility while allowing them to engage in the more positive aspects of pet ownership.\",\"endings\":\"['Instead of taking household duties out of the equation, encourage your children to be able to do similar things that their older siblings lack the skills to. [substeps] Ask your children if they would like to provide other household chores that they may enjoy.', '[substeps] Talk about the benefits and opportunities that dog ownership is bringing to your kids. Understand that the benefits are abstract, like their interest in ownership.', 'If your children only do the boring chores and fail to enjoy to fun things about having a dog, they will not be interested in the pet for very long. [substeps] Besides walking or playing with the dog, fun activities can include washing the dog or brushing its hair.', 'You will also need to encourage older siblings or children to help you with these duties. [substeps] For example, if you have young children, consider asking your children to help with chores the younger they get.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}