{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8b8be479-7c61-542a-af8c-21c6bd3caf96","task_key":"default--validation--25742","task_revision_id":"1","upstream_id":"25742","short_description":"HellaSwag validation 25742","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to adopt a rottweiler [title] Choose an adult rottweiler over a puppy if you have kids. [step] Many people mistakenly believe it is better to adopt a rottweiler puppy if you already have children. The rationale is that the puppy will adjust to the kids and their playfulness better than an adult dog.\",\"endings\":\"['[substeps] Rottweiler puppies and children can be a difficult mix. The puppies have a ton of energy and are constantly nipping and biting at things.', 'However, a very alert, cautious dog may become aggressive if left without an owner. [substeps] Do some background research about your lifestyle before choosing an adult rottweiler.', \\\"While it won't be able to interact with your children, it will greatly increase your chances of success. [substeps] Considering adopting a puppy who is temporarily informally confined to the home it is currently in.\\\", 'Still, you need to choose an adult dog for the best chance at custody. This is because rottweilers are social animals and will be more active if they are around other dogs.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}