{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"35a1ec6a-bd42-5227-aef9-192abee39ee2","task_key":"default--validation--38365","task_revision_id":"1","upstream_id":"38365","short_description":"HellaSwag validation 38365","config":"default","split":"validation","body":"{\"activity_label\":\"Pets and Animals\",\"ctx\":\"[header] How to control shedding (dogs ) [title] Brush your dog every day. [step] Remove your dog's excess hair in a controlled way by brushing it regularly, at least once a day. These brushing sessions should not last long, only a few minutes, but should become part of your regular routine.\",\"endings\":\"[\\\"You can use a rake-style brush to reduce a thick undercoat, or even a brush-glove to mimic the action of petting and reduce your dog's anxiety. [substeps] Many people prefer to brush their dog outdoors to reduce fur scattering in the home.\\\", '[substeps] If you do not know what a regular brushing is, ask your vet to show you some examples. [title] Feed your dog on a regular basis.', \\\"[substeps] Brushing your dog once per day also helps to remove hair and bulk it up so it can shed faster. Choose the right brush style for your dog's body type and overall movement.\\\", 'Brush her entire body from her head to her tail. Concentrate on making your brush as smooth and soft as possible for this, rather than using plastic brushes.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}