{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5f25e39e-cfa3-5b36-9c0c-c88fed908f70","task_key":"default--validation--4553","task_revision_id":"1","upstream_id":"4553","short_description":"HellaSwag validation 4553","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to bathe several small kids at once [title] Fill the bath with sufficient water for the amount of kids being added at the same time. [step] Remember that the more kids added, the more water will be displaced by their weight. To avoid spills over the top, aim for less water than you'd use for one kid.\",\"endings\":\"['Using a pool cleaner and a few drops of baby detergent might be handy. [substeps] For baby soap, use mineral spirits to clean out the water.', '[substeps] Add some bubble bath or even bath bombs for bathing enjoyment. A bathmat suitable for lining the bath will help to prevent slips.', 'Add one ice bath or two warm baths before adding the kids. This will help clean the inadequate water, since the kids will have to stay in the tub all day.', 'For instance, use one cup of warm water for a baby, one cup of warm water for a child under 2, and one cup of hot water for a smaller child. ( try adding more water if necessary to ensure that each child is taking their time.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}