{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f6e8e2af-343c-58f9-b92d-f8338caac591","task_key":"default--validation--32418--variant-9acf539b98c5","task_revision_id":"1","upstream_id":"32418--variant-9acf539b98c5","short_description":"HellaSwag validation 32418","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to make toilet training fun for your son [title] Dress your 1-2 year old son in a long shirt that covers to his thighs. [step] This way air will circulate to allow him to feel his private parts. It also stimulates him to want to urinate.\",\"endings\":\"['Measure the distance between each area and add one-half to two-thirds of the distance you expected for him before starting to wear the shirt. Let him do this until he feels his need.', 'This is also known as pubic incontinence. [substeps] Put cotton balls and pads on his pubic hair! [title] Get down on the floor on your knees and put some padding on his tummy.', 'He will actually like leaving his underwear at home so how it looks and smells makes it more fun for him. [title] Use toilet training pads instead of old diapers.', \\\"[title] Place a bucket or potty half filled with water on the floor in the bathroom; this way it will be easier to make the transition to the actual toilet. [title] Have an older male sibling, cousin, or friend's son age 4-7 accompany your toddler in the bathroom.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}