{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9f1d06da-a827-5c8d-91da-c97f7d63fe05","task_key":"default--validation--35853","task_revision_id":"1","upstream_id":"35853","short_description":"HellaSwag validation 35853","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to conduct potty time [title] Start by helping your child pull down their pants, underwear or training pants/diaper, and get on the toilet. [step] Make sure that they are safe and comfortable. Also, make sure that you have all of the \\\" things you'll need \\\" nearby.\",\"endings\":\"['Make a potty spot for your child to pee. Make sure it gets big enough for both parents to comfortably let you know where it is.', 'Make sure that they are within reach of your child and you. [title] Read 1-4 potty books.', 'This is especially important if your child is used to bathrooms. [title] Sit outside of the potty while your child releases his vaginal discharge.', '[title] Your child should know to grab the toothbrush, nail clippers, potty gel, bathroom supplies and toilet paper. [step] Also, make sure that your child knows not to touch your hands.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}