{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"80d6a1f3-1d2e-58f8-b608-d828fac47a69","task_key":"default--validation--17055","task_revision_id":"1","upstream_id":"17055","short_description":"HellaSwag validation 17055","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to be patient with an impatient toddler [title] Prepare in advance. [step] Trying to come up with ways to entertain a toddler can be difficult when they're impatient and you aren't prepared for the situation. It'll be much easier to remain calm when dealing with an impatient toddler if you've planned ahead.\",\"endings\":\"['[substeps] Reorganize your schedule by keeping more important things in mind while the toddler is under your care. Change up your schedule so that you have non-nagging things on your mind every minute or two.', \\\"This way you'll already have strategies in mind to use with the toddler and you can address the situation with a positive attitude. [substeps] Try keeping a list of activities to use.\\\", 'Some ideas are : [substeps] Finger painting or coloring. This can usually be done with clothes on.', \\\"Prepare a seat for both them and you at the table so they can be reminded about food if they decide to have a meltdown. [substeps] Make sure your toddler knows you're available if they're hungry.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}