{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b826e00b-eb01-52c3-b92c-a262ffa64da9","task_key":"default--validation--31078","task_revision_id":"1","upstream_id":"31078","short_description":"HellaSwag validation 31078","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to keep your three year old busy on a wintry day [title] Make a list of all the things your child likes to do. [step] Example : [substeps] Coloring crafts play-dough toys food etc. [title] Pick up one activity at a time for short span of 15-20 minutes as a child loses interest very soon if the activity stretches for long time.\",\"endings\":\"['[step] Example : [substeps] Help in the daily chores. It could be dusting, tidying up, making the bed.', '[step] Time can be divided up into phases, hard work and delayed activity at first. [title] Choose activities that interest the individual, just as you always have several reasons to stop at something as mentioned above.', \\\"[title] Pick up more if you notice your child stops. [step] This can be a sign that they're losing interest in the activity or they simply aren't wanting to catch up.\\\", '[title] Assign chores at that time each week. [title] Spend a total of three or four hours each day giving your child a different activity to do for an hour each day like coloring or making popsicles and paper bags.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}