{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"217b7555-03fc-550f-95e9-547284e019a7","task_key":"default--validation--35194","task_revision_id":"1","upstream_id":"35194","short_description":"HellaSwag validation 35194","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to entertain kids at your wedding [title] Designate a table for kids at the wedding. [step] If you are planning on having more than one or two kids at your wedding, create a table just for kids. This is an ideal option if the kids are all over the age of 5, as they can usually be on their own around other children without too much adult supervision.\",\"endings\":\"['When the table is full and the guests are ready to leave, designate a table for each child. This will make it easier for the guests to make changes to the table once the children arrive.', \\\"This would be ideal if they are all over the age of 7. [title] Design your table according to your guest's preferences.\\\", 'Consider adding around two chairs, if you plan on having more than one, to fit a group of kids. [title] Choose food and drinks, if applicable.', 'Consider if the kids you are inviting to the wedding will be okay on their own without their parents at the same table. If so, a kids table may be the best option for keeping the kids in one place.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}