{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"eb07c6c3-8070-50e0-b7f2-4cb8a2e069dc","task_key":"default--validation--10624","task_revision_id":"1","upstream_id":"10624","short_description":"HellaSwag validation 10624","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to get kids to help pack their lunches [title] Let your kids pick out lunchboxes or bags. [step] Your children will be more excited to bring their lunch to school if they have a lunchbox or lunch bag that has a design they like on it. For example, your children might choose one with a favorite cartoon character.\",\"endings\":\"['Tell your kids to purchase lunchboxes or bags that show off the featured characters on the package. For example, you might have a pineapple theme, with the colors pink, blue, and orange, or the acorns orange.', \\\"[substeps] Encourage your children's lunchboxes and bags to have different compartments in them (such as the finger-caps in cereal boxes). Consider diaper bags for your children to place their lunches in once they go to school.\\\", '[substeps] You should also consider buying lunch boxes with built in dividers. Many children do not like their food mixed up, and these lunchbox compartments will also make packing lunch easier for your kids.', 'Or they might decide to write a unique \\\" superhero \\\" on it. [substeps] Have your kids research lunchboxes before making a purchase.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}