{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4000a472-6ed6-58c6-be52-70dce1d55968","task_key":"default--validation--43320","task_revision_id":"1","upstream_id":"43320","short_description":"HellaSwag validation 43320","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to use bubble wrap [title] Use bubble wrap to protect delicate items, like glass or electronics. [step] Bubble wrap is ideal for padding glassware, ceramics, mirrors, and other fragile items while moving. Because bubble wrap comes in large sheets, it can be more effective for wrapping bigger items than styrofoam or newspaper.\",\"endings\":\"[\\\"[substeps] If it's not light enough for your bubble wrap, you can twist or simply press the ends of the bubble wrap together. [title] Place an ice pack on the spill.\\\", '[title] Wrap all delicate items before putting them in the box. [step] Place your item on a sheet of bubble wrap and cut out a piece long enough to cover the item in bubble wrap.', 'It also helps protect your items from dangerous particles. [substeps] Bubble wrap does not contain the same polymers that foam bath sheets, or these can solidify and shrink in water before use.', \\\"[substeps] Read a section on making bubble wrap from a variety of perspectives, so you have a comprehensive understanding of exactly what you're making. [title] Pack your bubble wrap in a cooler.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}