{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a1d8e825-be9b-5162-8b03-9d9c65bee808","task_key":"default--validation--41772--variant-80a0ccf17bcd","task_revision_id":"1","upstream_id":"41772--variant-80a0ccf17bcd","short_description":"HellaSwag validation 41772","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to buy a dvd system with dual monitors for a car or minivan [title] Determine where you want to install your monitors. [step] Depending on your space, you have a few options. You can mount the monitors in the front seat headrests, have them mounted into a recess in the back of the front seats, or hang them from the ceiling.\",\"endings\":\"['There are a few basic things to consider : [substeps] Proper placement. You should sit in the front row and your monitor in the rear row if you plan to put your monitor in the center row.', \\\"[substeps] For dual monitors, your seats don't have to be in their original position but must be situated this way. When installing the dual monitors for other vehicles, your height on each side of the vehicle must match.\\\", '[title] Decide which features you would like your dvd system to have. [step] You have several to choose from and they will all affect your cost and the amount of space you will need for installation.', 'However, avoid plugging into the other equipment, which cannot be mounted safely into the overhead stock unless you actually need it. [substeps] Many programs, such as vhs and vga tvs, come with two or three distinctive drives.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}