{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"02d54fd4-1bb3-50eb-a302-1759646ff995","task_key":"default--validation--48502","task_revision_id":"1","upstream_id":"48502","short_description":"HellaSwag validation 48502","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to pack your fragile items [title] Communicate with the moving company or whoever will be handling your items. [step] Aside from putting the labels on the boxes, you should inform the movers about the boxes that contain fragile items. It will serve as a heads up for them to handle it with extra care.\",\"endings\":\"['[substeps] If the moving company or whoever is handling your items offers assistance, ask what it is they would ask of you. For example, you might say, \\\" would you mind moving our boxes to a different section of my home? \\\" [title] Remember to pack your clothing and protective equipment as well.', '[title] Choose packaging materials that can keep fragile items safe from bumps, shocks or variations of any kind. [step] Use paper or bubble wrap to wrap your fragile items to provide cushioning.', 'Contact movers and discuss what in particular needs to be included in your shipment. It is always smart to let these movers know a little about the contents of your container.', '[title] Arrive with your items before your moving date. [step] If your moving company assigned you an advance deadline, you will receive packages when the time is right.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}