{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f953dba3-0dd6-5db8-aa05-414422096428","task_key":"default--validation--14919","task_revision_id":"1","upstream_id":"14919","short_description":"HellaSwag validation 14919","config":"default","split":"validation","body":"{\"activity_label\":\"Home and Garden\",\"ctx\":\"[header] How to fix a dryer that will not start [title] Check the cord for signs of damage. [step] Are there any sections of the cord where lose wires have melted the insulation? Is the plug disconnected from the wiring in any way? If so, the problem is likely the cord. [title] Buy a new cord.\",\"endings\":\"['[step] Replacement parts can be ordered online or purchased at some stores. Check the manual or search the model number online for recommendations on compatible cords.', \\\"[step] It should have been stripped from the cable and attached to your defective dryer. Make sure you have purchased the correct plug once you're given the option of replacing it.\\\", '[step] The dryer will require new replacement wiring to start working. Instead of buying the new accessory, save the original cord intact.', '[step] Cord repairs can cost between $75-$120 a month. If the cord has been damaged during repairs, you may have the option of getting a replacement cord at a thrift or online retailer.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}