{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"785635fd-b0bd-5e22-910d-7525ba04d345","task_key":"default--validation--11096","task_revision_id":"1","upstream_id":"11096","short_description":"HellaSwag validation 11096","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to keep your old phone number [title] Contact your service provider. [step] Telephone companies allow transfer of telephone lines from one place to another. What's going to happen is that they'll just transfer your existing line to the area where you're moving to instead of creating a new telephone line.\",\"endings\":\"['You\\\\'ll have to talk with your provider about where to find your line, and do this by logging into the websites of any other service providers. [substeps] Click on the \\\" new line \\\" link.', \\\"This means you're not transferring an existing line altogether. For instance, if your home is in the far west, you might turn your old line into a toll-free number.\\\", 'Making sure you still have your old number makes things easier on yourself. [substeps] Call * 41-785-9141 to inquire at the station where you last spoke.', 'On the other hand, not all landlines can be transferred for these reasons : [substeps] The area you want your landline to be transferred is not covered by your telephone company. The telephone company may not have any existing service for the area where you want your phone to be transferred to.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}