{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e2f5f308-2ef8-5d5d-ab38-3c4c8d180b15","task_key":"default--validation--46481","task_revision_id":"1","upstream_id":"46481","short_description":"HellaSwag validation 46481","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to use a credit card system [title] Open a merchant account. [step] A merchant account is a bank account, but it is different from a business checking account. A merchant account communicates with your customers' credit card issuers.\",\"endings\":\"[\\\"You fill out credits and other credit forms into your merchant account. You can do any transactions you'd like on a merchant account.\\\", \\\"It takes the customer's credit card information and verifies and approves the sale. Your merchant account communicates with the card issuer to authenticate the user, confirming that the card is not stolen and that the customer has enough of a balance to pay for the sale.\\\", \\\"Credit cards handle the transactions linked to your account. [title] Determine your business's credit score.\\\", 'Credit card companies offer a variety of services : [substeps] Subscription. Credit card issuers charge a fee for a card and fill out forms to use.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}