{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2341afe9-f9e9-5dff-afe7-eebab121a623","task_key":"default--validation--28455","task_revision_id":"1","upstream_id":"28455","short_description":"HellaSwag validation 28455","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to get cash back on a credit card [title] Compare credit card offers. [step] There are many different credit card companies offering cash-back rewards cards. The best way to start when researching these offers is by searching online.\",\"endings\":\"['Keyword phrases like \\\" cash-back rewards cards by city, state, zip code, \\\" are great resources for finding companies. [substeps] For example, you can research america on his or her website.', 'Call your local credit card company to discuss credit card rates and fees with them. Most companies offer cash back rewards cards for two reasons: first, they offer incentives and secondly, they only charge a percentage of the total amount the person deposits.', 'There you\\\\'ll get a comprehensive listing of every company offering cash-back credit cards, and you\\\\'ll be able to read the specific terms and conditions of each card. [substeps] Search online for \\\" cash back credit card \\\" or \\\" best cash back credit card offers \\\" to see a comprehensive listing.', '[substeps] You can find a list of card companies on zillow.com, which will take you through options such as \\\" applicable cash back \\\" and \\\" add-ons. \\\" many credit card companies feature an \\\" outbound cash \\\" feature.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}