{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"62adc744-84c2-556e-9564-08f641b30181","task_key":"default--validation--14327","task_revision_id":"1","upstream_id":"14327","short_description":"HellaSwag validation 14327","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to choose a credit card by rewards [title] Select a rewards card that allows you to get free gas, plane tickets or rental cars if you travel often. [step] These are usually called travel rewards, allowing you to accrue points toward items that are useful in travel. [title] Find a card that offers cash back if you do not travel often.\",\"endings\":\"['[title] Find a card that offers discounted prices and rewards for purchases that are unexpected. [title] Call the credit card company directly to acquire a rewards card.', '[step] Everyone can use more cash, and this type of rewards card gives you a percentage of the amount you charge on it. Consider the card that offers the highest percentage of cash back.', '[step] Most rewards cards offer regular cash back or periodic rewards rather than monthly rewards (like five-hour car rides). Avoid cards like this because they are currently not accepted.', '[step] If possible, get one that offers cash back when you get the option. In addition, credit cards often offer credit cards free of charge.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}