{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f98aae1a-edd8-5600-91e2-3cbbf5348ea3","task_key":"default--validation--22469","task_revision_id":"1","upstream_id":"22469","short_description":"HellaSwag validation 22469","config":"default","split":"validation","body":"{\"activity_label\":\"Youth\",\"ctx\":\"[header] How to do loan modification by yourself [title] Write a successful hardship letter. [step] The first step for getting approved for the loan modification program is hardship letter. A hardship letter is the letter which shows some kind of hardship in it which has cause your income loss and that's why you are unable to pay your monthly mortgage payments.\",\"endings\":\"['Such as divorce, job loss, business loss, medical illness, death or anything else. [title] Write down a brief 3-4 page of hardship letter showing that which kind of hardship you are actually suffering from which has led your income loss.', 'As with the letter you should include supporting information so that your hardship letter is very effective. [substeps] The program will require that you submit a complaint letter.', 'You can include anything at all that is of value to you as a hardship letter. You can include only the things which you are proud of and that you know support you most.', 'You should include the following information : [substeps] Find out the requirements for the hardship letter for the program where you were raised or what you must prove to get approved for the loan modification program. You should specify where the hardship letter must come from.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}