{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"485bc042-c71c-5184-8eab-3b253f89e57b","task_key":"default--validation--46735","task_revision_id":"1","upstream_id":"46735","short_description":"HellaSwag validation 46735","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to appeal a denial of medicare [title] Read your medicare summary notice. [step] Every three months you should receive a summary of the services and supplies that were billed to medicare during the timeframe. You will also see whether or not medicare agreed to cover payment fully or partially.\",\"endings\":\"['If the medical costs outweigh the claims outlined in your summary, then you have a limited amount of time to try to appeal the denial of medicare. [substeps] You should read the summary notice and read it again.', '[substeps] Look over your medicare summary notice when it arrives and note if there is something medicare has chosen not to reimburse. Each medicare summary notice should inform you of how you can appeal.', 'You should ask your doctor or other contact person to report the total assets covered in the denial. You also will check to see whether one or more of the listed assets are covered.', 'Review your summary whenever you receive a denial. [title] Understand the types of claims you are eligible to win.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}