{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"163e07bc-eec3-5206-b87c-74cde3b0ed44","task_key":"default--validation--39814","task_revision_id":"1","upstream_id":"39814","short_description":"HellaSwag validation 39814","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to prepare for a settlement conference [title] Decide what you want. [step] Settlement is voluntary, which means no one can force you to accept a settlement you disagree with. However, before going to the conference, you need to know your goals.\",\"endings\":\"['You want to know them at an appropriate time and place. [substeps] You can find settlement conferences in the following ways: look for settlement conferences that do not include the word \\\" settlement \\\" in the list of conference participants-the usual \\\" settlement \\\" or \\\" offer \\\" word from the list of attendees.', \\\"These will depend on the type of case. [substeps] In a divorce dispute, for example, you'll need to determine child custody, visitation, child support, and spousal maintenance (alimony).\\\", 'If you disagree with the other side, then your agreement could lead to bad treatment. [substeps] You should take into account how much legal costs you are entitled to receive for your settlement.', 'Before going to the conference, talk to your doctor and other healthcare providers about what you want to do, and what their rationale is. [substeps] Often, settlement conferences are for families or people willing to pay for health care.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}