{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b4701bb3-6499-57e5-8784-2595da769001","task_key":"default--validation--4527","task_revision_id":"1","upstream_id":"4527","short_description":"HellaSwag validation 4527","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to accept change [title] Embrace your feelings about change. [step] Whatever type of change is unsettling you, embrace that feeling. There's no way you'll get past it, if you ignore it and don't work through it.\",\"endings\":\"[\\\"Keeping your true emotions in the forefront of your mind helps more than anything. [substeps] Tell yourself that you're ready and willing to change.\\\", 'However, you can recognize the emotions that come with change. [title] Try to empathize with your condition.', \\\"Accepting change simply means accepting that you are not guaranteed a hard and fast end, neither were you. They may not be made for you, but it helps to work through them so you don't end up wallowing in them or feeling unresolved.\\\", 'If you embrace your feelings, it will be a lot easier to grow and move on. [substeps] Express your feelings to others, but do so in a polite way.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}