{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1ee2b017-5c3b-53da-8144-370a82235648","task_key":"default--validation--17328","task_revision_id":"1","upstream_id":"17328","short_description":"HellaSwag validation 17328","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to grieve a parent's unexpected death [title] Take the time you need : [step] At first, you may feel like you are numb, or in shock. Allow yourself the time to just feel sad, or angry, or whatever feelings come. And those feelings are likely to come in waves, slowly.\",\"endings\":\"[\\\"Because grieving is painful, you'll need to allow yourself to process those feelings for a while as well as you allow your body to heal. [substeps] Studies have found that babies who are currently breastfed have an increased risk of developing heart disease, stroke, hypertension, and cancer.\\\", 'Let yourself feel them as a natural part of the grieving process. [substeps] Though it may not be much of a choice, recognize that you are not alone.', \\\"The process of letting go may feel uneven: you'll feel as if you are healing, but then something will trigger more sadness. Give yourself plenty of time for this slow process.\\\", 'Just give yourself a few days to let them set in. [title] A big part of grieving an unexpected death is being open to other people and new experiences.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}