{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"64a48680-9581-589e-a0ff-d82fbd3a4103","task_key":"default--validation--36004","task_revision_id":"1","upstream_id":"36004","short_description":"HellaSwag validation 36004","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to deal with death [title] Give yourself time to grieve. [step] The finality of the death may take a while to sink in, even if you were expecting the person to die. There is no \\\" normal \\\" timetable for grief; it is a personal journey.\",\"endings\":\"[\\\"Let the emotions flow through you, and don't hold them in. [substeps] Many people feel that they shouldn't cry, get angry, or show any sort of emotion when someone dies.\\\", \\\"You have the choice whether or not to allow yourself this precious moment to pass without pain. Here are some general tips for easing your grief : [substeps] Don't go on with your life.\\\", 'A mourning person will have to be coping with loss and grieving in a peaceful and final way. Give yourself a few days to grieve, and use this time to begin a new activity and learn new techniques.', 'The grieving process feels like a complex process through which you fill the empty spaces within your heart. Allow yourself some time to let your imagination run wild.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}