{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3c034164-e3c3-5f40-9f88-5785916719a3","task_key":"default--validation--3942","task_revision_id":"1","upstream_id":"3942","short_description":"HellaSwag validation 3942","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to help a highly sensitive child [title] Give your child a peaceful and calm place to recharge. [step] Highly sensitive kids need time to settle down and regroup. They also tend to be quite shy, so they usually need some alone time.\",\"endings\":\"['If you can provide alternate, quiet surroundings for them, their sense of calm could last them a lifetime. [title] Avoid putting a toy, such as a big stuffed animal, in another room.', 'They may not be able to wait to be alone after an emotionally occurring event like a road accident. [substeps] A quiet, busy and relaxing place is ideal.', 'Create a space in your home that offers a quiet, safe place where they can relax and feel comfortable. [substeps] Since highly sensitive children like soft surroundings, fill the space with pillows and blankets that are smooth and comforting.', 'Taking them to a peaceful place, such as a park, is highly recommended. [substeps] Keep the area quiet so they will not feel isolated.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}