{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4c54dafb-96c5-510d-93b1-0f336bebe20c","task_key":"default--validation--8539","task_revision_id":"1","upstream_id":"8539","short_description":"HellaSwag validation 8539","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to get your children up in the morning [title] Open the curtains to let the sunshine in. [step] Light, particularly natural light, stimulates our brains to release serotonin, which helps us to wake up and feel alert. It is a crucial step in the process of waking up, and it will help your child to overcome the early-morning drowsiness that they are feeling.\",\"endings\":\"['[substeps] Never go to sleep late at night unless you are absolutely sure that the window is open enough. If you let in natural light, it can disrupt the natural circadian rhythm of your sleep cycle.', 'Open the shades to expose more light to let the light come in. [substeps] You can also turn on natural bright lamps to do this.', \\\"[substeps] Open the blinds or curtains in your child's room about 15 minutes before you want them to get out of bed. The sunshine will help them to wake up naturally.\\\", \\\"[substeps] As you're opening the curtains to let light in, you should pause halfway across your bedroom and focus on your window. This gives your child an opportunity to engage their senses in the room.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}