{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"719dc0fa-d048-5e74-852d-d79d4228ad32","task_key":"default--validation--28761","task_revision_id":"1","upstream_id":"28761","short_description":"HellaSwag validation 28761","config":"default","split":"validation","body":"{\"activity_label\":\"Youth\",\"ctx\":\"[header] How to deal with a moody friend [title] Stay calm. [step] When someone is moody, it doesn't help them if their friends are also tense or upset. It is unlikely that your friend's moodiness is the result of something you did, so don't take it personally.\",\"endings\":\"['[substeps] Take a deep breath and try to remember that your friend is upset. Though you may talk with them and find out what caused the moodiness, the outcome is likely less dramatic.', 'Just remember that you are here for a reason. They have probably had a bad day too, after all.', \\\"Stay calm and let the other person open up to you about what's bothering them. [substeps] Giving your friend space will help them to see that these are not just their problems, they are yours.\\\", '[substeps] If you feel yourself getting upset or tense, use some calming techniques before talking to your friend. Taking slow, deep breaths is a well-known way to reach a calm place.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}