{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"13fd113e-67cd-5a33-ba5d-8fbf4fd226da","task_key":"default--validation--42476","task_revision_id":"1","upstream_id":"42476","short_description":"HellaSwag validation 42476","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to get small children out of the house in the morning [title] Get up earlier than you think you need to. [step] Things with children almost always take longer than you plan; a little extra time goes a long way to making your morning more enjoyable. [title] Get yourself ready before you wake the kids up, if possible.\",\"endings\":\"['[step] Once young children are awake, they need attention right away; giving them that attention will be stressful if you still have a lot to do for yourself. [substeps] Enjoy a cup of coffee, take a shower, and spend a few minutes on yourself.', \\\"[step] If you have any kids with you, get him/her up about half an hour earlier. He/she will be more motivated to get out of bed when he/she hasn't just stayed asleep for an hour.\\\", '[step] This includes changing your underwear, folding their clothes or tying their shoes. Have the little ones give praise to you when you do it right before you get out of bed.', \\\"[step] This may seem easier said than done, but the whole point is to prevent them from waking up too early, in case you're out of bed too early. Don't forget (and help them in showering, brushing their teeth, etc.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}