{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"95424ba4-defa-536c-8c53-46150358038e","task_key":"default--validation--13971","task_revision_id":"1","upstream_id":"13971","short_description":"HellaSwag validation 13971","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to help children learn [title] Create a loving and peaceful environment. [step] Children need to feel our love at all times. Our love gives them confidence that they are heard, that they are present, and that they matter.\",\"endings\":\"['[substeps] A bright light that is comforting is best placed as a source of peace. While it is tempting to literally put it on the windowsill, that same light can also be placed wherever you would like.', 'Children need to feel this love every day, whether they are in the presence of a friend or relative. [substeps] One simple way to foster this kind of love in your child is to create as few dividers as possible.', 'Spend time interacting with children, making sure they are doing their best and nurturing our love as they are. [substeps] You may be tempted to try to give your child positive attention when you play with them, but this could get them upset, so try not to do that.', \\\"A warm, loving, and gentle environment is absorbed unconsciously and it gives children a wonderful start to life. [substeps] Make sure that your child feels at' home' within your home.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}