{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c56a7e8e-ae18-5415-98df-0160af8b7df1","task_key":"default--validation--12957","task_revision_id":"1","upstream_id":"12957","short_description":"HellaSwag validation 12957","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to teach your children to do laundry [title] Teach them how to sort dirty laundry. [step] Here's where sortable bins come into play. A set of three or more bins gives children a place to separate whites, darks, jeans, and other articles you don't want to mix.\",\"endings\":\"['This can also be done in the laundry area, but bins simplify the task for younger children. As you teach them to sort, you can begin explaining why you need to separate the clothing.', \\\"Under the bins, you've made a hierarchy and students can have one bin all ours. They take turns taking each section a walk, filling it with laundry and emptying it all together to build up the pile.\\\", \\\"The bins allow kids to go through all their clothes at once without the possibility of wrinkling the clothes into separate piles. Taking the bins out before your children go through their clothes you'll make it easier for all of them to see the items you've bagged up.\\\", \\\"A set of four bins gives your child a way to sort clothes and underwear, although you can use two bins if you want to have multiple bins available. You may want to work with several different bins so that you don't find where ever one bin is going to go.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}