{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c261ab24-4c9c-5e3c-9ab2-e1666d4de674","task_key":"default--validation--33407","task_revision_id":"1","upstream_id":"33407","short_description":"HellaSwag validation 33407","config":"default","split":"validation","body":"{\"activity_label\":\"Home and Garden\",\"ctx\":\"[header] How to cope with the stress of moving [title] Get rid of excess clutter. [step] When you're moving is a great time to get rid of old things you don't need anymore. It can be a big stress relief and make moving easier, since you'll have less to move.\",\"endings\":\"['Putting non-clutter in a storage area helps you move much faster than putting items in a box. [substeps] Like the boxes, smaller boxes will reduce clutter and you can try to just line them up together.', 'Try getting rid of your clutter as much as possible and go through old clothing and makeup items. [substeps] You can also try moving your items into different locations for more in-depth storage.', \\\"[substeps] When you're going through your things, put them into four piles: sell, donate, toss, and keep. You can try to sell some items online, while donating less valuable items to thrift stores.\\\", \\\"Make a list of everything you don't need, and put it where it isn't in sight. When it doesn't matter which stuff, put it where you don't need it most.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}