{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7be3b428-fba0-561e-8385-4b573cae9897","task_key":"default--validation--17152","task_revision_id":"1","upstream_id":"17152","short_description":"HellaSwag validation 17152","config":"default","split":"validation","body":"{\"activity_label\":\"Home and Garden\",\"ctx\":\"[header] How to prevent weevils from invading your pantry [title] Learn to identify weevils. [step] The best way to prevent weevils from getting into your home is to avoid buying food that's infested with them. To do this, you have to be able to identify weevils.\",\"endings\":\"['Find a large, open room (such as a spare bedroom) with lots of windows. Wear gloves and identify the weevils by sight.', '[substeps] Both rice and granary weevils have divided bodies made up of a head, thorax, and abdomen. Each species ranges from one-eighth inch (3.2 mm) to three-sixteenth inches (4.8 mm) long.', 'You can do this by finding out who they are and committing to certain food practices. [substeps] In order to find out if a particular food is a weevils problem, you may have to make specific lifestyle changes to identify whether or not your dish is a weevils problem.', \\\"If you don't know how to identify weevils, look through your pantry and see if your pantry has any around your home. [substeps] Look for infested food that has plants, fresh fruits, and dairy.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}