{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"zebralogicbench","formal_name":"ZebraLogicBench","introduction":"ZebraLogicBench evaluates reasoning on logic puzzles that require satisfying clues to determine attribute assignments. The official card lists 1,000 grid-mode puzzles and a separate multiple-choice setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2b8a94ee-20ae-5ba9-a9c9-22b986e72d40","task_key":"grid~5fmode--test--lgp~2dtest~2d6x5~2d11","task_revision_id":"1","upstream_id":"lgp-test-6x5-11","short_description":"There are 6 houses, numbered 1 to 6 from left to right, as seen from across the…","config":"grid_mode","split":"test","body":"{\"puzzle\":\"There are 6 houses, numbered 1 to 6 from left to right, as seen from across the street. Each house is occupied by a different person. Each house has a unique attribute for each of the following characteristics:\\n - Each person has a unique name: `Arnold`, `Bob`, `Eric`, `Carol`, `Alice`, `Peter`\\n - Each person has a unique level of education: `doctorate`, `trade school`, `associate`, `high school`, `bachelor`, `master`\\n - People own unique car models: `chevrolet silverado`, `ford f150`, `honda civic`, `tesla model 3`, `bmw 3 series`, `toyota camry`\\n - Each person has a unique favorite drink: `tea`, `water`, `boba tea`, `coffee`, `root beer`, `milk`\\n - They all have a unique favorite flower: `carnations`, `iris`, `lilies`, `tulips`, `daffodils`, `roses`\\n\\n## Clues:\\n1. Eric is the one who only drinks water.\\n2. The person with an associate's degree is the person who owns a Toyota Camry.\\n3. The boba tea drinker is in the fourth house.\\n4. The person who loves the vase of tulips is directly left of the person who owns a Tesla Model 3.\\n5. The person with a master's degree is somewhere to the left of the person who owns a BMW 3 Series.\\n6. The person who owns a Toyota Camry is directly left of the person who loves a bouquet of daffodils.\\n7. The person who loves the boquet of iris is somewhere to the left of the root beer lover.\\n8. The person who likes milk is somewhere to the right of the person who owns a Honda Civic.\\n9. Carol is the person who owns a Honda Civic.\\n10. The person with a high school diploma is in the second house.\\n11. The person with a master's degree is the boba tea drinker.\\n12. The person who owns a Tesla Model 3 is Arnold.\\n13. The person who loves the boquet of lilies is the person who owns a Tesla Model 3.\\n14. The person who loves a carnations arrangement is somewhere to the left of Alice.\\n15. The person with a bachelor's degree is somewhere to the right of the person who likes milk.\\n16. The one who only drinks water is the person who owns a Ford F-150.\\n17. Carol is somewhere to the left of the person with a doctorate.\\n18. There are two houses between the person who owns a Toyota Camry and the person who loves the vase of tulips.\\n19. The person who owns a Tesla Model 3 is somewhere to the left of the coffee drinker.\\n20. Bob is in the third house.\\n\",\"size\":\"6*5\"}","display_format":"text","language":"","answer_status":"unavailable","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}