{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"zebralogicbench","formal_name":"ZebraLogicBench","introduction":"ZebraLogicBench evaluates reasoning on logic puzzles that require satisfying clues to determine attribute assignments. The official card lists 1,000 grid-mode puzzles and a separate multiple-choice setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"04f189e1-7b4a-5c29-b749-5e9ddbc6cb61","task_key":"grid~5fmode--test--lgp~2dtest~2d5x5~2d16","task_revision_id":"1","upstream_id":"lgp-test-5x5-16","short_description":"There are 5 houses, numbered 1 to 5 from left to right, as seen from across the…","config":"grid_mode","split":"test","body":"{\"puzzle\":\"There are 5 houses, numbered 1 to 5 from left to right, as seen from across the street. Each house is occupied by a different person. Each house has a unique attribute for each of the following characteristics:\\n - Each person has a unique name: `Bob`, `Arnold`, `Alice`, `Peter`, `Eric`\\n - People own unique car models: `toyota camry`, `bmw 3 series`, `ford f150`, `honda civic`, `tesla model 3`\\n - Each person has a unique favorite drink: `tea`, `milk`, `water`, `root beer`, `coffee`\\n - The people are of nationalities: `dane`, `brit`, `german`, `norwegian`, `swede`\\n - People use unique phone models: `oneplus 9`, `iphone 13`, `google pixel 6`, `samsung galaxy s21`, `huawei p50`\\n\\n## Clues:\\n1. The person who uses a Google Pixel 6 is somewhere to the right of the Dane.\\n2. The person who uses a Google Pixel 6 is somewhere to the right of the root beer lover.\\n3. The person who owns a Tesla Model 3 is the British person.\\n4. The person who owns a Ford F-150 is the Dane.\\n5. Eric is the tea drinker.\\n6. The British person is directly left of the person who owns a Honda Civic.\\n7. Peter is somewhere to the right of the person who likes milk.\\n8. Bob is directly left of the Swedish person.\\n9. The person who uses an iPhone 13 is somewhere to the right of the person who uses a Huawei P50.\\n10. Arnold is the person who uses a Google Pixel 6.\\n11. Eric is not in the third house.\\n12. The person who owns a BMW 3 Series is somewhere to the right of the person who uses a Samsung Galaxy S21.\\n13. The person who owns a Tesla Model 3 is not in the first house.\\n14. Alice is somewhere to the left of the person who owns a Ford F-150.\\n15. The person who uses a OnePlus 9 is somewhere to the right of the person who uses a Samsung Galaxy S21.\\n16. The German is somewhere to the right of the person who owns a Tesla Model 3.\\n17. Eric is not in the fourth house.\\n18. Peter is directly left of the person who uses a Samsung Galaxy S21.\\n19. The coffee drinker is Bob.\\n\",\"size\":\"5*5\"}","display_format":"text","language":"","answer_status":"unavailable","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}