{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"zebralogicbench","formal_name":"ZebraLogicBench","introduction":"ZebraLogicBench evaluates reasoning on logic puzzles that require satisfying clues to determine attribute assignments. The official card lists 1,000 grid-mode puzzles and a separate multiple-choice setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0b7f5961-c811-5c53-b8aa-55f6a2819119","task_key":"grid~5fmode--test--lgp~2dtest~2d6x4~2d21","task_revision_id":"1","upstream_id":"lgp-test-6x4-21","short_description":"There are 6 houses, numbered 1 to 6 from left to right, as seen from across the…","config":"grid_mode","split":"test","body":"{\"puzzle\":\"There are 6 houses, numbered 1 to 6 from left to right, as seen from across the street. Each house is occupied by a different person. Each house has a unique attribute for each of the following characteristics:\\n - Each person has a unique name: `Carol`, `Peter`, `Alice`, `Eric`, `Arnold`, `Bob`\\n - Each person lives in a unique style of house: `ranch`, `colonial`, `victorian`, `mediterranean`, `craftsman`, `modern`\\n - People own unique car models: `tesla model 3`, `toyota camry`, `ford f150`, `chevrolet silverado`, `bmw 3 series`, `honda civic`\\n - The mothers' names in different houses are unique: `Janelle`, `Aniya`, `Kailyn`, `Penny`, `Sarah`, `Holly`\\n\\n## Clues:\\n1. The person whose mother's name is Penny is directly left of The person whose mother's name is Aniya.\\n2. Peter is in the sixth house.\\n3. The person who owns a Chevrolet Silverado is The person whose mother's name is Penny.\\n4. The person whose mother's name is Sarah is not in the fifth house.\\n5. There is one house between the person who owns a Honda Civic and the person who owns a Toyota Camry.\\n6. The person in a Craftsman-style house is somewhere to the right of the person in a ranch-style home.\\n7. Eric is somewhere to the left of The person whose mother's name is Sarah.\\n8. The person residing in a Victorian house is Carol.\\n9. The person who owns a Ford F-150 is the person in a Mediterranean-style villa.\\n10. The person whose mother's name is Kailyn is somewhere to the left of the person who owns a Ford F-150.\\n11. Bob is The person whose mother's name is Janelle.\\n12. The person who owns a BMW 3 Series is somewhere to the left of Eric.\\n13. The person whose mother's name is Holly is the person in a modern-style house.\\n14. The person who owns a Tesla Model 3 is not in the second house.\\n15. The person who owns a Toyota Camry is somewhere to the right of Eric.\\n16. The person who owns a Honda Civic is in the fourth house.\\n17. The person in a Craftsman-style house is the person who owns a Chevrolet Silverado.\\n18. Arnold is the person who owns a Ford F-150.\\n\",\"size\":\"6*4\"}","display_format":"text","language":"","answer_status":"unavailable","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}