{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"zebralogicbench","formal_name":"ZebraLogicBench","introduction":"ZebraLogicBench evaluates reasoning on logic puzzles that require satisfying clues to determine attribute assignments. The official card lists 1,000 grid-mode puzzles and a separate multiple-choice setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"53ab6fd0-ee66-5281-be5b-5215a49945c1","task_key":"grid~5fmode--test--lgp~2dtest~2d4x6~2d2","task_revision_id":"1","upstream_id":"lgp-test-4x6-2","short_description":"There are 4 houses, numbered 1 to 4 from left to right, as seen from across the…","config":"grid_mode","split":"test","body":"{\"puzzle\":\"There are 4 houses, numbered 1 to 4 from left to right, as seen from across the street. Each house is occupied by a different person. Each house has a unique attribute for each of the following characteristics:\\n - Each person has a unique name: `Peter`, `Alice`, `Arnold`, `Eric`\\n - People own unique car models: `toyota camry`, `tesla model 3`, `honda civic`, `ford f150`\\n - People have unique heights: `average`, `very short`, `short`, `tall`\\n - The mothers' names in different houses are unique: `Aniya`, `Kailyn`, `Holly`, `Janelle`\\n - Each person has a unique level of education: `bachelor`, `high school`, `master`, `associate`\\n - The people keep unique animals: `cat`, `fish`, `horse`, `bird`\\n\\n## Clues:\\n1. The bird keeper is The person whose mother's name is Kailyn.\\n2. The person who owns a Ford F-150 is the person who is tall.\\n3. The person whose mother's name is Kailyn is not in the third house.\\n4. The person with a master's degree is the fish enthusiast.\\n5. The person who is very short is somewhere to the left of the cat lover.\\n6. The fish enthusiast is the person who is short.\\n7. The person whose mother's name is Janelle is directly left of the person who owns a Toyota Camry.\\n8. The person whose mother's name is Kailyn is not in the first house.\\n9. The person who is short is somewhere to the right of Alice.\\n10. The person with a high school diploma is the person who has an average height.\\n11. There is one house between the person who is very short and The person whose mother's name is Holly.\\n12. The person with a master's degree is somewhere to the right of the person with a bachelor's degree.\\n13. The person with a master's degree and Peter are next to each other.\\n14. The person who owns a Tesla Model 3 is Eric.\\n15. The person who has an average height is somewhere to the right of Arnold.\\n16. The person who keeps horses is directly left of the person with a master's degree.\\n\",\"size\":\"4*6\"}","display_format":"text","language":"","answer_status":"unavailable","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}