{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"zebralogicbench","formal_name":"ZebraLogicBench","introduction":"ZebraLogicBench evaluates reasoning on logic puzzles that require satisfying clues to determine attribute assignments. The official card lists 1,000 grid-mode puzzles and a separate multiple-choice setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1a5634d7-9995-5fd9-b5e0-2c3cb41989cf","task_key":"grid~5fmode--test--lgp~2dtest~2d6x5~2d7","task_revision_id":"1","upstream_id":"lgp-test-6x5-7","short_description":"There are 6 houses, numbered 1 to 6 from left to right, as seen from across the…","config":"grid_mode","split":"test","body":"{\"puzzle\":\"There are 6 houses, numbered 1 to 6 from left to right, as seen from across the street. Each house is occupied by a different person. Each house has a unique attribute for each of the following characteristics:\\n - Each person has a unique name: `Bob`, `Arnold`, `Peter`, `Eric`, `Alice`, `Carol`\\n - People have unique favorite music genres: `jazz`, `rock`, `pop`, `hip hop`, `classical`, `country`\\n - Each person has a unique birthday month: `april`, `feb`, `jan`, `mar`, `sept`, `may`\\n - Each person has a unique favorite drink: `root beer`, `coffee`, `tea`, `boba tea`, `water`, `milk`\\n - Each person has an occupation: `nurse`, `doctor`, `teacher`, `lawyer`, `artist`, `engineer`\\n\\n## Clues:\\n1. The person who loves pop music is not in the fourth house.\\n2. The boba tea drinker is the person whose birthday is in April.\\n3. The person whose birthday is in January is somewhere to the right of the person whose birthday is in May.\\n4. Arnold is not in the third house.\\n5. Eric is in the first house.\\n6. Carol is the person who loves jazz music.\\n7. The person who loves classical music is directly left of the root beer lover.\\n8. The person who loves country music is somewhere to the left of the person who is a teacher.\\n9. The person who is a teacher is somewhere to the left of the person who is a nurse.\\n10. The person who is a doctor is somewhere to the left of the person who is a teacher.\\n11. The root beer lover is the person who loves hip-hop music.\\n12. Arnold is the person who is a lawyer.\\n13. Carol is not in the fourth house.\\n14. The person who is an artist is somewhere to the left of the person who loves pop music.\\n15. The person whose birthday is in April is Bob.\\n16. The person who likes milk is not in the second house.\\n17. The one who only drinks water is somewhere to the right of the person whose birthday is in March.\\n18. The tea drinker is the person whose birthday is in September.\\n19. The person whose birthday is in January is the person who loves pop music.\\n20. The person who loves jazz music is directly left of the person who loves rock music.\\n21. Alice is the person who is a nurse.\\n22. The tea drinker is not in the sixth house.\\n23. The person who is a doctor is the root beer lover.\\n\",\"size\":\"6*5\"}","display_format":"text","language":"","answer_status":"unavailable","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}