{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"zebralogicbench","formal_name":"ZebraLogicBench","introduction":"ZebraLogicBench evaluates reasoning on logic puzzles that require satisfying clues to determine attribute assignments. The official card lists 1,000 grid-mode puzzles and a separate multiple-choice setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"50784cd5-ba0c-5e4c-9c4a-896a1e15536d","task_key":"grid~5fmode--test--lgp~2dtest~2d6x6~2d14","task_revision_id":"1","upstream_id":"lgp-test-6x6-14","short_description":"There are 6 houses, numbered 1 to 6 from left to right, as seen from across the…","config":"grid_mode","split":"test","body":"{\"puzzle\":\"There are 6 houses, numbered 1 to 6 from left to right, as seen from across the street. Each house is occupied by a different person. Each house has a unique attribute for each of the following characteristics:\\n - Each person has a unique name: `Carol`, `Bob`, `Alice`, `Peter`, `Eric`, `Arnold`\\n - Each person has a unique level of education: `master`, `doctorate`, `high school`, `bachelor`, `trade school`, `associate`\\n - People have unique favorite book genres: `romance`, `fantasy`, `historical fiction`, `science fiction`, `mystery`, `biography`\\n - Each mother is accompanied by their child: `Alice`, `Samantha`, `Timothy`, `Meredith`, `Bella`, `Fred`\\n - Everyone has something unique for lunch: `stew`, `soup`, `stir fry`, `spaghetti`, `pizza`, `grilled cheese`\\n - People have unique favorite sports: `volleyball`, `basketball`, `tennis`, `baseball`, `swimming`, `soccer`\\n\\n## Clues:\\n1. Alice is the person who loves swimming.\\n2. The person's child is named Alice is directly left of the person who loves historical fiction books.\\n3. The person who loves the stew is the person who loves historical fiction books.\\n4. The person with a doctorate is the person who loves the soup.\\n5. The person who loves science fiction books is in the sixth house.\\n6. The person who attended trade school is directly left of the person who loves historical fiction books.\\n7. The person who loves baseball and the person's child is named Bella are next to each other.\\n8. The person with a master's degree is somewhere to the left of the person who loves mystery books.\\n9. The person who loves soccer is somewhere to the left of the person who loves fantasy books.\\n10. The person who loves stir fry is the person with an associate's degree.\\n11. The person who is a pizza lover is Peter.\\n12. Bob is not in the sixth house.\\n13. The person's child is named Meredith is directly left of the person who loves fantasy books.\\n14. The person's child is named Samantha is Eric.\\n15. There is one house between the person who loves eating grilled cheese and Bob.\\n16. The person who loves eating grilled cheese is the person's child is named Samantha.\\n17. The person who loves volleyball is the person's child is named Samantha.\\n18. The person's child is named Fred is somewhere to the left of the person's child is named Samantha.\\n19. Bob is the person who loves tennis.\\n20. The person who loves soccer is directly left of Carol.\\n21. The person who loves eating grilled cheese is somewhere to the left of the person who loves mystery books.\\n22. The person's child is named Meredith is the person who loves biography books.\\n23. The person's child is named Meredith is the person who loves the soup.\\n24. Carol is the person with a high school diploma.\\n\",\"size\":\"6*6\"}","display_format":"text","language":"","answer_status":"unavailable","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}