{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"zebralogicbench","formal_name":"ZebraLogicBench","introduction":"ZebraLogicBench evaluates reasoning on logic puzzles that require satisfying clues to determine attribute assignments. The official card lists 1,000 grid-mode puzzles and a separate multiple-choice setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a60475b7-00aa-54df-a42c-c0c796a230b1","task_key":"grid~5fmode--test--lgp~2dtest~2d6x6~2d4","task_revision_id":"1","upstream_id":"lgp-test-6x6-4","short_description":"There are 6 houses, numbered 1 to 6 from left to right, as seen from across the…","config":"grid_mode","split":"test","body":"{\"puzzle\":\"There are 6 houses, numbered 1 to 6 from left to right, as seen from across the street. Each house is occupied by a different person. Each house has a unique attribute for each of the following characteristics:\\n - Each person has a unique name: `Alice`, `Carol`, `Peter`, `Bob`, `Arnold`, `Eric`\\n - They all have a unique favorite flower: `carnations`, `iris`, `tulips`, `daffodils`, `lilies`, `roses`\\n - Each person prefers a unique type of vacation: `camping`, `mountain`, `city`, `beach`, `cultural`, `cruise`\\n - Each person lives in a unique style of house: `colonial`, `modern`, `mediterranean`, `craftsman`, `ranch`, `victorian`\\n - People have unique heights: `short`, `very short`, `average`, `tall`, `super tall`, `very tall`\\n - People have unique hair colors: `red`, `black`, `gray`, `brown`, `auburn`, `blonde`\\n\\n## Clues:\\n1. The person who loves the boquet of lilies is not in the fifth house.\\n2. The person who is very short is the person who has auburn hair.\\n3. Arnold is the person who enjoys camping trips.\\n4. The person who has auburn hair is Eric.\\n5. The person who goes on cultural tours is somewhere to the left of the person who is super tall.\\n6. There are two houses between the person who has gray hair and the person who is short.\\n7. The person who is tall is somewhere to the left of the person who has brown hair.\\n8. The person in a Craftsman-style house is Bob.\\n9. The person who is very short is somewhere to the left of the person who has blonde hair.\\n10. The person who is very tall is Bob.\\n11. There are two houses between the person who loves the rose bouquet and Peter.\\n12. The person in a modern-style house is not in the fourth house.\\n13. The person who prefers city breaks is the person who is short.\\n14. The person living in a colonial-style house is somewhere to the left of the person who loves the vase of tulips.\\n15. The person who loves a carnations arrangement is the person who has brown hair.\\n16. The person who has red hair is the person who loves the boquet of lilies.\\n17. The person who enjoys mountain retreats is the person residing in a Victorian house.\\n18. The person who loves a bouquet of daffodils is the person in a modern-style house.\\n19. Arnold is the person who has an average height.\\n20. The person in a Mediterranean-style villa is not in the first house.\\n21. The person who is tall is not in the fifth house.\\n22. The person who loves the vase of tulips is not in the fourth house.\\n23. Carol is directly left of Bob.\\n24. The person who is very tall is the person who goes on cultural tours.\\n25. The person in a Mediterranean-style villa is the person who has red hair.\\n26. The person who is super tall is the person who has black hair.\\n27. Eric is the person who loves the rose bouquet.\\n28. The person who enjoys mountain retreats is directly left of the person who likes going on cruises.\\n\",\"size\":\"6*6\"}","display_format":"text","language":"","answer_status":"unavailable","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}