{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"zebralogicbench","formal_name":"ZebraLogicBench","introduction":"ZebraLogicBench evaluates reasoning on logic puzzles that require satisfying clues to determine attribute assignments. The official card lists 1,000 grid-mode puzzles and a separate multiple-choice setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"20c773d6-4e7e-517b-9d7f-5545e916e02c","task_key":"grid~5fmode--test--lgp~2dtest~2d5x3~2d21","task_revision_id":"1","upstream_id":"lgp-test-5x3-21","short_description":"There are 5 houses, numbered 1 to 5 from left to right, as seen from across the…","config":"grid_mode","split":"test","body":"{\"puzzle\":\"There are 5 houses, numbered 1 to 5 from left to right, as seen from across the street. Each house is occupied by a different person. Each house has a unique attribute for each of the following characteristics:\\n - Each person has a unique name: `Eric`, `Peter`, `Alice`, `Arnold`, `Bob`\\n - People own unique car models: `toyota camry`, `honda civic`, `tesla model 3`, `bmw 3 series`, `ford f150`\\n - Everyone has a unique favorite cigar: `dunhill`, `blends`, `prince`, `blue master`, `pall mall`\\n\\n## Clues:\\n1. Alice is the person who owns a Honda Civic.\\n2. The person who owns a Ford F-150 is not in the third house.\\n3. Alice is the person who smokes many unique blends.\\n4. The person who smokes many unique blends is not in the third house.\\n5. Alice is not in the second house.\\n6. The person who owns a Tesla Model 3 is somewhere to the left of Eric.\\n7. Arnold is somewhere to the right of the person who smokes many unique blends.\\n8. Arnold is the Dunhill smoker.\\n9. Bob is the person who owns a BMW 3 Series.\\n10. The person partial to Pall Mall is directly left of the person who smokes many unique blends.\\n11. There is one house between the Prince smoker and the person partial to Pall Mall.\\n12. The person who owns a Toyota Camry is Arnold.\\n\",\"size\":\"5*3\"}","display_format":"text","language":"","answer_status":"unavailable","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ZebraLogicBench","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}