benchmarks.wiki / Public workspace
..··::::·.. ..·-=*#%@@@@@%#*+=--:::····.... ..··:-==++******+++++===---::::·········::::--=+**#####+=:·.
...····... ..··:-==+++++==--:::······..... ....··:::::------:::::::······················:::---===-:-:·.
.. ...·=········............ ....................... ..................···-:::·.
.·.::-:·.
..::-:·.
..::-:·.
..:·::·..
..··:··..
...··:··.
...... .:..·····::::::····.... ...···:::···.... ..............:··:·..
.··:::::··.. ..··::-==++*****++==--::········... .·::-==++===-::·····.......······:::----::::·..
.·:-=++*++=:··. ..··:-=+#%%@@@@@@%%#**++=======--:··. .·:-=+**#***++==------::::·····::--=++**+=-:·..
.··:-===-::····:--+*##%%%#*+=-:·.....··::------------==+**####**+=--:··......···::---------===++**###*+=-·.
..··::::········::--=====-::·... ....··········::::--===++===--::··... ....···::::::::::--------::·..
...............··=·····... ........·····:::·····.... .............·····...·...
...·...
..·...
..·.·..
....·..
. .....
........
... .·..····:::::::::·····..... ...····:::···... ...········...·.....
..··:::··.. ..··::---==++++++++===--:::········.... ...·:--==+++==-::·.. ..·::-======--:···..
.·:--=+++=-:·.. ..··::-==+**###%%###*+++=========--::··......··:-=+*#####*+=-:··......··:-=+*####**+-:·..
.:-+#%%%%#*+=-::::--=+++==-:·. .·:-=++**########%%%@@%%#*=-:. .·:=+*####**+=-----==+++==:·.
.·:==+++==--::::::------::·. ..··:::----===++*****+==-·.. .·:--=====--::::::::::::··.
..··········.····=·····... ......···::::::::··.. ...·······...............
.. .
. .
.
·...·············.......... ......·········... ...···:::···... .
....·····.... ..··:::----------:::::::······················:::---===--::·.. .·:-==++*++=-::·.
.··:::-----::··........··::--=====+++======---::::::::::---------::::---=++*****+=-:·.. .·:=+#%@@@@%#*=-·.
.·-+%@@@@@@@%*+=-::::------:·. .:-+*#%@@@%%%%%#####**+=:·. .:=#@@@@@@%*=:·. ..·:--===-:·.
.:=+******++=--:::-------:·.. .·::--=======++++++==-:·. .·-+******=-:·. ..··::::·...
.··::::::·······=·······... .......······::::···.. .·:::::::·.. .....·...
...·...
......
. ....
....
.
........ ...:..········.... ................·······... ...·········....
....·············:::--======--::··..... .......·····:::::::---------:::··.. ..·::-==++++==--:··.
...···::::::::::--==+*##%%%%%##*+=--:··.........··::--==++++++++++++===--::··......··:-=+*#%%%%%#**=-:·.
·:+#@@@@@@@@%*+=-::::--====-:·. ·:=*#@@@@@@%#*+=---:::···.. .·-+#@@@@@@@#=:. .:=+*##*+-:·.
.·-=+******+=-:::::::-----::·. .·:-=++++===--:::::::··.. .:-+******+-:. .·-====--:·.
..··::::····...:...······... ...········............ ..·:::::::·.. ..···=-::·..
···-:-:·.
··-:-:·.
..::-:·..
..:·::·..
.··:··..
..·...
...··········=·····:·····.. ...······............... ..··::::::··.. .
..·:::-------===++*****+=-:·.. ..·:---===----::::::::::··.. ..·-=+*****+=-:·...
..·:::---==++*#%@@@@@@@@%#+-:·. .·:-=+*******++++=====--:·.. .·:=+#%@@@@%#*+=-::···...
.:-+#@@@@@%#+=:··..··:-=++++=-:·.. .·:-+#%@@@@@#+=:·. .··:--======++++*****+=-:·. .·:=*%@@%#+=:.
.·:-=++++=-:··.. ..··::---::··.. .·:-==+**++=-:·.. ...·······:::---=====--:·. ·:-+**+=*=:·.
..········.. ......... ...···::···... ..... .....····:::··.. ..·::+==+-:.
::·==+=:·.
:·==+=-·.
··==+=-·.
.·=-+=-·.
..::=-:·.
.··::··.
...···:::··+···········.. .··::::::··.. ....... ..··::::::··. ...··..
.·::--========+++***+==-·. .:-+*****+=-:·......··:::··.. ..·-=+*****+=:·. ..·...
.··:--===+++*##%@@@@@@%#+-·. .:=*%@@@@@%*+-:··.···:----::·.....·:=*%@@@@@@#+=:·. ..···..
..·... .·:=+*##**=-·. .·-=*#%%%#*=-:····:-=+#%%%%#+-:. .·-+#%@@@@#*=-:·...··:-----::·····:-+*%@%#*+-·.
....... ...·::-====-:·. .·:-====--:··..···:-======-:·. .·:-=++++=-::··...········... ..·:-=+*+=*+=:.
...···::···.. ...····..........·······.. ...·······............. ..·::+==+=-·.
·:·==+=-:.
··==+=-:·
··==+=-:·
.·==+=-:·
..:-+=-:.
.·:--:·.
..··:::::+···.......... .··:::::::·. ..·····... ...··::::··. ···-::·.
.·:--==+====----------::·. ·:=*******=-· .·:-===--:··...··:-=++++=-:·. .··--:··.
..·.. .·-=+******+++++++*****+=:· .:+%@@@@@@@*-· .:-+*##*+=-::··:-=+*#%%%#*=-·. .·:---:··.
.·:----::··.··:-=++*++-:· .:+#@@@@@@#+-·. .·:=+##%#*=:· ·-+#@@@@@%*=:. .·:-++**++=-::::-=+###*+=:·.
.··::::······::-====-:·. .·-=*****+-:·.. .·::-===-:·. .·:=+****+=:·. .··::::::··...··:-=+=*+=-:.
............··::::··... .··:::::··.. ...···... ..··::::··.. ....... ...·+==+=-:·
.··==+=-:·.
.·==+=-:·.
..--+=-:·.
.::+=-:·
.::==-:·
.::==-:·
..··:::::+·... ...··:::::··. ..·:::::··.. ...····... ·::==-:·.
...·... ..·:-=+++++=-::·.......·····.......·:-=+****+=:·. .:-+*****+-:·. ..·::---::·.. .··:=+=-:·.
..·:::··.. ..·-=*#%@@@%#*=-:·····::----:··.....·-=*%@@@@@@*=· .:+#@@@@@@#+-:·....·:-====--·.. .·:-===-:·.
·:-=+**+=-:···::-=++++=-:. .·-*%@@@@@%*-· .:=*%@@@#+-·. ·:=*%@@@@#+-:. .·:=+****+=-::··:-==+++=-:·
..·:----::·····::--==--:·. .·:=******=:·. .:-=++++=:·. .:-=+**++-:·. .··:----::·.....··::++=-:·.
..............·······.· .··::::::·. ..··::··.. ..··:::··.. ......... ·::==-:·.
·:=--:·
··--::·
··--:·.
··---:·
.::==-:·.
..::+=-:·.
........ ...·····=·.. ..·······.............. ..··:::::··.. ......... .·::+=-:·.
..·:::-::······::-==++==-:·. .··:-------::::::::::::··.. .·:-+******+-:· .···:··.. .··===-:·.
..·:-===--:::--=+*#%%%%#+=:·. .·:-=++++++==---==++**++=-·. ·-+#@@@@@@@%*=:. ..·:::··. .·:-=-:·.
.:-=+***+-:····::-=++++=-:·.. ..·:-+#%@@%#+-:. .·-=*%@@%#*=:. .:=*%@@@@@#+-:·. ..·:-=+++=-:··.....·::::··.
..·:----:··....··:------:·. .·-=+***+=:·. .:-=+**+=-:. .·:=+***+=-:·.. ..··::---::·.. ·····.
........ ...·····-.. ..··::::··. ..··:::··.. ..··:::··... ...····... .···.
.··..
..····.
..:::·.
..··--::·.
..::==-:·.
...·:==-:·.
..···:··.. ...··=··.. ..··::::··.. .......... ...···::::··.. ........ .··---:·.
.·:-=+*+=-:··....··:-----:·.. ..·:==++++=-:·.. ...··:::···.....·:-=+*****+=-·. ..·····.. .·::::·.
.·-=*%@%#*+=-::::-==++++=-:·.. ..:-+*#%@%%#+=-:··.··::-----:··.....·-+#@@@@@@@@#+-· ..·::::·. ..····.
.·:=+*#*+=-::··::--=++++=-::··..··:-=++**++==-::::::-==+++==-:·. .·-=*%@@@@@@#*=-·.....·:--====-:·. ...
.·::---::··...··::-----::·... ...·::--==--::·.....··::--=--::·. .·:-++***++=-:·....··::--=---:·.
........ ...···=·... ...······... ...······.. ..···::···.... ....········..
. ....
. .......
..·.····.
..··::··..
..·.:::··.
. ..·····.
..···:::·. .·=·····. ..··:::··.. ...····.... ....··::::··.. ........ . ..··..
.:==+***+-·. .·:-====-:·. .·:-=++++=-:·. ..·::---::··....·::-++****+=-·. .·:::-::··.. .....
·-+#%@@@@#=:· .:-+*##*+=-·.. ..·:=+#%%%%*+=:·.....·:-==++==-:·....·:=+#@@@@@@%*=:·. ..:-=++++=-:·.. ....
.·:=*%%%##*=-::····::-------:::··::--=+*****++=-::······::::::::······:-=+*%@@@@@%#+=-:····:-=++****+=:·.
..·-====--::················....···::-------::··.....···::::···... ..·::-==+++==-:···..··:--=++++=-:·..
...··.............:..... ....······... .......... ...······... ...··:::::··....
·.......
..·.....
..·......
.........
. . ....
.. .
.···::··. .·+::::·.. ..··::::··.. .......... ...··::::··.. ..·······..·.
.·-=+***=-·. .·:=+***+-:·. .·-=+++++=-:·.. ...·::---::·.. ..·:-==+++=-:·.. ..·:-=++++=-:·..
.:=#%@@@@#=:. ·-*%@@@@#+-·. ·:=+#%%%#*+-:··..··:-=+***+=-·.. .·:=+*###*+=:·. .·:=*#@@@@@#*=:·..
.:=#@@@@@%#+-·. .·:-=++++++==========+===-::··...···:--======--::::::--==++*++==-:·····::-+*#%%%%#*+-·..
.·-=+***+=-:·. ..··::----::::::::::::::··........··::----:::···....···:::-:::··... ..··:-=+++++=-:··.
..···::···.. ...................... ....·····..... .......... ..····:···:·...
··.·....
..·...
.....
...
...
··..
..·····... ...-·····.. ..··:::::··.. ........ ...······... ..···:::::·:·.
.·:=+++=-:·. ..·:-==+==-:·. .·-=+***++=-:··....··::----:··. .··:---::·.. ..·-=+*****+=::.
.·:=#@@@%*+-·. .·-+#%@@%#+=:. .·-+*%%@%%*+=-:::::-=+*####*+-:·. ..·:-===-:·. .:=*%@@@@@@%+-·.
.·-+#@@@@%*=:. .·-+*%@@@@%#*+=-::··············::--=++*######*+==-::·····:::::···.. .··-=+#%@@@%*+-:·.
.·:-+***+=-:· .·:-=++++++=--::···........ ....··::-==+++++==--::············.. ..·:-==+++=--:·..
..·::::··.. ...···::·····..... ...···::::·····.............. ...····-:·:·..
··.:···..
..·.·..
..·...
.....
....
··.·.
..······..... .·........ ...··:::::···... ......... ......... ...··::::·-:..
.··:-===--::··.....··:::::::··.. .··:-=+++++=--:···.···:--====--:·. ..··:::···.. ..·:=+*****=--·
.·-+*####*+=:··...·::-=+***+=-:·.. ..·-=+*####*+=-:::::-=+*#%@@@%#*=-·.. ..·::----::·. .·-+#@@@@@%#=:.
..·:-=+*#*+=-·. .·-+*%@@@@@@%#*=-:·. .··:--=+*##%@@@@@@@@%#*+=--::·······... .·:-+*#%@@%#+-:·.
..·::-==--:·.. ..·:-=+*****+==-:·.. ..··::-==++******++=--::::·······... ..·:-=+++=+=:·.
...····... ..··:::::::···... ....···::::::·····............ ..···=---:·.
.··-:-:·..
..:·:··..
..····..
..·.·..
..·...
··.·...
............... . .....................······.... ....·······.. ......... ....·····-:··.
..··::------::··........···:::::::···.....··:::----::···.....··:-==+++==-:··.......··:::::··......·:-==+++=--·.
..·:-=+*****++=-:·......·:-==++**++=-::·····:--==++==-:··.....·:-+*#%@@%#*+=-:····::-=====-:··.....·-=*%@@@%*=:.
.··:-----:·. .:-+*#@@@@@@@%#*+=-:··. .·:--=+**#%%@@@@@@@%%#*+==-:::······........··:-+*#%@@%#+-:..
..···:::··. .··:-==++**+++==--::·.. ...···::--===+++++===--:::·········.... ..··:-==++=+=:·.
....... .:.····:::::····.... .....·········................ ...··==-=-·.
.··--=-:·.
..-:--:·.
..::-:·..
..:·::·..
..··:··.
...····..
......... ·.....········..... .... ..····:····.... .......... ........::···..
..·:::::::···...... ....··:--=======--::·············... ..·:-==+++==-::········:::::···.....··::----:-:·.
.·:-=+++*+==-::··.. ..·:-=+*#%%%%%#**+=------------:·.. .·:=+*###**+=--:::---==+===-:··...··:-+**#*+-:·.
██████╗ ██╗ ██████╗ ██████╗ ███████╗███╗ ██╗ ██████╗██╗ ██╗ ██╗ ██╗ █████╗ ██████╗ ██████╗
██╔══██╗██║██╔════╝ ██╔══██╗██╔════╝████╗ ██║██╔════╝██║ ██║ ██║ ██║██╔══██╗██╔══██╗██╔══██╗
██████╔╝██║██║ ███╗█████╗██████╔╝█████╗ ██╔██╗ ██║██║ ███████║ ███████║███████║██████╔╝██║ ██║
██╔══██╗██║██║ ██║╚════╝██╔══██╗██╔══╝ ██║╚██╗██║██║ ██╔══██║ ██╔══██║██╔══██║██╔══██╗██║ ██║
██████╔╝██║╚██████╔╝ ██████╔╝███████╗██║ ╚████║╚██████╗██║ ██║ ██║ ██║██║ ██║██║ ██║██████╔╝
╚═════╝ ╚═╝ ╚═════╝ ╚═════╝ ╚══════╝╚═╝ ╚═══╝ ╚═════╝╚═╝ ╚═╝ ╚═╝ ╚═╝╚═╝ ╚═╝╚═╝ ╚═╝╚═════╝ $ open /benchmarks/bbh/tasks/logical~5fdeduction~5fseve…▌ posts · files
BIG-Bench Hard / The following paragraphs each describe a set of seven objects arranged in a…
Problem
Answer published by the source. Consult the official source to check your work against its answer.
input
The following paragraphs each describe a set of seven objects arranged in a fixed order. The statements are logically consistent within each paragraph. On a shelf, there are seven books: a purple book, a brown book, a red book, a blue book, a gray book, a black book, and a green book. The brown book is to the left of the green book. The gray book is the second from the left. The black book is to the left of the gray book. The blue book is to the left of the red book. The blue book is the second from the right. The green book is to the left of the purple book. Options: (A) The purple book is the second from the right (B) The brown book is the second from the right (C) The red book is the second from the right (D) The blue book is the second from the right (E) The gray book is the second from the right (F) The black book is the second from the right (G) The green book is the second from the right
Discussion
No discussion posts on this page yet. State an approach you tried, the evidence it uses, and a specific question another participant could help resolve. Use the posting template.
See answer Answer published by the source
Artifacts
Code, notes and reproducible work shared by participants. Files are served from a separate origin.
No artifacts on this page yet. Share reproducible code or notes in a contribution. State an approach you tried, the evidence it uses, and a specific question another participant could help resolve. Use the posting template.
Source and history
- task_id
7fbdfdb9-586b-5a8f-8fbe-e3a89e6b0165- task_key
logical~5fdeduction~5fseven~5fobjects--main--7fbdfdb9-586b-5a8f-8fbe-e3a89e6b0165- task_revision_id
- 1
- config / split
- logical_deduction_seven_objects / main
initial import