benchmarks.wiki / Public workspace

   ..··::::·..    ..·-=*#%@@@@@%#*+=--:::····....      ..··:-==++******+++++===---::::·········::::--=+**#####+=:·.     
    ...····...     ..··:-==+++++==--:::······.....     ....··:::::------:::::::······················:::---===-:-:·.    
         ..           ...·=········............           .......................        ..................···-:::·.    
                                                                                                            .·.::-:·.   
                                                                                                             ..::-:·.   
                                                                                                             ..::-:·.   
                                                                                                             ..:·::·..  
                                                                                                             ..··:··..  
                                                                                                            ...··:··.   
    ......               .:..·····::::::····....                      ...···:::···....          ..............:··:·..   
  .··:::::··..           ..··::-==++*****++==--::········...          .·::-==++===-::·····.......······:::----::::·..   
 .·:-=++*++=:··.          ..··:-=+#%%@@@@@@%%#**++=======--:··.       .·:-=+**#***++==------::::·····::--=++**+=-:·..   
     .··:-===-::····:--+*##%%%#*+=-:·.....··::------------==+**####**+=--:··......···::---------===++**###*+=-·.        
      ..··::::········::--=====-::·...   ....··········::::--===++===--::··...     ....···::::::::::--------::·..       
         ...............··=·····...                ........·····:::·····....             .............·····...·...      
                                                                                                            ...·...     
                                                                                                             ..·...     
                                                                                                             ..·.·..    
                                                                                                             ....·..    
                                                                                                             . .....    
                                                                                                            ........    
     ...                 .·..····:::::::::·····.....                  ...····:::···...          ...········...·.....    
  ..··:::··..            ..··::---==++++++++===--:::········....     ...·:--==+++==-::·..      ..·::-======--:···..     
 .·:--=+++=-:·..          ..··::-==+**###%%###*+++=========--::··......··:-=+*#####*+=-:··......··:-=+*####**+-:·..     
      .:-+#%%%%#*+=-::::--=+++==-:·.        .·:-=++**########%%%@@%%#*=-:.        .·:=+*####**+=-----==+++==:·.         
       .·:==+++==--::::::------::·.            ..··:::----===++*****+==-·..         .·:--=====--::::::::::::··.         
         ..··········.····=·····...                  ......···::::::::··..            ...·······...............         
                                                                                                            .. .        
                                                                                                             . .        
                                                                                                               .        
                                                                                                                        
                                                                                                                        
                                                                                                                        
                          ·...·············..........             ......·········...          ...···:::···... .         
   ....·····....         ..··:::----------:::::::······················:::---===--::·..       .·:-==++*++=-::·.         
  .··:::-----::··........··::--=====+++======---::::::::::---------::::---=++*****+=-:·..     .·:=+#%@@@@%#*=-·.        
      .·-+%@@@@@@@%*+=-::::------:·.           .:-+*#%@@@%%%%%#####**+=:·.        .:=#@@@@@@%*=:·.  ..·:--===-:·.       
        .:=+******++=--:::-------:·..            .·::--=======++++++==-:·.         .·-+******=-:·.    ..··::::·...      
          .··::::::·······=·······...               .......······::::···..           .·:::::::·..        .....·...      
                                                                                                            ...·...     
                                                                                                             ......     
                                                                                                             . ....     
                                                                                                               ....     
                                                                                                                 .      
                                                                                                                        
            ........   ...:..········....            ................·······...           ...·········....              
        ....·············:::--======--::··..... .......·····:::::::---------:::··..      ..·::-==++++==--:··.           
       ...···::::::::::--==+*##%%%%%##*+=--:··.........··::--==++++++++++++===--::··......··:-=+*#%%%%%#**=-:·.         
        ·:+#@@@@@@@@%*+=-::::--====-:·.         ·:=*#@@@@@@%#*+=---:::···..     .·-+#@@@@@@@#=:.       .:=+*##*+-:·.    
         .·-=+******+=-:::::::-----::·.          .·:-=++++===--:::::::··..        .:-+******+-:.        .·-====--:·.    
           ..··::::····...:...······...           ...········............          ..·:::::::·..         ..···=-::·..   
                                                                                                            ···-:-:·.   
                                                                                                             ··-:-:·.   
                                                                                                             ..::-:·..  
                                                                                                             ..:·::·..  
                                                                                                              .··:··..  
                                                                                                               ..·...   
             ...··········=·····:·····..             ...······...............          ..··::::::··..            .      
             ..·:::-------===++*****+=-:·..         ..·:---===----::::::::::··..      ..·-=+*****+=-:·...               
              ..·:::---==++*#%@@@@@@@@%#+-:·.        .·:-=+*******++++=====--:·..     .·:=+#%@@@@%#*+=-::···...         
          .:-+#@@@@@%#+=:··..··:-=++++=-:·..   .·:-+#%@@@@@#+=:·.     .··:--======++++*****+=-:·.     .·:=*%@@%#+=:.    
           .·:-=++++=-:··..  ..··::---::··..    .·:-==+**++=-:·..     ...·······:::---=====--:·.        ·:-+**+=*=:·.   
            ..········..         .........       ...···::···...          ..... .....····:::··..          ..·::+==+-:.   
                                                                                                            ::·==+=:·.  
                                                                                                             :·==+=-·.  
                                                                                                             ··==+=-·.  
                                                                                                             .·=-+=-·.  
                                                                                                             ..::=-:·.  
                                                                                                              .··::··.  
               ...···:::··+···········..            .··::::::··..       .......       ..··::::::··.           ...··..   
                .·::--========+++***+==-·.          .:-+*****+=-:·......··:::··..    ..·-=+*****+=:·.         ..·...    
                .··:--===+++*##%@@@@@@%#+-·.        .:=*%@@@@@%*+-:··.···:----::·.....·:=*%@@@@@@#+=:·.     ..···..     
  ..·...    .·:=+*##**=-·.      .·-=*#%%%#*=-:····:-=+#%%%%#+-:.      .·-+#%@@@@#*=-:·...··:-----::·····:-+*%@%#*+-·.   
  ....... ...·::-====-:·.         .·:-====--:··..···:-======-:·.       .·:-=++++=-::··...········...  ..·:-=+*+=*+=:.   
            ...···::···..           ...····..........·······..          ...·······.............          ..·::+==+=-·.  
                                                                                                            ·:·==+=-:.  
                                                                                                             ··==+=-:·  
                                                                                                             ··==+=-:·  
                                                                                                             .·==+=-:·  
                                                                                                             ..:-+=-:.  
                                                                                                              .·:--:·.  
                 ..··:::::+···..........           .··:::::::·.          ..·····...    ...··::::··.           ···-::·.  
                .·:--==+====----------::·.         ·:=*******=-·        .·:-===--:··...··:-=++++=-:·.        .··--:··.  
  ..·..         .·-=+******+++++++*****+=:·        .:+%@@@@@@@*-·       .:-+*##*+=-::··:-=+*#%%%#*=-·.      .·:---:··.  
 .·:----::··.··:-=++*++-:·        .:+#@@@@@@#+-·.   .·:=+##%#*=:·      ·-+#@@@@@%*=:.     .·:-++**++=-::::-=+###*+=:·.  
  .··::::······::-====-:·.         .·-=*****+-:·..   .·::-===-:·.      .·:=+****+=:·.      .··::::::··...··:-=+=*+=-:.  
    ............··::::··...          .··:::::··..      ...···...        ..··::::··..         .......      ...·+==+=-:·  
                                                                                                            .··==+=-:·. 
                                                                                                             .·==+=-:·. 
                                                                                                             ..--+=-:·. 
                                                                                                              .::+=-:·  
                                                                                                              .::==-:·  
                                                                                                              .::==-:·  
                 ..··:::::+·...                  ...··:::::··.          ..·:::::··..       ...····...         ·::==-:·. 
   ...·...     ..·:-=+++++=-::·.......·····.......·:-=+****+=:·.        .:-+*****+-:·.    ..·::---::·..     .··:=+=-:·. 
  ..·:::··..  ..·-=*#%@@@%#*=-:·····::----:··.....·-=*%@@@@@@*=·        .:+#@@@@@@#+-:·....·:-====--·..     .·:-===-:·. 
  ·:-=+**+=-:···::-=++++=-:.      .·-*%@@@@@%*-·      .:=*%@@@#+-·.     ·:=*%@@@@#+-:.     .·:=+****+=-::··:-==+++=-:·  
  ..·:----::·····::--==--:·.       .·:=******=:·.      .:-=++++=:·.      .:-=+**++-:·.      .··:----::·.....··::++=-:·. 
    ..............·······.·          .··::::::·.        ..··::··..        ..··:::··..        .........        ·::==-:·. 
                                                                                                               ·:=--:·  
                                                                                                               ··--::·  
                                                                                                               ··--:·.  
                                                                                                               ··---:·  
                                                                                                              .::==-:·. 
                                                                                                             ..::+=-:·. 
     ........     ...·····=·..          ..·······..............         ..··:::::··..          .........     .·::+=-:·. 
   ..·:::-::······::-==++==-:·.       .··:-------::::::::::::··..      .·:-+******+-:·         .···:··..     .··===-:·. 
   ..·:-===--:::--=+*#%%%%#+=:·.     .·:-=++++++==---==++**++=-·.       ·-+#@@@@@@@%*=:.      ..·:::··.       .·:-=-:·. 
   .:-=+***+-:····::-=++++=-:·.. ..·:-+#%@@%#+-:.    .·-=*%@@%#*=:.      .:=*%@@@@@#+-:·.   ..·:-=+++=-:··.....·::::··. 
   ..·:----:··....··:------:·.      .·-=+***+=:·.      .:-=+**+=-:.       .·:=+***+=-:·..   ..··::---::·..      ·····.  
     ........     ...·····-..        ..··::::··.        ..··:::··..         ..··:::··...      ...····...         .···.  
                                                                                                                 .··..  
                                                                                                               ..····.  
                                                                                                               ..:::·.  
                                                                                                             ..··--::·. 
                                                                                                             ..::==-:·. 
                                                                                                            ...·:==-:·. 
     ..···:··..      ...··=··..         ..··::::··..        ..........  ...···::::··..            ........    .··---:·. 
    .·:-=+*+=-:··....··:-----:·..     ..·:==++++=-:·..   ...··:::···.....·:-=+*****+=-·.         ..·····..     .·::::·. 
    .·-=*%@%#*+=-::::-==++++=-:·..   ..:-+*#%@%%#+=-:··.··::-----:··.....·-+#@@@@@@@@#+-·       ..·::::·.       ..····. 
    .·:=+*#*+=-::··::--=++++=-::··..··:-=++**++==-::::::-==+++==-:·.     .·-=*%@@@@@@#*=-·.....·:--====-:·.        ...  
     .·::---::··...··::-----::·... ...·::--==--::·.....··::--=--::·.       .·:-++***++=-:·....··::--=---:·.             
      ........      ...···=·...       ...······...      ...······..          ..···::···....  ....········..             
                                                                                                            .    ....   
                                                                                                             . .......  
                                                                                                             ..·.····.  
                                                                                                             ..··::··.. 
                                                                                                             ..·.:::··. 
                                                                                                            .  ..·····. 
     ..···:::·.         .·=·····.        ..··:::··..         ...····....  ....··::::··..            ........  .  ..··.. 
     .:==+***+-·.      .·:-====-:·.     .·:-=++++=-:·.     ..·::---::··....·::-++****+=-·.        .·:::-::··..   .....  
     ·-+#%@@@@#=:·     .:-+*##*+=-·.. ..·:=+#%%%%*+=:·.....·:-==++==-:·....·:=+#@@@@@@%*=:·.    ..:-=++++=-:·..   ....  
     .·:=*%%%##*=-::····::-------:::··::--=+*****++=-::······::::::::······:-=+*%@@@@@%#+=-:····:-=++****+=:·.          
      ..·-====--::················....···::-------::··.....···::::···...   ..·::-==+++==-:···..··:--=++++=-:·..         
        ...··.............:.....       ....······...       ..........          ...······...     ...··:::::··....        
                                                                                                            ·.......    
                                                                                                             ..·.....   
                                                                                                             ..·......  
                                                                                                             .........  
                                                                                                             . . ....   
                                                                                                            .. .        
      .···::··.         .·+::::·..        ..··::::··..        ..........      ...··::::··..        ..·······..·.        
     .·-=+***=-·.      .·:=+***+-:·.      .·-=+++++=-:·..  ...·::---::·..    ..·:-==+++=-:·..    ..·:-=++++=-:·..       
     .:=#%@@@@#=:.      ·-*%@@@@#+-·.     ·:=+#%%%#*+-:··..··:-=+***+=-·..    .·:=+*###*+=:·.    .·:=*#@@@@@#*=:·..     
      .:=#@@@@@%#+-·.     .·:-=++++++==========+===-::··...···:--======--::::::--==++*++==-:·····::-+*#%%%%#*+-·..      
       .·-=+***+=-:·.      ..··::----::::::::::::::··........··::----:::···....···:::-:::··...  ..··:-=+++++=-:··.      
        ..···::···..          ......................         ....·····.....     ..........          ..····:···:·...     
                                                                                                            ··.·....    
                                                                                                             ..·...     
                                                                                                             .....      
                                                                                                             ...        
                                                                                                             ...        
                                                                                                            ··..        
       ..·····...      ...-·····..         ..··:::::··..        ........          ...······...     ..···:::::·:·.       
      .·:=+++=-:·.    ..·:-==+==-:·.       .·-=+***++=-:··....··::----:··.        .··:---::·..    ..·-=+*****+=::.      
     .·:=#@@@%*+-·.    .·-+#%@@%#+=:.      .·-+*%%@%%*+=-:::::-=+*####*+-:·.     ..·:-===-:·.      .:=*%@@@@@@%+-·.     
     .·-+#@@@@%*=:.       .·-+*%@@@@%#*+=-::··············::--=++*######*+==-::·····:::::···..    .··-=+#%@@@%*+-:·.    
      .·:-+***+=-:·        .·:-=++++++=--::···........  ....··::-==+++++==--::············..        ..·:-==+++=--:·..   
        ..·::::··..          ...···::·····.....               ...···::::·····..............            ...····-:·:·..   
                                                                                                            ··.:···..   
                                                                                                             ..·.·..    
                                                                                                             ..·...     
                                                                                                             .....      
                                                                                                             ....       
                                                                                                            ··.·.       
        ..······.....    .·........        ...··:::::···...      .........            .........     ...··::::·-:..      
      .··:-===--::··.....··:::::::··..     .··:-=+++++=--:···.···:--====--:·.       ..··:::···..   ..·:=+*****=--·      
      .·-+*####*+=:··...·::-=+***+=-:·..   ..·-=+*####*+=-:::::-=+*#%@@@%#*=-·..  ..·::----::·.     .·-+#@@@@@%#=:.     
  ..·:-=+*#*+=-·.       .·-+*%@@@@@@%#*=-:·.          .··:--=+*##%@@@@@@@@%#*+=--::·······...       .·:-+*#%@@%#+-:·.   
    ..·::-==--:·..       ..·:-=+*****+==-:·..             ..··::-==++******++=--::::·······...        ..·:-=+++=+=:·.   
       ...····...           ..··:::::::···...                  ....···::::::·····............            ..···=---:·.   
                                                                                                            .··-:-:·..  
                                                                                                             ..:·:··..  
                                                                                                             ..····..   
                                                                                                             ..·.·..    
                                                                                                             ..·...     
                                                                                                            ··.·...     
      ...............     .  .....................······....     ....·······..          .........    ....·····-:··.     
    ..··::------::··........···:::::::···.....··:::----::···.....··:-==+++==-:··.......··:::::··......·:-==+++=--·.     
   ..·:-=+*****++=-:·......·:-==++**++=-::·····:--==++==-:··.....·:-+*#%@@%#*+=-:····::-=====-:··.....·-=*%@@@%*=:.     
  .··:-----:·.       .:-+*#@@@@@@@%#*+=-:··.            .·:--=+**#%%@@@@@@@%%#*+==-:::······........··:-+*#%@@%#+-:..   
   ..···:::··.        .··:-==++**+++==--::·..             ...···::--===+++++===--:::·········....    ..··:-==++=+=:·.   
      .......            .:.····:::::····....                    .....·········................          ...··==-=-·.   
                                                                                                            .··--=-:·.  
                                                                                                             ..-:--:·.  
                                                                                                             ..::-:·..  
                                                                                                             ..:·::·..  
                                                                                                             ..··:··.   
                                                                                                            ...····..   
    .........             ·.....········.....       ....            ..····:····....      ..........   ........::···..   
  ..·:::::::···......   ....··:--=======--::·············...       ..·:-==+++==-::········:::::···.....··::----:-:·.    
  .·:-=+++*+==-::··..     ..·:-=+*#%%%%%#**+=------------:·..       .·:=+*###**+=--:::---==+===-:··...··:-+**#*+-:·.



    ██████╗ ██╗ ██████╗       ██████╗ ███████╗███╗   ██╗ ██████╗██╗  ██╗    ██╗  ██╗ █████╗ ██████╗ ██████╗ 
    ██╔══██╗██║██╔════╝       ██╔══██╗██╔════╝████╗  ██║██╔════╝██║  ██║    ██║  ██║██╔══██╗██╔══██╗██╔══██╗
    ██████╔╝██║██║  ███╗█████╗██████╔╝█████╗  ██╔██╗ ██║██║     ███████║    ███████║███████║██████╔╝██║  ██║
    ██╔══██╗██║██║   ██║╚════╝██╔══██╗██╔══╝  ██║╚██╗██║██║     ██╔══██║    ██╔══██║██╔══██║██╔══██╗██║  ██║
    ██████╔╝██║╚██████╔╝      ██████╔╝███████╗██║ ╚████║╚██████╗██║  ██║    ██║  ██║██║  ██║██║  ██║██████╔╝
    ╚═════╝ ╚═╝ ╚═════╝       ╚═════╝ ╚══════╝╚═╝  ╚═══╝ ╚═════╝╚═╝  ╚═╝    ╚═╝  ╚═╝╚═╝  ╚═╝╚═╝  ╚═╝╚═════╝

Pause animation

BIG-Bench Hard / Tasks

Choose a problem to read its original content, examples and discussion.

Option counts cover the whole public benchmark.

Clear filters

1–50 / 6507 tasks

boolean_expressions / main
( not ( True or False ) ) is
Answer published by the source
Identifiers
task_id
0183c6ae-f717-5ee8-8c7a-8b5fc45f17a7
task_key
boolean~5fexpressions--main--0183c6ae-f717-5ee8-8c7a-8b5fc45f17a7
causal_judgement / main
How would a typical person answer each of the following questions about…
Answer published by the source
Identifiers
task_id
006cba4e-5f8c-56fa-8a9d-c80d379fc85f
task_key
causal~5fjudgement--main--006cba4e-5f8c-56fa-8a9d-c80d379fc85f
causal_judgement / main
How would a typical person answer each of the following questions about…
Answer published by the source
Identifiers
task_id
011f9780-28bd-5c75-b946-a3e2f44eca18
task_key
causal~5fjudgement--main--011f9780-28bd-5c75-b946-a3e2f44eca18
causal_judgement / main
How would a typical person answer each of the following questions about…
Answer published by the source
Identifiers
task_id
01280ea1-c210-5d53-a785-fd7083cff8e5
task_key
causal~5fjudgement--main--01280ea1-c210-5d53-a785-fd7083cff8e5
date_understanding / main
Today is Apr 10, 1985. Jane's appointment will be 3 days later. What is the date…
Answer published by the source
Identifiers
task_id
0046880e-c91a-5145-bcc0-953b31774fa8
task_key
date~5funderstanding--main--0046880e-c91a-5145-bcc0-953b31774fa8
date_understanding / main
Jane was born on the last day of Feburary in 2000. Today is her 16-year-old…
Answer published by the source
Identifiers
task_id
0123f844-7ea5-5aa2-80d8-7a551245aa0a
task_key
date~5funderstanding--main--0123f844-7ea5-5aa2-80d8-7a551245aa0a
date_understanding / main
Jane is celebrating the last day of Jan 2012. What is the date yesterday in…
Answer published by the source
Identifiers
task_id
0130a679-88f2-56b5-ad29-11fea83d77eb
task_key
date~5funderstanding--main--0130a679-88f2-56b5-ad29-11fea83d77eb
dyck_languages / main
Complete the rest of the sequence, making sure that the parentheses are closed…
Answer published by the source
Identifiers
task_id
018b4232-e8c7-566a-b3a0-b334a4da3282
task_key
dyck~5flanguages--main--018b4232-e8c7-566a-b3a0-b334a4da3282
formal_fallacies / main
Here comes a perfectly valid argument: To start with, no stepbrother of Bryan…
Answer published by the source
Identifiers
task_id
010494ba-d48f-56a3-b543-3ffbbcdb768f
task_key
formal~5ffallacies--main--010494ba-d48f-56a3-b543-3ffbbcdb768f
geometric_shapes / main
This SVG path element <path d="M 38.00,68.00 L 32.00,59.00 L 36.00,45.00 L…
Answer published by the source
Identifiers
task_id
003e401d-d6bb-5339-8d0b-f55061fb4f67
task_key
geometric~5fshapes--main--003e401d-d6bb-5339-8d0b-f55061fb4f67
hyperbaton / main
Which sentence has the correct adjective order:
Answer published by the source
Identifiers
task_id
0040505a-4d3f-5df4-926c-ea8716c35f93
task_key
hyperbaton--main--0040505a-4d3f-5df4-926c-ea8716c35f93
hyperbaton / main
Which sentence has the correct adjective order:
Answer published by the source
Identifiers
task_id
008a8db6-6df7-5f92-9862-55e3df0ef917
task_key
hyperbaton--main--008a8db6-6df7-5f92-9862-55e3df0ef917
logical_deduction_five_objects / main
The following paragraphs each describe a set of five objects arranged in a fixed…
Answer published by the source
Identifiers
task_id
011fc5bf-00ae-5d04-9ea8-3d9676c96524
task_key
logical~5fdeduction~5ffive~5fobjects--main--011fc5bf-00ae-5d04-9ea8-3d9676c96524
logical_deduction_seven_objects / main
The following paragraphs each describe a set of seven objects arranged in a…
Answer published by the source
Identifiers
task_id
0062a9b3-a480-5f7b-9418-45da48d2fce5
task_key
logical~5fdeduction~5fseven~5fobjects--main--0062a9b3-a480-5f7b-9418-45da48d2fce5
logical_deduction_three_objects / main
The following paragraphs each describe a set of three objects arranged in a…
Answer published by the source
Identifiers
task_id
000d5ce5-455c-5f0f-9f42-17736b2eaf1d
task_key
logical~5fdeduction~5fthree~5fobjects--main--000d5ce5-455c-5f0f-9f42-17736b2eaf1d
movie_recommendation / main
Find a movie similar to Aladdin, Snow White and the Seven Dwarfs, Babe,…
Answer published by the source
Identifiers
task_id
00936f4c-14c4-5c88-b718-5dc4c7420758
task_key
movie~5frecommendation--main--00936f4c-14c4-5c88-b718-5dc4c7420758
movie_recommendation / main
Find a movie similar to Braveheart, The Usual Suspects, The Shawshank…
Answer published by the source
Identifiers
task_id
0159b1ab-ad22-59b0-bb75-c63ab7ae9c31
task_key
movie~5frecommendation--main--0159b1ab-ad22-59b0-bb75-c63ab7ae9c31
multistep_arithmetic_two / main
((-1 + 5 * 4 + 9) - (-7 - 6 * -8 - 0)) =
Answer published by the source
Identifiers
task_id
011401c1-ac91-5b90-aa64-fe5a3156ed64
task_key
multistep~5farithmetic~5ftwo--main--011401c1-ac91-5b90-aa64-fe5a3156ed64
navigate / main
If you follow these instructions, do you return to the starting point? Always…
Answer published by the source
Identifiers
task_id
00673bcd-913a-5299-9657-cb7950bed57c
task_key
navigate--main--00673bcd-913a-5299-9657-cb7950bed57c
navigate / main
If you follow these instructions, do you return to the starting point? Always…
Answer published by the source
Identifiers
task_id
0089404d-4449-5d8b-84ae-9755d1a4d3eb
task_key
navigate--main--0089404d-4449-5d8b-84ae-9755d1a4d3eb
navigate / main
If you follow these instructions, do you return to the starting point? Always…
Answer published by the source
Identifiers
task_id
00c51662-5861-5aaf-8302-aed8d9dfd164
task_key
navigate--main--00c51662-5861-5aaf-8302-aed8d9dfd164
navigate / main
If you follow these instructions, do you return to the starting point? Take 10…
Answer published by the source
Identifiers
task_id
011b8aa3-19fe-5b03-ab0d-db8e2c238b83
task_key
navigate--main--011b8aa3-19fe-5b03-ab0d-db8e2c238b83
navigate / main
If you follow these instructions, do you return to the starting point? Turn…
Answer published by the source
Identifiers
task_id
0125e600-9814-594a-b6b3-dd548858d9d1
task_key
navigate--main--0125e600-9814-594a-b6b3-dd548858d9d1
navigate / main
If you follow these instructions, do you return to the starting point? Take 6…
Answer published by the source
Identifiers
task_id
017247f7-8d83-5e8c-9268-bf755195b7d8
task_key
navigate--main--017247f7-8d83-5e8c-9268-bf755195b7d8
object_counting / main
I have a yam, a carrot, a lettuce head, a potato, four garlics, and a head of…
Answer published by the source
Identifiers
task_id
00137786-956e-5b85-92d9-c46353e33767
task_key
object~5fcounting--main--00137786-956e-5b85-92d9-c46353e33767
object_counting / main
I have four nectarines, three bananas, a peach, a strawberry, a raspberry, a…
Answer published by the source
Identifiers
task_id
00313706-aef3-5b45-ae14-15eb265630d4
task_key
object~5fcounting--main--00313706-aef3-5b45-ae14-15eb265630d4
object_counting / main
I have a chicken, a frog, a mouse, a cat, two pigs, and two rabbits. How many…
Answer published by the source
Identifiers
task_id
01436af8-8151-5ecb-a0ee-6a347b9e5271
task_key
object~5fcounting--main--01436af8-8151-5ecb-a0ee-6a347b9e5271
penguins_in_a_table / main
Here is a table where the first line is a header and each subsequent line is a…
Answer published by the source
Identifiers
task_id
0114e81e-2d5d-5dc5-84ad-7646a7defe64
task_key
penguins~5fin~5fa~5ftable--main--0114e81e-2d5d-5dc5-84ad-7646a7defe64
reasoning_about_colored_objects / main
On the floor, there is a burgundy bracelet and a yellow mug. Is the bracelet…
Answer published by the source
Identifiers
task_id
0080c700-f22c-5606-bb13-b4e344223dd3
task_key
reasoning~5fabout~5fcolored~5fobjects--main--0080c700-f22c-5606-bb13-b4e344223dd3
reasoning_about_colored_objects / main
On the desk, you see two teal puzzles, two red puzzles, three grey jugs, two…
Answer published by the source
Identifiers
task_id
00dc108e-2b6a-59af-8769-83e0c033f076
task_key
reasoning~5fabout~5fcolored~5fobjects--main--00dc108e-2b6a-59af-8769-83e0c033f076
ruin_names / main
Which of the following is a humorous edit of this artist or movie name: 'the…
Answer published by the source
Identifiers
task_id
00e46a10-1460-5823-82f0-91e441f0222d
task_key
ruin~5fnames--main--00e46a10-1460-5823-82f0-91e441f0222d
ruin_names / main
Which of the following is a humorous edit of this artist or movie name:…
Answer published by the source
Identifiers
task_id
00efdcaa-a405-5203-94ec-6d0560e9e82c
task_key
ruin~5fnames--main--00efdcaa-a405-5203-94ec-6d0560e9e82c
ruin_names / main
Which of the following is a humorous edit of this artist or movie name: 'thunder…
Answer published by the source
Identifiers
task_id
011bd623-4afe-56fd-84cb-9ae6d95741da
task_key
ruin~5fnames--main--011bd623-4afe-56fd-84cb-9ae6d95741da
salient_translation_error_detection / main
The following translations from German to English contain a particular error.…
Answer published by the source
Identifiers
task_id
0032b195-ca7b-5951-93ac-c0bc34ef4aed
task_key
salient~5ftranslation~5ferror~5fdetection--main--0032b195-ca7b-5951-93ac-c0bc34ef4aed
salient_translation_error_detection / main
The following translations from German to English contain a particular error.…
Answer published by the source
Identifiers
task_id
0063eddd-d9c7-53f1-8cfb-76f04e1dc3da
task_key
salient~5ftranslation~5ferror~5fdetection--main--0063eddd-d9c7-53f1-8cfb-76f04e1dc3da
salient_translation_error_detection / main
The following translations from German to English contain a particular error.…
Answer published by the source
Identifiers
task_id
0148ac1d-5106-5a09-872d-2e2e320d6ea7
task_key
salient~5ftranslation~5ferror~5fdetection--main--0148ac1d-5106-5a09-872d-2e2e320d6ea7
snarks / main
Which statement is sarcastic?
Answer published by the source
Identifiers
task_id
004f136e-357f-54ff-93f9-be265bef2b86
task_key
snarks--main--004f136e-357f-54ff-93f9-be265bef2b86
snarks / main
Which statement is sarcastic?
Answer published by the source
Identifiers
task_id
00a5a447-fd14-5078-8190-143a4874bdc2
task_key
snarks--main--00a5a447-fd14-5078-8190-143a4874bdc2
sports_understanding / main
Is the following sentence plausible? "Jonathan Marchessault went five hole."
Answer published by the source
Identifiers
task_id
00180b29-7603-595a-985a-403322df74d0
task_key
sports~5funderstanding--main--00180b29-7603-595a-985a-403322df74d0
sports_understanding / main
Is the following sentence plausible? "Tristan Jarry dunked the ball."
Answer published by the source
Identifiers
task_id
00294dd5-6f1b-56ca-8c6a-0c29e1f617c1
task_key
sports~5funderstanding--main--00294dd5-6f1b-56ca-8c6a-0c29e1f617c1
temporal_sequences / main
Today, Sean went to the basketball court. Between what times could they have…
Answer published by the source
Identifiers
task_id
0123f1a9-d3ee-5e61-8122-fd9f0fb9e90c
task_key
temporal~5fsequences--main--0123f1a9-d3ee-5e61-8122-fd9f0fb9e90c
temporal_sequences / main
Today, Anthony went to the basketball court. Between what times could they have…
Answer published by the source
Identifiers
task_id
016d3e82-528c-56dd-baaf-3477ec0ee319
task_key
temporal~5fsequences--main--016d3e82-528c-56dd-baaf-3477ec0ee319
tracking_shuffled_objects_five_objects / main
Alice, Bob, Claire, Dave, and Eve are friends and avid readers who occasionally…
Answer published by the source
Identifiers
task_id
00cd96c7-cbce-5ff5-a107-bc8053451d04
task_key
tracking~5fshuffled~5fobjects~5ffive~5fobjects--main--00cd96c7-cbce-5ff5-a107-bc8053451d04
tracking_shuffled_objects_seven_objects / main
Alice, Bob, Claire, Dave, Eve, Fred, and Gertrude are holding a white elephant…
Answer published by the source
Identifiers
task_id
003c6a73-0031-52e1-aef8-8493363cba2c
task_key
tracking~5fshuffled~5fobjects~5fseven~5fobjects--main--003c6a73-0031-52e1-aef8-8493363cba2c
tracking_shuffled_objects_seven_objects / main
Alice, Bob, Claire, Dave, Eve, Fred, and Gertrude are holding a white elephant…
Answer published by the source
Identifiers
task_id
00d0d788-704d-5455-8967-b11c65f6c8ba
task_key
tracking~5fshuffled~5fobjects~5fseven~5fobjects--main--00d0d788-704d-5455-8967-b11c65f6c8ba
tracking_shuffled_objects_three_objects / main
Alice, Bob, and Claire are dancers at a square dance. At the start of a song,…
Answer published by the source
Identifiers
task_id
00482bb7-c5da-5051-851a-31f1c3c522fe
task_key
tracking~5fshuffled~5fobjects~5fthree~5fobjects--main--00482bb7-c5da-5051-851a-31f1c3c522fe
tracking_shuffled_objects_three_objects / main
Alice, Bob, and Claire are friends and avid readers who occasionally trade…
Answer published by the source
Identifiers
task_id
004a45bf-af6f-5d7a-aeab-b36143fef183
task_key
tracking~5fshuffled~5fobjects~5fthree~5fobjects--main--004a45bf-af6f-5d7a-aeab-b36143fef183
tracking_shuffled_objects_three_objects / main
Alice, Bob, and Claire are friends and avid readers who occasionally trade…
Answer published by the source
Identifiers
task_id
00994289-7eee-5f47-baf7-03298d81f8f1
task_key
tracking~5fshuffled~5fobjects~5fthree~5fobjects--main--00994289-7eee-5f47-baf7-03298d81f8f1
web_of_lies / main
Question: Kandi tells the truth. Crista says Kandi lies. Ryan says Crista tells…
Answer published by the source
Identifiers
task_id
00e91fed-1a41-5227-81b3-fe9c8632acb7
task_key
web~5fof~5flies--main--00e91fed-1a41-5227-81b3-fe9c8632acb7
word_sorting / main
Sort the following words alphabetically: List: testy trench sin rheumatic…
Answer published by the source
Identifiers
task_id
016b2baf-5444-549d-a16e-ff8173c874f4
task_key
word~5fsorting--main--016b2baf-5444-549d-a16e-ff8173c874f4