benchmarks.wiki / Public workspace

    ..·:-=+++*******+++++======-------------:::::·····...····::--==+**########*++=--:···........·····:::::::::::::···.  
    ..·:-=+++******++++++=========---------::::····.......···:--=++*###%%%%##**+=--::··.......················:::::··.. 
    .··:-=+++******++++++===========------:::····.........··::-=++*##%%%%%%##*+==-::···....·············...····:::::··. 
   ..··:-=+++*****++++++++===========----:::···..........··::-=+**#%%%@%%%##*+==-::············:·····.......···:::::··. 
   ..·::-=++++***++++++++++==========---:::··....    ...··::-=+*##%%@@@%%#**+=--::········:::::::····.......··::::::·.. 
   ..·::-=+++++++++++++++++++++=====---:::··...      ...·::-=+*#%%@@@@%%#*++=-::·······::::---::::··.......··:::::::·.  
   ..·:--=++++++++++++++++++++++====---::··..        ..·:--=+*#%%@@@@%##*+=--::······:::--------::···.....··:::::::·..  
   ..·:--=+++++++++++++++++++++++===--::·...        ..·:-=+*#%%@@@@%%#*+==-::······:::--=====---:::········::-:::··..   
   ..·:--=+++++++++++++++++++++++==--::·..         ..·:-=+*#%%@@@@%%#*+=-::·······::--========---::::::::::---::··..    
   .··:--=++++++++++++++*****++++==-::·..         ..·:-=+*#%@@@@@%#*+=-::··...···::--===+++====---------------:·..      
   .··:--=++++++++++++********++==-::·..         ..·:-=*#%%@@@@%%#*+=-:··.....··::--====++=================--:·..       
   .··:--=++++++++++**********++=--:·..         ..·:-+*#%@@@@@%#*+=-::··.....··::---============+++++++++==-:·..        
   ...·::-==++++++++++====----::::::::---------------:::::::::::---==++******++==-:··.........·::--==++++++===-::···..  
   ..··:-=++++++++++++===----:::::::::------------::::::···::::--=++***####**+=--:·...    ...·::--==+++++====--::···..  
   ..·::-=+++***+++++===----:::::::::-----------:::::·····:::--=++**######**+=-:··..      ..·::-==++++++===----:::··..  
   ..·:-=+*******++++===---::::::::::--------:::::·······:::-==+*##%%%%%##*+=-:·..       ..·:--==++++++===-----:::··..  
   .··:-=+*******+++===---:::::::::::------::::·········::--=+*##%%@@@%%#*+=:··.        ..·:--=+++++++====------::··..  
   .·:-=+*###****+++==----:::::::::::---:::::··········::-=++*#%@@@@@@%#*+-:·..        .··:-==+++++++=========---:··..  
  ..·:-=+*####***++===---::::::::::::::::::····.....··::-=+*#%@@@@@@@%#*=-:·.         .··:-==+++++++===========--:··.   
  ..·:-=+*#####**++==---:::::::::::::::::···.......··::-=+#%@@@@@@@@%#+=-:·.        ..·::--==+++++=======+++++=-::·..   
  .··:=+*#%%###**++==---:::::::::::::::···.........·:-=+*#%@@@@@@@@%#+=-:·.        ..·::--============++++++++=-:·..    
  .·:-=+*#%%##**++==---::::::::::::::···....   ...·:-=+*#%@@@@@@@@%*+=-··.       ..··::-----=========+++****++=-:·.     
  .·:-=+*#%%##**++==----::::::::::::··...      ..·:-=+*#@@@@@@@@@#*+=-:·..    ...··::::----------===+++*****++=:·..     
  .·:-=+*#%%##*++==------------::::··..        .··-=+*#%@@@@@@@%#*+=-:··.....···:::::::::::::::---==++******+=-:·.      
   ...·······::::::-----=========================----:::·········::-==++*****++=--:·...    ..·:-=+*##%%%%%#**+=-:·..    
   ..···:::::::::-------------------==============--:::········::--=++******+==-:·..      ..·:-=+*#%%%%%%##*+=-::·...   
   ..··:::----------------------------======+====---:::······::--=++******++=-:·..       ..·:-=+*#%%@@%%##*++=-::··..   
  ..··::--======-------::::::::::::---====+++====---::::··:::--=++**###**+=-:·..         .·:-+*##%%@@%%##**++=--:··..   
  ..··:--=+++=====---::::·······::::--====+++====--:::::::---=++*#####**+=-:·.          .·:-+**#%%%%%%##**+++==-::·..   
  ..·:--=+***+++==--:::····...····::--==========---:::::--==+**##%%##**+-:·.           .·:-=+*##%%%####***++++=--:·..   
  .··:-=+*##***++=--::··........··::---=======----------=++*##%%%%%#*+=-:·.          ..·:-=++**####***********+=-:··.   
  .·:-=+*#%%##**+=--:··...  ....···::---====----------=++*#%%@@@@%##+=-:·.          ..·:-==++++*+++++++*******+=-:··.   
  .·:-+*#%@@%##*+=-:··..      ...··::---------------==+*#%%@@@@@%%#+=-:·.         ..··:--===========++++***###*+=:··.   
  .·-=+*#%@@@%#*+=-:·..       ..···:::::::::::::---=+**#%@@@@@@%%*+=-:·.        ..··:::------------===++**####*+=:··.   
  .:-=+*#%@@@%#*=-:··..      ...···:::::::::::::--=+*#%%@@@@@@%#*+=-:·.... ....··::::--::::::··::::--=++*#####*+=:·..   
  ·:-=+*#%@@@%*+=-:·...     ....·············::--=+*##%@@@@@%%#*+=-::···.····:::------::····...···::-=++*#####*+=:··.   
  ........       ..··::-==++************+++++====--:::··....  ...··::-=++******+=--:··.....··:-=+*#%@@@@@%#*+=-:·..     
  ................···::--====++++++++++++++++++++==--::··.......··::-==++++++==-:··.......·:-=+*#%@@@@@@%#*+=-:··..     
  ...···············:::::-------=====++++*******++==-::···.....··::--==++===-::·...   ..··:-+*#%@@@@@@@%#**+=-:··..     
  ..····::::::::::::::::::::::::::--==++**######**+==-::·······::---====--::··.       .·:-=+*#%@@@@@@@%#**+==-:··...    
  ..··::---------::::·····....····:--=++*###%%###*++=--:::::::----====--::·..        .·:-=+*#%@@@@@@%%#**+===--:··..    
  ..·::-==++====--::···...     ..··:-=++*##%%%%##**+==--------======--::·..         .·:-=+*#%%@@@%%%#**+++====-::··..   
  .··:-=+*****++=--:·..         ..·:-=+**#%%%%%##**+++======+++++==--:·..          .·:-=+**##%%%###**++++======--:·..   
  .·:-=+*#%%##*+=-:··.           .·:-=+**#######****+++++******++=--:·.           .·:-=++********+++=====++++++=-::·.   
  .·:=+*#%@@@%#*=-:·.            .·:-=++**#####*********#####**+==-:·.          .··:-==+++++++====---====+++**++=-:·.   
  .·-=+*#%@@@%#*=-:.             .·:-==++***********####%%%##**+=-:·..        .··:--===++===----::::---==+***#*+=-:·..  
  ·:-=+*#%@@@%#+=:·.            .··:--===++++++****##%%%%%%#**+=-:··..    ...·::--=======--:::·····::--=++*####*+-:·..  
  ·:-=+*#%@@@%*+-:.            ..··::---=====+++**##%%%%%%#**+=-:··......···:--=======--::··......··::-=+**#%%#*+=-·..  
  ...··....      ...·::-==+****##*****++++++++++===--::··..       ..··:-==++***++==--:::::--=++*#%%%%%%#*+=-:·..        
  ...····.........··::---====++++====+++++********++=--:·..       ..··:---====----::::::-==+*#%%@@@@@%%#*+-::·.         
  ...·············:::::--------------==++*###%%%%##*+=-::·..     ...··:::::::::·····:::-=+*#%@@@@@@@@%#*+=-:·..         
  ..····::::::::::::::::::·········:--=+*#%%@@@@@%%#*+=-:··........·········......··::-=+*#%@@@@@@@@%#*+=-:··...        
  ..··::--======----:::··...    ..··:-=+#%@@@@@@@@%#*+=--:····..·····......     ..··:-=+#%@@@@@@@@@%#*+=-::··.....      
  ..··:-==++++++==--:··..         .·:-+*#%@@@@@@@@%#*++=--:::·······...         ..·:-=+*%@@@@@@@@%#**+=-::·····.....    
  ..·:-=+*####**+=--:·.           .·:=+#%@@@@@@@@@%#**+===---:::···..           .·:-=+*#%@@@@@@%%#*+==-:::········...   
  ..·:=+*#%%%%#*+=-:·.            .:-=*#%@@@@@@@@%%#***++===---::··.           .·:-=+*#%%@@@@%%#*++=--::::::::::···..   
  .·:-=*#%@@@@%*+=:·.            .·:-+*#%%@@@@@%%%###****+++==-::·..          .·:-=+**#%%%%%##*+==--::::::::---:::··.   
  .·:=+*#%@@@@#*+-:.            .·:-=+*###%%%%%########****+==-:··.         ..·:-=++*######**+==--::::::::---=---:··..  
  .·-=+*#%@@@%#+=:·.           ..·:-=++**********########**+==-:·..        .··:-=++*******++=--:::····:::--=====-::·..  
  .:-=+*#%@@%#+=:·.           .··:--===++++++++****######**+=-::·...    ...·:--=++*****++==--::·······::--==+++==-:·..  
  ..··:::::::::::::---=====+=====---::::---==++******++=-:··.        ..·::--==++++++++++++**###%%%%##*+=-:··.           
  ..··:::----------========---:::·····::--=+*##%%%%%#*+=-:·..        ..··:::------====++*##%%@@@@@@%#*+=-:·.            
   .··:::--========+====---:···......··:-=+*#%@@@@@@%#*=-:·..        ...·····::::---=++*#%@@@@@@@@@%#*=-:·.             
   ..·::--==+++++*++++=--:··..     ..·:-=+#%@@@@@@@@%#+=-:·...       ........···::--=+*#%@@@@@@@@@@#*+-:·.              
   ..·::-=+****##***+=--:·.        ..·:=+#%@@@@@@@@%#*+=-:··............  .....··:-=+*#%@@@@@@@@@@%*+=-:·.              
   ..·:-=+*###%%##**+=-··.         .·:=+*%@@@@@@@@%#*+==-::···.......        ..··:-=+*%@@@@@@@@@@%#+=-:·.               
   ..·:-=*#%%%%%%#*+=-·..         .·:-+*#%@@@@@@@%#**+==--:::····....        ..··:=+*#%@@@@@@@@@%#*=-:·..               
   ..·:-+*%%@@%%#*+=-:..         .·:-=*#%%@@@@%%##*++===----:::···..         ..·:-=+#%@@@@@@@@@%#*+=-:·..               
   ..·-=+#%@@%%#*+=-:·.        ..·:-=+*#%%%%%##**+++======----::··..        ..·:-=+*#%@@@@@@@%%#*+=-:··..      .....    
   .·:-=*#%%%##*+=-··.       ..·:-=++**####***++++==========--::··..       ..··:-=+*#%@@@@@@%#**+=-:··...............   
   .·:-=+*###*+=-:··.      ..·:--=++*****+++==========++++===--:··..      ..··:-=+*##%%%%%%##*++=-::··...............   
   .·:-=++*++=-::·........·::-==++++++++===------====++++++==--:··...   ...··:-==+*##%%%%##**+==-::··........·····...   
   .·:-=+*######*******++==--:·..        .·:-=+*#%@@@@%%#*=-:·..      ...·::---====++++****###%%%##**+=-:·..            
   .·:-=+*######%%%####*+==-:·.         .·:-=+#%@@@@@@%#*+-:··..     ...··:::----====++**##%%%@@%%##*+=-:·.             
   ..·:-=+*##%%%@@@@%%#*+=-:·.         ..:-=+#%@@@@@%%#*=-::·..........····:::::---==+**#%%@@@@@@%##*=-:·.              
   ..·:-=+*#%%@@@@@@@%#*+=:·.         .·:-=+#%%@@@%%#*+=-::··.......·········::::--==+*##%@@@@@@@%#*+=-·..              
    ..·:-+*#%@@@@@@@@%#+=-:·.        .·:-=+*#%%%%##*+==-::·····················::--=++*#%@@@@@@@@%#*=-:·.               
     .·:-=*#%@@@@@@@%#*=-:·..      .·:--=+*#####**+==-:::········::::··········::--=+*#%%@@@@@@@%#*+=-·..               
     ..·-=*#%%@@@@%%#*+=::·.......·:--=++*****++==--:::····:::::::::::·········::-==+*#%@@@@@@@%%#+=-:·.                
     ..·:=+*#%%%%%#*+==-:·······::-==++****++==--::······:::::----::::·········:--=+*##%@@@@@@@%#*+=-:·.                
      .·:-++******++=--:::::::--=++******++==-::········:::--------:::········::-==+*#%%@@@@@@%#*+=-:·..                
      .·:-========----:::---=++**#####**+==-::··.....···::----=----:::·······::--=++*#%%@@@@%%#**+=-:·.                 
      ..·:::--:::::::::--=++*##%%%%%##*+=-::··......···::---====---:::·······::-==+**#%%%@%%%##*+=-:··.                 
      ...···········::-=++*#%@@@@@@%#*+=-:··........··::--======---:::······::--==+*##%%%%%%##*+==-:·..                 
   .·:=+*%@@@@@@@@@@@%%#*+=-:·.            .·:=+#%@@@@@@@%#*+=-::········::::-----------===+++*******++=-::·..          
   .·:-=+#%@@@@@@@@@@@@%#*+-:·.            .:-=+*#%%%%%#**+=--:::::::::::---------------===++*******++==-:··.           
   ..·:-=+##%@@@@@@@@@@@#*+-:·.          ..·:-=+******++==--:::::::-----===------:::----===++*******++=-::·..           
    ..·:-=+*#%@@@@@@@@@@%*+-:·.         .·::-===++===---::::::::---==========---:::::---==++********+==-:·..            
     ..·:-=+*#%@@@@@@@@%#*+=-:·.......···::-------:::·······::--==++++++++===---:::::---==++*******++=-::·.             
       .·:-=+#%@@@@@@@@%#*+=--:::··::::------:::··........··::-==++*****+++==---:::::--===++******++==-:·..             
        .·:-+*##%@@@@%%#**++=============--::··..       ..··:-=++**###***++==---::::---==+++*****++==-::·..             
         .·:-=+**#######**************++=--:·..          .·:--=+**#####**++==---:::----==+++*****++=--:··.              
         .··:-==++++*****###%%%@@@@%%#*+=-:·.            .·:-=+**######**++==---------===+++***+++==-::·..              
          ..··::--===+**##%@@@@@@@@@@%#+=-·.            ..·:-=+**######**++==---------===++++++++==--:··..              
            ...··::-==+*#%@@@@@@@@@@@%*+-:·.            .·:-=++*######**+++==--------===+++++++++==-::·..               
               ..··:-=+#%@@@@@@@@@@@@%*=-·.             .·:-=++*#####***++===-------====++++++++==--:··..               
  ..·:-+*#%%%%%@@@@@@@%%#*+=-:·.             .:-=+*##%%%%##**+++=========------:::·········:::-==++*******++=-:·..      
   .·::-=+**###%%@@@@@@@%#*+=-:·.           .·::-==+++++++++=====+++++++++++==--::···....···::--=++******++==-:·..      
   ..··::-==+**#%@@@@@@@@%#*+-:·..         ..··:::-----------===++**######**+==-::··......···:--==++*****++==-:·..      
    ....··:-=++*#%@@@@@@@%#*+=-::·..........··············::--=+**#%%%@@%%##*+=-::··.......··::-==++****+++=--:·..      
        ..·:-=+*#%@@@@@@@@%#*+==--:::·······.....       ..··:-=+*#%@@@@@@@%#*+=-::·........··::-==+++**+++==-:··..      
          .·:-=+*#%@@@@@@@%##**+++===---::··..           ..·:-+*#%@@@@@@@@@%#+=-::·.........·::--==+++++++=--:··.       
          ..·:-=+*#%%%@@@%%%%%####***+==-:··.             .·:=+*%@@@@@@@@@@%#*=-::·.... ....··:--==++++++==--:·..       
           .·:--=+**##%%%@@@@@@@@@%%#**+-:·.              .·-=+#%@@@@@@@@@@%#*=-::·.... ....··:--===++++==--::·..       
           ..·::-==+**##%@@@@@@@@@@@@%*+=:·.              .·-=*#@@@@@@@@@@@%#*+-::·.... ....··::--========--::·...      
            ..··:--=++*#%@@@@@@@@@@@@%#+=:·               .:-+*%@@@@@@@@@@@%#*+-::·.........··::--=======---::·...      
             ...·::-=+*#%@@@@@@@@@@@@%#+-:.               .:-+*%@@@@@@@@@@@%#*=-::·.........··::---=====---::··...      
               ..··:-=+#%@@@@@@@@@@@@%#+-·.               ·:=+#%@@@@@@@@@@@%#*=--:··........··:::---------:::··....     
  .··:---===-----==++***##**++=-:··.        ..··:--==++++++++++++++++++++++==--::··....  ....·::-=+**#%%%%%%##+=:·..    
  ..··::::::::::-==+*###%%##*++=-:··..     ...···:::------====+++***######**+==-::·..       ..·:--=+*#%%%%%%%#+=:·..    
  ..........···:-=+**#%%%%%##*+==-::··..........········:::--==+**#%%%@@%%%#*+=--:·..        .··:-=+*#%%%@%%%#+=-·..    
   ...     ...·:-=+*##%%%%%%#**+==--:::····..............··::-=+*#%@@@@@@@@%#*+=-:·.         ..·:-=+*##%%@%%%#+=-·..    
            ..·:-=+*##%%%%%%##**++===--:::··...          ..·:-=+#%@@@@@@@@@@%#+=-:·.          .·:-=+*##%%@%%%#*=-·..    
            ..·:-=+**##%%%%%####***++==--::·..            .·:-=*#%@@@@@@@@@@%#*=-:·.          .··:-+**#%%@%%%#*=-··.    
            .··:-=++**####%%%%%####**++=--:·.             .·:-+*%@@@@@@@@@@@@#*=-:·.          ..·:-=+*#%%%%%%#*=-:·.    
           ..·::-==++***###%%%%%%%%%#**+=-:·.              ·:-+*%@@@@@@@@@@@@%*=-:·.           .·:-=+*#%%%%%%#*=-:·.    
          ..··::--===++**##%%%@@@@@%%#*+=-:·.              ·:-+#%@@@@@@@@@@@@%*=-:..           .·:-=+*##%%%%%#*=-:·.    
        ...···:::---==++**#%%@@@@@@@%%#+=-:·.              ·:=+#@@@@@@@@@@@@@%*=-:.            .·:-=+*##%%%%##*=-:·.    
      ...·····:::::---=++*#%%@@@@@@@@%#+=-:.              .·:=*#@@@@@@@@@@@@@%*=-·.            .·:-=+**##%%%##+=-:·..   
    ...···::······:::--=+*#%%@@@@@@@@%#+=-·.              .·:=*%@@@@@@@@@@@@@%*=-·.            ..·:-=+*#######+=-:·..   
  .·::::··.       ..·:-=++*####**++=--::········:::::---------========++++====---:::·········::--=++*###%%%%##+=-··.    
 ..·····..        .·:-=++*#####**++==--::::·······::::::::::----===+++*****+++==--::··.......··:--=+**##%%%%%#*=-:·.    
  .···..         .··:-=+**####***++==----:::::·············:::--==++**######**+==-::·.........··:-==+*##%%%%%%*+-:·.    
  .....         .··:-=++*********+++===----:::·····.......···::-=++*##%%%%%##**+=-::·..      ..·::-=+*#%%@@@@%#+=:·.    
  ....         .··:--=+++*******+++++====---::···....   ....·::-=+*##%%@@@@%%#*+=-:··..       ..·:-=+*#%%@@@@@#+=-·..   
   ..       ...··:--===++++++++++++++++===--::··...       ..··:-=+*#%@@@@@@@%##+=-:··.         .·::=+*#%%@@@@@#*=-:..   
       .....···:::---=======+++++++++++++==--:··..         .··:-=*#%@@@@@@@@@%#*+-:·..         ..·:-=*#%%@@@@@%*+-:·.   
    .....··::::----------=====+++++***+++==--:··.          .··:=+*#%@@@@@@@@@%#*+-:·.           .·:-=+#%@@@@@@%#+-:·.   
   ...··::------------------===+++*****+++=--:·..          .··-=+*%@@@@@@@@@@@#*+-:·.           .·:-=+#%@@@@@@%#+=:·.   
   ..··:--======----::::::---==+++******++=-::·..          .·:-=+#%@@@@@@@@@@@%*+-:·.            .·-=+*%@@@@@@%#+=:·.   
   .··:-=+++++==---:::::::::--==++******++=-::·.           .·:-=*#%@@@@@@@@@@@%*+-:·.            .·:=+*%@@@@@@%#*=-·.   
  ..·:-=+****++=--:::····:::--==++******++=-:··.           .·:-=*#@@@@@@@@@@@@%*+-:.             .·:=+*%@@@@@@%#*=-:..  
 .··::··.            ..:-=+*#%%%%%%%##**++==---:::::·············::::----===============------=======++++++===-:··..    
 .·····..            .·:-=+**##%%####**+++===---::::·············::::--====++++++++====------------====++++++==-:·..    
 ..···..            .·:--=++***###*****++++===---:::····......····::--===+++***++++===----:::::::----===++++++=-::·.    
  .··...          ..··:--==++++*******++++++===---::···........···::--==++*******+++==--:::::··::::---==+++***+=-:·..   
  .......       ...··::----====++++++++++++++===--::···.........··::-==++**####***++==--::········::--==++****++=-:·.   
  .............·····:::::------====+++++**++++==--::··..........··:--=++**#######*++=--::···.....··::--=+**###*+=-:·.   
  ...·····::::::::::::::::::::---===+++*****+++=--::··...    ...··:-==+**##%%%%##**+=--:··........··:--=+*##%%#*+=:·..  
  ..···::---------:::::······:::---==++******++==-::··...    ...··:-=+**#%%%%%%%#**+=-:··..      ..·::-=+*#%%@%#*=-:·.  
  ..·::-==++++===--:::·········::--==++******++==-::·...     ...·::-=+*#%%@@@@@%##*+=-:·..        .··:-+*#%@@@%#*+-:·.  
  ..·:-=+*#***++==-::··.......··::-==++*******+==-::·...      ..·:--=+*#%@@@@@@%%#*=-:·..         ..·:=+*#%@@@%#*+=:·.  
  .·:-=+*#%%##**+=-::·.........··:--=++*******++=-::·...      ..·:-=+*#%@@@@@@@%%#+=-:·.           .·:=+*%@@@@%#*+=:·.  
  .·:-+*#%@@@%#*+=-:··..     ...·::-=++***#***++=-::·..      ..··:-=+*#%@@@@@@@%#*+=-·.            .·-=+#%@@@@%#*+=:·.  
  .····..             .·:-+*#%@@@@@@@@@%%#*+==-::···....     ....···::--===++************++++===----::::::······....    
  .····..            ..·:-+**#%%@@@@@%%%##*++=--::···....     ....··::--==++***#######***+++==---:::::·······:····...   
  .···...           ..·:--=+**##%%%%%%###**++==--::··....      ....··::-==++**#########**++==--:::··········::::···..   
  ..··...          ..··:--==++***#######****++==--::··...       ...··::-==+**##%%%%%###**++=--::····...····:::::::··..  
  ...··.....    ....··:::--===+++***********+++==--:··...        ..··::-=++*##%%%%%%%##**+=--::··.......···::----::··.  
  ...········..·······::::----===+++*********+++=--::··..        ...·::-=+**#%%@@@@%%%#*++=-:··...    ...·::-====--:·.  
  ..····:::::::::::::::::::::----==+++********++==--:··...        ..·::-=+*#%%@@@@@@%%#*+=-:··..       .··:-=+++==-:·.  
  ..··:::--------::::::·····::::---==++********++==-::·...        ..·::-=+*#%@@@@@@@%%#*+=-:·.         .·:-=+***++=-·.  
  ..··:--=======---:::·········:::--=++***###***++=--:··..        ..·:--+*#%%@@@@@@@%#*+=-:·.         ..·:-+*###*+=-:.  
  ..·:--=+***+++==--::···.....···::-==++**#####**+==-:··..        ..·:-=+*#%@@@@@@@@%#*+=:·.          .·:-=+#%%#*+=-·.  
  ..·:-=+*###**++=--::··........··:--=++**######*++=-:··..        ..·:-=+*#%@@@@@@@@%#+=-:·.         ..·-=+*#%%#*+=-·.  
  .·:-=+*#%%%##*++=-:··...    ...··:-=++*###%%###*+=--:·..        ..·:-=+*%@@@@@@@@%#*+-:·.          .·:-+*#%%%#*+-:·.  
  ........           .·:-=+*%@@@@@@@@@@@%#*+=-:·..            ..··:--=++**###%%%%####***++==--:::···..................  
  .......           .··:-=+*#%@@@@@@@@@%#**+=-:··..           ...·::-==+**###%%%%%%%###**++=--::··....     ....·····..  
  .......          ..·:-==+*#%%@@@@@@@%%#*++=-::·..            ..··:--=++*###%%%%%%%%%##*++=--:··..         ..·······.  
  ........       ...·::-==+*##%%%%%%%%##**+==-::··..           ..··::-==+**#%%%@@@@@@%%#**+=-::·..          ..··::::·.  
   ...............···:--==+**####%%%###***+==--:···..          ...··:--=+**#%%@@@@@@@@%%#*+=-:·..           .··::-::··. 
   .............···:::--==++****######***++==--::··....         ..··::-=++*#%%@@@@@@@@@%#*+=-:·.            .·:-----:·. 
   ....··········::::---===++++*********+++===--::···...        ...··:--=+*#%@@@@@@@@@@%#*+=:·.            .·:-====-:·. 
   ...····::::::::::----=====+++++++++++++++===--::···...        ...·::-=+*#%@@@@@@@@@@%#*+-:·.            .·-=====-:·. 
   ...···:::::::----------========++++++++++====--:::··...        ..··:-=+*#%@@@@@@@@@@%#*=-·.            .·:==++==-:·. 
   ..···::----------------------=======+++++++===---::··...        ..·::-+*#%@@@@@@@@@@%#+=:·.           .·:-=+++=-:·.  
   ..··::--=========----------------====+++++++++==--::··..         ..·:-=*#%@@@@@@@@@@%*+-:·.          .·:-=++==-::·.  
   ..··:--===========----::::::::::---===++++**++++==-::·..          .·:-=+#%@@@@@@@@@%#*=-:·.        ..·:--===--:··..  
    ..............··::-==+*#%%@@@@@@@@%##*+=-:·.             ..·:-=+**#%%@@@@@@%%##*++==--::···.....       ...·······.  
    .............···:--=+**#%%@@@@@@@%%#*+=-:··.             ..·:-=++*#%%@@@@@@%%%#**++==--::··...           ..······.. 
    ............···::-==+*##%%@@@@@@@%##*+=-:·..             ..·:-==+*##%%@@@@@%%%##**++==-::··..            ..··:::··. 
    ...........···::--=++*##%%@@@@@@%%#*+==-:·..            ..··:--=+**##%%%@@@@%%%%##**+==-:··.              .·:::::·. 
    ..........····::-==+**##%%@@@@%%%#**+=-::·..            ..··:--=++**##%%%%@@@@%%%##**+=-:··.             .··:---:·. 
    .........····::--=++**##%%%%%%%%#**+==-::·..           ...··::-==++**##%%%@@@@@@@%%#**+=:·.              .·:----:·. 
    ......······::--==++**##%%%%%%##**++=--:··...         ...···::--==++**##%%%@@@@@@@@%#*+=-·.              .:-----:·. 
    ......·····:::--=++***###%%%###**++==-::···....   .......···:::---==++*##%%@@@@@@@@%%*+=-·.             .·:-----:·. 
    .....·····:::--==++***#######***++==--::···...........········:::---=++*#%%@@@@@@@@@%#+=-·.            .·::---::·.  
    .....····:::--==+++***#####***++===--:::·························::--=++*#%@@@@@@@@@%#+=-·.           ..·:::::··..  
    .....···:::--===++**********+++==---:::::····::::::::::·····....···::-=+*#%@@@@@@@@@%*+=-:·.        ..···::···..    
    ....···:::--===+++********++===---:::::::::::--------:::···........·::-=+*#%@@@@@@@%#*+=-::··.....·········..       
     ..··:------=======+++****######***++=--:··..           .··:-=+**#%%@@@@@%%##*+==-::···.................·····::··.. 
    ...··:-------=====+++****#######**++==-::·..           ..·::-=+*#%%@@@@@@%%#**+==--::····......         ..···:::··. 
    ...··::------====++++***########**++=--:··..           ..·:-=++*#%%@@@@@%%##**+==---::····...            ..·:::::·. 
    ...··:::-----====+++***########***+==-::·..           ..·::-=+*##%%%@@%%%###**++==---:::···..            ..·::-::·. 
    ...··:::-----===+++***#########**++=--:··..          ..··:-=++*##%%%%%%%###**++++===---::··..            .··:---:·. 
    ...··::::----===+++**##########**+==-:··..          ..··:--=+**#########*****+++++++==--::·..            .·::---:·. 
    ...··::::----===++***####%%###**++=-::·..          ..··:--=++****##*******++++*****+++==-:·..           .··::--:··. 
    ...··::::----==+++**####%%####*++=--:··..         ..··:--==++*****+++++++++++********++=-:·..           .·:::::··.  
    ...···:::---===++**####%%%###**+=--:··..        ...·::-===++++++++========+++**#####**+=--:·.         ..··:::··..   
    ...···:::---==++***###%%%%##**+==-:··..       ...··:--==++++++===--------==++**######*++=-:··.........·······..     
    ...···:::---==++**###%%%%##**+==-:··..       ..··:--==++++++==--::::::::--=++*#######**+==-:::············..        
    ...···:::--==++**###%%%%##**+==-:··..      ..··:--=+++**++==--::·······::-==+**######**++====--------::··.

Pause animation

BIG-Bench Extra Hard (BBEH) / Tasks

Choose a problem to read its original content, examples and discussion.

Option counts cover the whole public benchmark.

Clear filters

1–50 / 4513 tasks

bbeh_boardgame_qa / full
A few players are playing a boardgame. The current state of the game is as…
Answer published by the source
Identifiers
task_id
0278794d-5037-565a-8d68-42271f1bdc83
task_key
bbeh~5fboardgame~5fqa--full--0278794d-5037-565a-8d68-42271f1bdc83
bbeh_boolean_expressions / full
From the following five expressions, only one evaluates to true. Which one is…
Answer published by the source
Identifiers
task_id
0308d0b7-ca43-5f8e-a040-4371b30924c8
task_key
bbeh~5fboolean~5fexpressions--full--0308d0b7-ca43-5f8e-a040-4371b30924c8
bbeh_buggy_tables / full
I have a table with 36 rows (including the header) and 18 columns. The table was…
Answer published by the source
Identifiers
task_id
003a20b7-d411-5a1e-9b3b-0576dc552638
task_key
bbeh~5fbuggy~5ftables--full--003a20b7-d411-5a1e-9b3b-0576dc552638
bbeh_buggy_tables / full
I have a table with 31 rows (including the header) and 18 columns. The table was…
Answer published by the source
Identifiers
task_id
026e45c8-35fd-5f73-beca-0dfca3ec7b8b
task_key
bbeh~5fbuggy~5ftables--full--026e45c8-35fd-5f73-beca-0dfca3ec7b8b
bbeh_buggy_tables / full
I have a table with 35 rows (including the header) and 18 columns. The table was…
Answer published by the source
Identifiers
task_id
0283b1f5-9a95-5659-ab50-ecbbc06eafec
task_key
bbeh~5fbuggy~5ftables--full--0283b1f5-9a95-5659-ab50-ecbbc06eafec
bbeh_buggy_tables / full
I have a table with 26 rows (including the header) and 18 columns. The table was…
Answer published by the source
Identifiers
task_id
029bb740-6062-5e0f-967a-334a4c366fcf
task_key
bbeh~5fbuggy~5ftables--full--029bb740-6062-5e0f-967a-334a4c366fcf
bbeh_causal_understanding / full
Question: Joe was about to go pick up his child from a school in the suburbs. In…
Answer published by the source
Identifiers
task_id
013f7dc1-cb91-530e-8c3b-c2c2e65a7d76
task_key
bbeh~5fcausal~5funderstanding--full--013f7dc1-cb91-530e-8c3b-c2c2e65a7d76
bbeh_causal_understanding / full
Question: Tom has a huge garden and loves flowers. He employed two gardeners who…
Answer published by the source
Identifiers
task_id
02e66609-68b7-5ff5-a9b1-7372ec50c987
task_key
bbeh~5fcausal~5funderstanding--full--02e66609-68b7-5ff5-a9b1-7372ec50c987
bbeh_disambiguation_qa / full
Here is a sentence with pronoun(s) whose antecedent(s) can either be derived…
Answer published by the source
Identifiers
task_id
00878d02-f8c5-5341-a8f1-fe3525f296b4
task_key
bbeh~5fdisambiguation~5fqa--full--00878d02-f8c5-5341-a8f1-fe3525f296b4
bbeh_disambiguation_qa / full
Here is a sentence with pronoun(s) whose antecedent(s) can either be derived…
Answer published by the source
Identifiers
task_id
028e6665-0d6d-5436-8300-1b34f2ea59f7
task_key
bbeh~5fdisambiguation~5fqa--full--028e6665-0d6d-5436-8300-1b34f2ea59f7
bbeh_dyck_languages / full
You are an expert in a language called dyck where you must complete the language…
Answer published by the source
Identifiers
task_id
009f54de-5b16-56e9-9efb-4ee22f2b47e4
task_key
bbeh~5fdyck~5flanguages--full--009f54de-5b16-56e9-9efb-4ee22f2b47e4
bbeh_dyck_languages / full
You are an expert in a language called dyck where you must complete the language…
Answer published by the source
Identifiers
task_id
018d7cb3-9eb4-595a-bf07-93c4a18f2bfd
task_key
bbeh~5fdyck~5flanguages--full--018d7cb3-9eb4-595a-bf07-93c4a18f2bfd
bbeh_geometric_shapes / full
Suppose we draw this SVG path element: M 19.03578,0.0 L 16.93423,0.0 M…
Answer published by the source
Identifiers
task_id
0054a0ef-e3be-51e2-b514-56740fb0d34f
task_key
bbeh~5fgeometric~5fshapes--full--0054a0ef-e3be-51e2-b514-56740fb0d34f
bbeh_geometric_shapes / full
Suppose we draw this SVG path element: M 22.697,21.71258 L 16.697,28.9511 M…
Answer published by the source
Identifiers
task_id
0102a81a-31eb-53f1-97a0-fcf0ec0722c8
task_key
bbeh~5fgeometric~5fshapes--full--0102a81a-31eb-53f1-97a0-fcf0ec0722c8
bbeh_geometric_shapes / full
Suppose we draw this SVG path element: M 7.69681,0.0 L 12.69681,2.88675 M…
Answer published by the source
Identifiers
task_id
02d94a88-d820-5352-90a6-8c253b2090f4
task_key
bbeh~5fgeometric~5fshapes--full--02d94a88-d820-5352-90a6-8c253b2090f4
bbeh_hyperbaton / full
In a variant of English, we are given that the following sentences have correct…
Answer published by the source
Identifiers
task_id
02170807-6db0-504a-8050-2f05d469777e
task_key
bbeh~5fhyperbaton--full--02170807-6db0-504a-8050-2f05d469777e
bbeh_linguini / full
Proto-Chamic is the theorized common ancestor of all the languages in the Chamic…
Answer published by the source
Identifiers
task_id
013f0302-fcec-5e73-841d-0daa2ccf615f
task_key
bbeh~5flinguini--full--013f0302-fcec-5e73-841d-0daa2ccf615f
bbeh_linguini / full
Here are some words in Rikbaktsa and their English translations:
Answer published by the source
Identifiers
task_id
01c2a642-f373-5f46-9431-15d1440331e2
task_key
bbeh~5flinguini--full--01c2a642-f373-5f46-9431-15d1440331e2
bbeh_movie_recommendation / full
Which option has more similar movies in terms of whether a group of people will…
Answer published by the source
Identifiers
task_id
000d807a-a466-526a-8898-e781855857e2
task_key
bbeh~5fmovie~5frecommendation--full--000d807a-a466-526a-8898-e781855857e2
bbeh_movie_recommendation / full
Which option has more similar movies in terms of whether a group of people will…
Answer published by the source
Identifiers
task_id
005f6d98-8e8a-51cf-9e5d-1424d0a64661
task_key
bbeh~5fmovie~5frecommendation--full--005f6d98-8e8a-51cf-9e5d-1424d0a64661
bbeh_movie_recommendation / full
Which option has more similar movies in terms of whether a group of people will…
Answer published by the source
Identifiers
task_id
00bb61de-1444-53c2-adcf-46ef2e5e3d26
task_key
bbeh~5fmovie~5frecommendation--full--00bb61de-1444-53c2-adcf-46ef2e5e3d26
bbeh_multistep_arithmetic / full
Consider the following new operations:
Answer published by the source
Identifiers
task_id
006b5b24-237d-5994-8217-2d55c54e6cce
task_key
bbeh~5fmultistep~5farithmetic--full--006b5b24-237d-5994-8217-2d55c54e6cce
bbeh_multistep_arithmetic / full
Consider the following new operations:
Answer published by the source
Identifiers
task_id
00d42f84-79a1-5683-983a-9fbbbe9703c2
task_key
bbeh~5fmultistep~5farithmetic--full--00d42f84-79a1-5683-983a-9fbbbe9703c2
bbeh_multistep_arithmetic / full
Consider the following new operations:
Answer published by the source
Identifiers
task_id
01638b37-2610-5725-a150-4e82daebc0ed
task_key
bbeh~5fmultistep~5farithmetic--full--01638b37-2610-5725-a150-4e82daebc0ed
bbeh_multistep_arithmetic / full
Consider the following new operations:
Answer published by the source
Identifiers
task_id
019c7e27-f8b6-52de-ad66-609c2eba55a7
task_key
bbeh~5fmultistep~5farithmetic--full--019c7e27-f8b6-52de-ad66-609c2eba55a7
bbeh_multistep_arithmetic / full
Consider the following new operations:
Answer published by the source
Identifiers
task_id
02ac5e65-3a00-5fb8-b359-37fa92287665
task_key
bbeh~5fmultistep~5farithmetic--full--02ac5e65-3a00-5fb8-b359-37fa92287665
bbeh_nycc / full
The following is a description of a funny cartoon for the New Yorker Caption…
Answer published by the source
Identifiers
task_id
00502bea-4ed9-57e0-9255-c91d047c3d75
task_key
bbeh~5fnycc--full--00502bea-4ed9-57e0-9255-c91d047c3d75
bbeh_object_counting / full
My grandmother has 46 cheetahs. I have 32 toyota tundra cars (feeling good about…
Answer published by the source
Identifiers
task_id
008904e8-3ce9-5ab9-b8ef-3bed8ce4d56f
task_key
bbeh~5fobject~5fcounting--full--008904e8-3ce9-5ab9-b8ef-3bed8ce4d56f
bbeh_object_counting / full
My cousin has 65 hamsters. I have 61 quinces (it is a funny story how I have 61…
Answer published by the source
Identifiers
task_id
00c6eb9c-ffd1-5a27-a8e0-e5af02818246
task_key
bbeh~5fobject~5fcounting--full--00c6eb9c-ffd1-5a27-a8e0-e5af02818246
bbeh_object_properties / full
I had a collection of 46 weird items that went through a few changes. Initially,…
Answer published by the source
Identifiers
task_id
00391bef-f885-5764-b36d-a111114db3b2
task_key
bbeh~5fobject~5fproperties--full--00391bef-f885-5764-b36d-a111114db3b2
bbeh_object_properties / full
I had a collection of 32 weird items that went through a few changes. Initially,…
Answer published by the source
Identifiers
task_id
0189ba89-c9a8-5984-b250-0944df49724b
task_key
bbeh~5fobject~5fproperties--full--0189ba89-c9a8-5984-b250-0944df49724b
bbeh_object_properties / full
I had a collection of 37 weird items that went through a few changes. Initially,…
Answer published by the source
Identifiers
task_id
018b072b-3418-53e0-9ca8-79c8b788ae35
task_key
bbeh~5fobject~5fproperties--full--018b072b-3418-53e0-9ca8-79c8b788ae35
bbeh_object_properties / full
I had a collection of 31 weird items that went through a few changes. Initially,…
Answer published by the source
Identifiers
task_id
0224ea9a-c0a2-5fe3-845a-7e3bca8568ce
task_key
bbeh~5fobject~5fproperties--full--0224ea9a-c0a2-5fe3-845a-7e3bca8568ce
bbeh_sarc_triples / full
Here are three (post, reply) pairs from Reddit. Your task is to decide whether…
Answer published by the source
Identifiers
task_id
0289011f-50f3-5118-93c4-61cbff6f4641
task_key
bbeh~5fsarc~5ftriples--full--0289011f-50f3-5118-93c4-61cbff6f4641
bbeh_shuffled_objects / full
Alice, Bob, Claire, Dave, Eve, Fred, and Gertrude are holding a white elephant…
Answer published by the source
Identifiers
task_id
0068ef9a-ba60-5995-9f48-db327d1c80c2
task_key
bbeh~5fshuffled~5fobjects--full--0068ef9a-ba60-5995-9f48-db327d1c80c2
bbeh_shuffled_objects / full
Alice, Bob, Claire, Dave, Eve, Fred, and Gertrude are playing a game. At the…
Answer published by the source
Identifiers
task_id
0082d0ba-898e-5ad4-835e-a3ccc68ee4b9
task_key
bbeh~5fshuffled~5fobjects--full--0082d0ba-898e-5ad4-835e-a3ccc68ee4b9
bbeh_shuffled_objects / full
Alice, Bob, Claire, Dave, Eve, Fred, and Gertrude are holding a white elephant…
Answer published by the source
Identifiers
task_id
00fd2579-1fbb-5159-b801-474e1c11eba6
task_key
bbeh~5fshuffled~5fobjects--full--00fd2579-1fbb-5159-b801-474e1c11eba6
bbeh_spatial_reasoning / full
You have been given a diamond tile map consisting of N rows, where the first row…
Answer published by the source
Identifiers
task_id
03139e35-ddfa-59c8-89f4-e485085da421
task_key
bbeh~5fspatial~5freasoning--full--03139e35-ddfa-59c8-89f4-e485085da421
bbeh_sportqa / full
You will be given a main question and two sub-questions. Each question comes…
Answer published by the source
Identifiers
task_id
0109c58a-dc4f-588b-b838-5d46bd19bf4e
task_key
bbeh~5fsportqa--full--0109c58a-dc4f-588b-b838-5d46bd19bf4e
bbeh_temporal_sequence / full
Eve, Sophia, Yolanda, Nancy and Emma work from 9 to 5 their local time on…
Answer published by the source
Identifiers
task_id
00716e1a-c47a-5321-829a-3b09d9466b1b
task_key
bbeh~5ftemporal~5fsequence--full--00716e1a-c47a-5321-829a-3b09d9466b1b
bbeh_temporal_sequence / full
Yolanda, Karen and Alice work from 9 to 5 their local time on weekdays. They…
Answer published by the source
Identifiers
task_id
0090ccec-90ec-52f2-9fc1-868971463521
task_key
bbeh~5ftemporal~5fsequence--full--0090ccec-90ec-52f2-9fc1-868971463521
bbeh_temporal_sequence / full
Amelia, Rachel and Lisa work from 9 to 5 their local time on weekdays. They want…
Answer published by the source
Identifiers
task_id
016d1e3d-989f-57ad-8c22-6a1e8e8cbbd5
task_key
bbeh~5ftemporal~5fsequence--full--016d1e3d-989f-57ad-8c22-6a1e8e8cbbd5
bbeh_web_of_lies / full
In this question, assume each person either always tells the truth or always…
Answer published by the source
Identifiers
task_id
01df78a6-412f-5c2b-bb18-3f8826a53bf9
task_key
bbeh~5fweb~5fof~5flies--full--01df78a6-412f-5c2b-bb18-3f8826a53bf9
bbeh_web_of_lies / full
In this question, assume each person either always tells the truth or always…
Answer published by the source
Identifiers
task_id
02c6ebe6-ae70-52a0-9c1d-ba837b3293f9
task_key
bbeh~5fweb~5fof~5flies--full--02c6ebe6-ae70-52a0-9c1d-ba837b3293f9
bbeh_word_sorting / full
Consider a new alphabet whose letters have the same order as the English…
Answer published by the source
Identifiers
task_id
026f6d9a-8abe-54b6-92e0-be981644844c
task_key
bbeh~5fword~5fsorting--full--026f6d9a-8abe-54b6-92e0-be981644844c
bbeh_zebra_puzzles / full
There are 8 people next to each other in a row in positions 1, 2, 3, 4, 5, 6, 7,…
Answer published by the source
Identifiers
task_id
00a77d16-7eb2-5854-b6ff-3e869b9add6f
task_key
bbeh~5fzebra~5fpuzzles--full--00a77d16-7eb2-5854-b6ff-3e869b9add6f
bbeh_zebra_puzzles / full
There are 7 people next to each other in a row in positions 1, 2, 3, 4, 5, 6, 7…
Answer published by the source
Identifiers
task_id
00da5be8-08ba-53e3-9841-0f6124011f28
task_key
bbeh~5fzebra~5fpuzzles--full--00da5be8-08ba-53e3-9841-0f6124011f28
bbeh_zebra_puzzles / full
There are 5 people next to each other in a row in positions 1, 2, 3, 4, 5 who…
Answer published by the source
Identifiers
task_id
00e79ebb-cd73-5db9-b941-486f36647ddd
task_key
bbeh~5fzebra~5fpuzzles--full--00e79ebb-cd73-5db9-b941-486f36647ddd
bbeh_zebra_puzzles / full
There are 7 people next to each other in a row in positions 1, 2, 3, 4, 5, 6, 7…
Answer published by the source
Identifiers
task_id
0162fe2e-5cd0-5dc6-8293-ab60cd18d8cc
task_key
bbeh~5fzebra~5fpuzzles--full--0162fe2e-5cd0-5dc6-8293-ab60cd18d8cc
bbeh_zebra_puzzles / full
There are 7 people next to each other in a row in positions 1, 2, 3, 4, 5, 6, 7…
Answer published by the source
Identifiers
task_id
028e7a03-929a-5efb-8c00-c486abc7a173
task_key
bbeh~5fzebra~5fpuzzles--full--028e7a03-929a-5efb-8c00-c486abc7a173