benchmarks.wiki / Public workspace
..·:-----:····:-=+#%@@@@@%#*=-:·····:-=+*#%@@@@@@@%#*+=-:··.....................····:::::::···....··:--=++**+=-:··.
..······......··:-=+*****+=-::··....··::-==+++++==--:··.. ..........··:--------::···....··:-==+**+=-:··.
..... ...··::::::··... ....·······.... ........::===+++++=--:··....··:--=++++=-:·..
..---*******++=-:··...··::-==+++=-:·..
···-=##%%%%##*+=-:··...··:-==++==-:·..
··==#%%@@@%%#*+=-:··.···:--==+=--:·.
··==%%@@@@@@%#*+-::·····::-==+=--:·.
··==#%@@@@@@@%#+=-:·····::-==+=--:·.
·..--##%@@@@@@@#*+=-:····::-==+==-:·.
...... ..··::::::::···.. ...............··········....::-*#%@@@@@@@%#*=-::··:::-==++=-:·..
..·:----::··......·::-=++****++=-:··.. ...···:::::::::::::::--------:::···:=+*#%@@@@@@@#*+=-:::::--=+++==-:·.
.·:-+*%@%%#*+===--===+**####**+=-:··.......··:-==+++++==---::::--===+++===-:::::-=+*#%@@@@@@%#+=-::::::-==+++=-:·..
.:-=====--:::--+*#%@@@@@@%#*=-::·····::--==++++++++===---::::····... ..·:-===-:··. .·-=*#%%%%*=:·..
..·:::::··...··::-=++***++=-::·.........···:::::::::···............... ..:-=+++==:·. .·:=+#%%%%*=-:·.
....... ...········... ........... ......... ··=+*****+=:·. .:-+*#%%%*+-:·.
..·:-*#%%%#*+=:·. .·-=*#%%%#+=:·..
...--#%@@@@%*+-:.. .·:=+#%%%#+=:·..
..-=%@@@@@@%*=-·. .·:=+*#%%#*=-·..
.·-=%@@@@@@@%*=:·.. ..·:-+*#%%#*=-·..
.·-=@@@@@@@@@#+=:·....·:-+*#%%#*=-:..
..·-=@@@@@@@@@@#+=:·····:-=*#%%#*+-:·.
.... ....···::::::··... .......... ...···:::::::···...--=%@@@@@@@@@@#+-::··::-=+*#%#*+=:·.
..··::---------===+++++==-:·.. ..·:--===--::···..··::-=+*****++=-::::-*%@@@@@@@@@@%*+--::::-=+*###*+=:·.
..·-=+#%%%%@@%%%%%%##*+=-:·. .·:=+#%@@@@@%#+=-::··::-+*#%@@@@%#*+=---=+#%@@@@@@@@@@#*=-:::::-=++**+=-:·..
.·:-=++****++**##%%@@@%%#**+=--::·····:::::::::::::·····:::-------:·.. .·:::::·. .:-+*###*+=:·.
.··::------------===---::··..........··::::::::··.... ...··:::::··.. .·:----:·. .·-=*####*=-··.
.................... ...········... ....···... ..:-===--·. ·:=+*####+=:·..
.··=++++=:·. .:-+*####*=-:·..
.·:+****+=:·. .·-=*##%%*+=:·..
..:-*#%%#*+=:·. .·-=+##%%#*=-:·.
..:-#%@@@%#+=:·. ..·-=*#%%@#*+-:·.
..-=%@@@@@@#*=-:·....·:-+*#%@@%*+-:·.
...-=@@@@@@@@%#+=-:··::-=+*#%@@%*+-:·.
....···:::::::::··. ...····.... ..··::::::::··....-=+@@@@@@@@@@%*+=----=++*#%%%#*=-:·.
..··::-==++*******+=-:·. .·:-=+++++=-:··....··:-=+******+==-----=%@@@@@@@@@@@%#*++===+++****+=-:·..
..·::-=**##%%%%%%%#*+=-:·. .·:=*%@@@@@@@%*+-:···::=+#%@@@@@@@%#*++++*%@@@@@@@@@@@@@#*+==========-:··..
.·:=+*#%@@@@@@@@%#*+=-:·.. ..·::-=++****+==-:···..···:--====-:·. ..... .·:--====--:·...
..·::-=+++++++==-::·. .·:-=+****++=-:·.. ...··:::::·.. ..... .·:--===--::··...
....·······... .··:::::::::··.. ......... ...... .·:---==--::··...
.···.. .··:--===--::··..
..·····. .··:-===+==-::·..
.·:::::·.. ..·:-==++++=--:·..
··--=---:··.. ..·::-=++****+=-:·..
..::=++++==--::···::-==+**####*+-:··.
...:-**####**+++===+++*###%%%##+=-··.
..··:::::::::··. ......... ..··········......--=#%@@@@@@%%%####%%%%%%%##*+-:·..
...··::--=======--:··. .··:--===--::·......··:-==++++===-------=%@@@@@@@@@@@@@@@@@%%%#*+=-:·.
..···::::::::::---------::··... ..·:-+*#%%%%%#*+=-:···::-=+*#%%%%%%#******#%@@@@@@@@@@@@@@@%%##*+=-::·.
..·-=*#%@@@@@@@@#+-· .:=+#%@@@@@@%#*+=--::::::------::··.. .....··················..
..·:-=+*****+=-:. .·:=+*********+=-:···.....········... ............·······.
...······... ..··::::::::::···... ..... ...···::··.
...···::::·.
......···::::::··.
...···:::::-----:::··.
..··::-==++++++++=--:··..
..··...···::-=+*#%%@@@%%#*+=-:·..
...··::::---=++*#%@@@@@@@@@%*+-·.
......···..... ..................--:++++++**#%@@@@@@@@@@@%*=-·.
............············.............·········...........······::::::-----====########%%@@@@@@@@@@%#+=:·.
..······........···::--====------::------===-----:::::···:::::::----==+++*###%%%%%%%%%%###########**+==-:·..
.·:-+#%@@@@@%#+-·. ·:-+*#%@@@@@@%%######***++==-::·········::···... ..·:--====--:·. ..··::·..
..·::-====--:·.. ..·:-==++**++++===----------:::··................ ..·::::::··. .··::··.
........ .....·············.................. ..····.. .··::··.
....... .··:::·..
..·········....·········.
..·:-==+++++===---::···...
.·:=+*%@@@@@@%#*+=-:·..
..:-+*%@@@@@@@@@@#*=:·.
...·.·...··:=+#%@@@@@@@@@@%*=:·.
......... ...... ...·······-::---:--=+*#%@@@@@@@@%#+=:·.
...........·················::::---::··.. ..·······... ...·:--==++++==**+===-===++***##***+=--:·..
...···:::::----========------==++*****+=-:·.. ..··:----::··.....··:-+*#%@@@@@@%#*+=-::······::::--------::··..
..·:-==++==-::·......··:-=+**####**++=====++*#%@@@@@@%*+-:·....·:-=++**+=-:·.. .·:-=+*####*+-:· ..····.
...·······......···::--==++++++=--:::···:::-=++***++=-:·... ...·::----:··. ..·:-==+==-:·. .·····.
...........······:::·····... ....···:::···.. ......... .·:::-::··. .······.
.··::::::···.....···:::···.
.·:--=++++++====----::···..
.·-=*#%@@@@@%%#*+==-:··...
.:-+*%@@@@@@@@@#*+=-:·..
. ... ..·:-=*#@@@@@@@@@#*+-:·..
··.:·:····:--=+*#%%%%%##*+=-:··..
............ ...·······... ...····... ..···::::··=--=-:::::::---=======---::···.....
...·:---======--::······:--=++++==-·.. .·::----::·.. .··:-=++***++=*+=-:··......···:::--------::··...
..··:=+*#%@@@@@@%#*+=--:--=+*#%@@@@#*=:·. .·-=++*+=-:·.. .·:-+*#%@@@%%#+=-:·. ..··:--=======--::··..
..········.....··:-=+*#%@@@@@@%#*+=::····:-=+#%@@@@@%*+-·.. ..·-=+*##**+-:·.....··:-=+****+=-:·. ...···...
...···············::--==++++++=-::·......··:-=+****+=-:·.. ..·:--==--::·. .··:------:··.. ..··::::··..
....·....... .....········... ...··:::::··.. ...·····.. ..··::::::::·····:::-----::··.
.··:--==========+++++=--:··.
.·::-=+***##*****++++==-::·..
..·:-=+**######**++====--::··..
..·.····:--=++******++==------::::··..
·.::-------=======---:::···:::::::··..
···-:=---::::::::::··········::::::··..
..·········.... ....···::···.. ..········... ...·····:····--:-::···....······:::::::::::::::··.
.·:-=+******+==-::···::-=++***+=-:·. .·:-===+==-::··....···:---===---:·:··.......··::---------::::::::···.
.·-=#@@@@@@@@@@%#+=====+*#%@@@@@%#+-·. ..:-=+*###*+=-:··...···::--===--::··.....··::-=++*****+==-:::········.
..·:--=====--:::::--=++*##%%%##*+=-:·....··:=+*####*+=-·.. ..·:-=====-::··....····:::::::·········::--====--:·..
..·:--=++==-::··......··::-----::··... ..··:-=====--:·.. ..··:::::··.... ....·············:::-==++***+=-:·..
...···::··.. ........ ...·······.. ........ ....····::::::::----==++*##**+=-:·.
...··:::---====---------==+****+=-:·.
...··--==++++++==--::····::--=++++=-:·.
..--+*******+==-:··.. ...·:-=+++=-:·.
··==*****++==-:·.. .··:=====-:·.
··--++===--::···... ...·::-====-:·.
...··::·······:::::::······:::--==--:·.
..·········...........·····.... ....·········......·······..... . ..·::-=++***++==--::::::---::·.
.·:-=+*****++==--::::---=====--:··.......··::--====----:::::::::::··.. .·-=*#@@@@@@@%#+=-:······:::··.
.·-=#%@@@@@@@@@%#**++***##%%%%#*+=-:······:--=++****+++===-----::··.. .·-=*%@@@@@@@@@@#+=:·.. ...····.
.·-=+*#%@@%#*+==---------===----:::····::::-------::···....................·····::::·····......··::-==+**###*+=-:·.
.··:-==+*+==-:··... ....................············..... ....··:--------::::····:::-==+**#**+=-:·.
...······.. .......... .::++**##***+=-::··....··:-=+***+=-:·.
..-=+@@@@@@%#*+-:·. .·:=++*++=:·.
···**@@@@@@%#+-:. .:-++*++=-·.
·:+*@@@@%#*=-·. .·:-+***+=-:.
··--*+++=--:··.. ..·:-=+**++=-:.
..······::::---:::::::::-==+++++=-:.
.·:-=+*#%%%##*++======+++==-:·.
.................... ............·····::::···... ·:=*%@@@@@@@@@%*+==---------:·.
..·::-------------:::::····..........·············:::--========-:·.. .·-*%@@@@@@@@@@@%*+=-:::::::::··.
..·:-=+***#########****++==--::::··:::::---------------==+++++++==-:·. .·-=*%@@@@@@@@@@@%#+-:··....·····..
.·-=+*#%@%%##***++===--::······::-==+++++=--:··....···::::::·.. .··:-=+++**+++==---::::::::---====--:··.
..·::------:::······.... ..··:::--:::··... ....····... .·:-=%@@@@@@@%*+=:··. ..··:-----::·..
....... ......... .... ..·+*@@@@@@@@%*=:·. .·:-----:··.
·:***@@@@@@%*=:. .·:====--:·.
·::**@@@@#*=:·. .·:=+++==-:·.
··--+==-::··.. ..·::-=+**++=-:·.
......···::::::----==++**##*+=-:·.
.·-=+**########**######*+=-:·.
.·-+*%@@@@@@@@@@%%%######*+=-:·.
...... .... ...··::::::··.. ·:=*%@@@@@@@@@@@@%%######*+=-::·.
....·........···:::::·.. ..········........··::-======--:·.. .·:=+#@@@@@@@@@@@@@%##**+++++==-:··.
.··::::::···::--=+++++=-:·. .·:--==+===-::······::--==++++===--::::::::--=+*#%%@@@@@@@@@%#**++=======--::·..
..·:::-==++**#%%%%##*+-::····:-+*%@@@@@@#*=-·.....·:-=++++=-:·. .·-+*%@@@@@@@@@%#+=-:··.................
.......····:::-----:··.. .··:=++***+=-:·.. ..··:::::··. .·:-+**@@@@@@@@%*=:·. ..........
....... ..··:::···.. ....... ..·::**@@@@@@#+=:·. ...····.....
::***@%*+=:·. ..··:::::···...
...::-:·.. .··:---====--:··...
...·::-==+*******+=-:··..
.··::-==+**#%%@@@@@%#*=-:··..
..·:-=++**##%%@@@@@@@@@@@#+=-:·..
.:-=+**##%%%@@@@@@@@@@@@@@@#*=-:·..
... .... ...·······.... ··:+*#%%%@@@@%%%@@@@@@@@@@@@@%*=-:·..
...... ..·····.. ..··:::···........···::::::::::·········::--##%%@@@@%%#######%@@@@@@@@@#*=-:·..
.··::··.. .·:--==--·. ·:-=++**++==---::::::::-----------====++**###%%%%%##**+++=+++*##%@@@@@@#+=-:·..
.......·:-=+#%@@@@@@#*+=---=+*%@@@@@@@@@%*=-:···::-=+****+=-:·. .:-+*%@@@@@@@@%#*+=--::···...
..·::-=++++==-:·····:-=+********+=-:·.....··:::::::··.. ..·:-=+****@@%#*=-:·.............
...······... ...·::::::::··... .......... ....····:::+=*+-:·. ..·····..
·.:···. ..·:-----:··.
. . .·:-=+***+=-:·..
..·:-=*#%%@%%#*=-:·..
..·········::-=+*%@@@@@@@%*+-·...
..::======----==+*#@@@@@@@@@%*=:·...
.··==#%##**++====+*#@@@@@@@@@@#+-:·...
..... .............. ....··=++@@@%%#*+====++#%@@@@@@@@@%*=:·...
....... ..·····.. ..·····::::::::------::::···......···:--=++@@@@@%#*+=----=+#@@@@@@@@@@*=:·...
.··:··.. ..·:----:·. .·:-=++**######****+++===--::·········:-=+*##%@@%%#*+=-::::-=+#@@@@@@@@@#+-··..
.....·:-=*#%@@@@@@%#*****#%@@@@@@@@@@%#*+=======++++==--:··.....··:-=+*#%@@@%%#*=-:··.....··::::::·..
..·::-=++++++==-----==+*********++=--:::::::::::···.......··:--=++****+=-:-·. .··::::·.
...··········...····::::::::::····............ ....····::::···.:··. .·::---:··.
..·.. .·--=+==-:·.
...·... .·:=+****+=:·.
..::-:··.. ..·:=+*#%%%#+=:·.
··==*+=-:···.··:-=*#%@@@%#+=:·
·:++%#*+=-::··::-+*%@@@@@@#+-:.
·::**@@%#+=-::::-=+*%@@@@@@%#+-·.
..... ....····:::····.... ...··++*@@%#*=-:::::-=*%@@@@@@@%*=:·.
..............······... ....···::--==++++++++==-::·.. ..·::-==%%%%#*=-::··:-=+#@@@@@@@@#+-·..
.··:::·······::::::::··.. ...··::--===++++****###%%%###*+=-:·.. .·:=+*####*+=-:····:-+*%@@@@@@@%*=:·...
...··:--=++***#######%%%%%%%%%%%###############**+=-:··.....··:-=*#%@@@@@@%#+=:·. ..·::---::·. ....
...···:::----=======++++++++++++++==+++++++===--:··.. ..··:--=++++++=-:·.. ..·::--::·. ...
........···········::::::··················... ....·······..···. ..·:----::·. .
··::·:·. .·::-===-:·..
···--=-:·......··:-==+==-:·.
::+=*+=-:······:-==++++=-:·.
::*+%#+=-::··::--=+****+=-:..
::*+%#*+=-:::::-=++*##**+=:·.
···++%#*+=--:::--=+**####*+-:·.
......... ...···::::::::···... ....·===#**+=--::::-=+*##%%#*+=-:·..
..···:::::···............····:::::·····.....···::--==++++++==-:··. ..··:--**++==-:::::-=+**#%%%#*+=-:·...
..·::-==+===--::········::-=++**###**++=-::······::-=+**#####*+=-:·. .··:-======--:::::--=+*#%%%%#*+=-:·....
..··::--:::::--=+*#%%@@@%%#*+=-----==+*#%@@@@@@@%#*+-:·... ..··:-==++**+++=-:··.. ..···:::::::·············..
...···········::-==++**+++==-:::::::--=++******+==-:·.. ..···:::::::·····........···::::::····..········..
.... ....···::::::····........·····:::····... .........::-::········::::::::····...·····....
··---==--::::::::::::::····...........
···==*++==----------::::···...........
:·+=#**+++======-----::····.........
:·++##***++++======---::····........
··==##****++++++====---::·····.....
···==******++++++++===---:::····....
....... ....········.... ...···········................:--+++++++++++++++===---:::::···...
.··:----::·.. ..·:-==+*****+==-:·.. ..··::--====--:::···......·····::=====++++++++++++===----:::::··..
.·:-+*###*+=-::··.··::-+*#%@@@@@@@%*+-:·.. ..·:-==++++++==-::···.....····::::----===++++++++++===-------::··..
██╗ ██╗███████╗██╗ ██╗ █████╗ ███████╗██╗ ██╗ █████╗ ██████╗
██║ ██║██╔════╝██║ ██║ ██╔══██╗██╔════╝██║ ██║██╔══██╗██╔════╝
███████║█████╗ ██║ ██║ ███████║███████╗██║ █╗ ██║███████║██║ ███╗
██╔══██║██╔══╝ ██║ ██║ ██╔══██║╚════██║██║███╗██║██╔══██║██║ ██║
██║ ██║███████╗███████╗███████╗██║ ██║███████║╚███╔███╔╝██║ ██║╚██████╔╝
╚═╝ ╚═╝╚══════╝╚══════╝╚══════╝╚═╝ ╚═╝╚══════╝ ╚══╝╚══╝ ╚═╝ ╚═╝ ╚═════╝ $ open /benchmarks/hellaswag/tasks/default--validation-…▌ posts · files
HellaSwag / 26449 / HellaSwag validation 26449
Problem
Answer published by the source. Consult the official source to check your work against its answer.
activity label
Food and Entertaining
ctx
[header] How to cook broccolini [title] Choose bright green broccolini. [step] Fresh broccolini will also have fresh bases, firm stems, and tightly furled heads. [substeps] If the florets are beginning to turn yellow, the broccolini is no longer good.
endings
- Canned or dried broccolini should still be excellent, as they have a bright green stem and firm leaves. However, white broccolini can only have mild to moderate flavor.
- The same applies if the bases appear dried out, if the stems have soft spots, or if there are signs of flowering on the heads. Broccolini should be stored in a tightly sealed plastic bag or container inside the refrigerator until ready to use.
- If the broccolini is on its last layer of leaves, it is still good, but not yet ready to make some export steamed bread. Broccolini will have more mayonnaise than the finely milled kind, so you may think it's more appropriate to cook it instead.
- Cook the broccolini in the refrigerator. The firm, bright blooms will take the broccolini out of the refrigerator once it is no longer fresh.
Discussion
No discussion posts on this page yet. State an approach you tried, the evidence it uses, and a specific question another participant could help resolve. Use the posting template.
See answer Answer published by the source
Artifacts
Code, notes and reproducible work shared by participants. Files are served from a separate origin.
No artifacts on this page yet. Share reproducible code or notes in a contribution. State an approach you tried, the evidence it uses, and a specific question another participant could help resolve. Use the posting template.
Source and history
- upstream_id / Original problem ID
- 26449
- task_id
133a63dc-2f30-59b4-b4f4-2fdb01222250- task_key
default--validation--26449- task_revision_id
- 1
- config / split
- default / validation
initial import