benchmarks.wiki / Public workspace
..······.......···········...........···:::::::::::::::···········::::::::::::::::::::::----=========--:::::·······.
........ ..............······::::::::·······························:::---:::::::::::------::::·····........
........·········............................. .···--------::::::············............
..··---------:::·······.........
..··--=====---::···..........
..··-===++===--:··....
..·:==++++++==-::·...
..·:=++*****++=-:··..
...·:=+**####*++=-:·... ..
..········... ........ . ...··:::::::···......··:=+*##%%##*+=--:·... ..........
..··::::::··. ..·::::::··... ..·:-==+*****+==-::······-=+*#%%%%%#*+=-:··........·······...
..··::::··. .·:-=+**++=-:··......·:-+*%@@@@@@@%*+=-:::::--=+*#%@@@@%#*+=-:··....···:::---::··..
..... ............······::::::---::::::::::················::::::::::::::::--==++*###%%###**++===++****+=-:·.
......····::::::::::::::····················..........·····::::::::---==+++*****+++==---==+++===-:·.
.........············....... ............... ···::::::::::---=========---::::-------:·.
.··::::::::::::::-------::::····:::::::··.
.··:::::::········::::::·····...········..
.··----:::··············.................
..··-----::···..............
..·:====--::··....
...::=====--::·...
...····... ......... ...···::::::···..........:::+++++==-:··..
..······.. .··::--:::··.. ..·::-=+******++=-::······:::+*****+==-:··.. ........
..····.. .·:-=+**++=-::·....··:-+*%@@@@@@@@%#*+=--::--==+**####*++=-:·... ....·······....
.....····::::----------::::::::·················:::::-----:::::---=++*#%@@@@@@@@@%##*****##%@@%#*+=-:·.
......····::::--------:::·····.........................··········:---==+**#%@@@@@@@%%#***++**#%@@%#*+=-:·.
.............·············..... ...... ....···::--==++*##%%@@%%##**++++++*#%@%#*+=-:·
..··:::---==++**#####**++======++*##**+=-·.
··:::::---==+++++++++==-------=++++==-:·.
··::::::::----=====---:::::::::-----::·..
··:::·····::::::::::::··········:::···..
..··:::·················.................
...··:::····............... ......
....... ....·..... . ...··········.... ...···-:::··....
...··.. ..·::----::··........·:--=++***++=--:··......····::=---::··.. .........
...··.. .·-=+****+=-::··..··:-=+#%@@@@@@@%#*+=-::··:::--=======-::·.. ......····.......
....····:::-----==------:::::::::··············:::---=======------==+*#%@@@@@@@@@@@%#*++=++**#@@@@@%#*+=:·.
.....·······::::--------:::····......................·····::::::::··:::=+*#%@@@@@@@@@@@%#**++++*#%@@@@@%#*+=:·.
..............············..... .............:::++*#%@@@@@@@@@@%##*+++**#%%@@@@%#*+=:·.
...::=+*##%@@@@@@@@@%#**++++**#%%@@@%#*+-:..
..·:==+**#%%@@@@@%%#**++===+++*##%%#*+=:·.
..··-==++**#######**++==----===++**++=-:·.
..··----==+++++++++==--:::::::---==--::·..
..··:::::-----------::··········:::::··...
··:·······:::::·····..........·······...
..... ...····.... .......·...... ··.·····.........................····....
....... .·::-----::··.. ..··::--===--::··.... .....······:···.... .............·····....
...... .·:-++****+=-:··....··:-=+*##%%##*+=-:···....···::-----::··... ....··············....
...·····:::-----===--------:::::::::::::···::::--==++*****++==------==+*#%@@@@@@@%#*+=-::::--=*#%@@@@@@%#+-:..
....·······:::::-----::::·······....··.........····:::--------:::::::::--#%@@@@@@@@@%#*+==---==+*%@@@@@@@%#+-·.
..............········...... .....................-==%@@@@@@@@@@%#*++===++*#%@@@@@@@%*=:·.
..·==%@@@@@@@@@@@%#*++++++**#%@@@@@@#+-:·.
.·-=%@@@@@@@@@@@%#*++===++**##%%%%#*=:·.
..--#%%@@@@@@@%%#*++=======+++****+=-:·.
..:-**##%%%%%##**+==---:::---======-:··..
..::=++++***+++==--:::·····::::----:::··..
...··-----------:::············::::::::···..
... ....····.... . ..... .....···::··············.....······::::::::···.
...... ..·::-----::·.. ...····:····... .....······..···..............··········::::::::···..
...... .·:-=+***++=-:·.. .··:--=====--::·.... ....··::::::::··... ....··::::::::::::::····....
....··::::---------------==========-----::---==+**##%%##*+=--:·····::-=+*##%%##*+=-:·.....·:-=*#%@@@@@@%#+-·..
.....·····::::::::::::::·····:::::::··········::---=======--::·······::-==%@@@@%%#*+=-::··::-=+*%@@@@@@@%*=:·.
...............................................··········..........··=++@@@@@@%#*+==-----=+*#%@@@@@@%#+-·.
···+*@@@@@@@@%#*+==-===++*#%%%%%#*+=:·.
··+*@@@@@@@@%#*++======++***#***+=-:..
··+*@@@@@@@@%#*+==------===++++==--:·..
··=+@@@@@%%##*+==--:::::-----===---::···..
··-=#####**++==--:::···:::::----====--::··.
...::======----:::·······::::----======--:·.
........... . ...........···::::::···········:::::::-----====--::·.
...... ..··::---::··.. ........... .....·········...··........····:::::-----::::::::::::··..
...... .·:-==+++==-:·.. ..··::::::··... ....··:::::::::··... ...··::---===---::···..........
..··::---------=====++***####**++==------==+*###%##**+-:·.. .·:-==++++==-:·.. ..·:=+#%@@@@@@%*+=:·.
....···::::::::::::::------------::::::::::--===++===-::·... ..··:--==##**+=-:··...··:-+*#%@@@@@%*+=:·
........................··...............··········.... ...···+++@%%#*+=-::::::-=+*##%%%%#*+-:·.
·::**@@@%#*+==------==++*****+=-:·.
::**@@@@%#*+==-------===+++==--:··..
::**@@@@%#*+==--:::::----====----:::·····..
·:++@@%##*+==--::::::::----======++===--:·..
··==#**++==--:::::::::----===+++**#**+=--:·.
...::===----:::::::::-----====++++***++=-:·.
........... . ..................···:::::::::::------------------===--::·..
...···:::::··... ........... ......·············..........···::--======---::·············..
.... ..··:--===--::·. ..·······..... ....··:::-----:::··... ..··:--===+===-::·.. .......
..·::------====++**#%%%@@%%##*+=--::::--==+*****++=:·. ..·:-====--:·.. ..·-=+#%@@@@@%#+=:·.
..···:::::::::---===++++++==--:::·····::---====--::·.. .··::-----+=-:··....··:-=+*#%%%%#*+-:.
.............···············...........·········... ...·····===*+=-::····::-==+****++=-:·.
:::++#*++=-:::::::--======--:··. ..
::*+%#*+=--:::·::::---------::::··::::::··.
::++%#*+=--:::··::::----=======+++*+++=--:·.
··==**+==--:::::::---===+++***###%%%#*+=-:.
··--+==------------====++++***###%%#*+=-:·.
...:·---------=================++++++=-::·.
............ . ....................... ...·::::--===++++===--:::·····:::-:::··.
...···::::···... .....................·····::::::····..... ...··::-==++++==-::·.. ..·····...
..·:::-----::·.. ...·······..........··::---====--::··.. ..··:--==+++=--:·. .··:::··.
.··:::-----==++*##%%@@%%#*+=-:··...··::-==++++=-:·. .·:-====--:··.. ..·:-=+*#%@%%#*+-:.
..···:::::::--===+++++++=--:···....···::------:··. ..·::------::::··...··::-=++***+=-:·.
..........······:::::····.............······.... ...·······--:-::······::---==---:··. ..···.
···--=-::·······::::--:::::·······::-----:··.
··--=-::········:::----======+++**#**++=-:·.
··--=--:::::::::--===+++***##%%%@@@%#*+-:·.
·.-:=---------====+++****###%%%@@@@#*+-:·.
..::=======+++++++++++++++++*******+=-:·.
...··--==++++**+++==---:::::::---===-::·.
.............. .......... · ....................... ..·:--==++++++==-:··.. ...··::-::··.
...··:::::···... .......................···:::::::::···... .·::-==++++=--:·. .·::---:··.
..·::----::··.. ..·········........···:--==+++==--:·.. .··:-==++==-::·. ..·:-===--:·.
...····:::-==+*#####*+=-:·.. ..·:-=====--:·. .·:-==+++==-::··.....·::-=+****+=-:·. ......
.....···:::--===+===--:··.. ..··::::-::··.. ..·::------::··.·.....··::------:··. .··::::·.
.......············.... .....··..... ...········..··.·.......···:::::····.....··::-=====--:·.
...·.·.......··::::------====++**##%#*+=-:·.
..··:······:::--==+++***###%%%@@@@@%*+=:·..
..:·-------===+++****###%%%@@@@@@%%*+-:·..
..::==+++++******+++++****#######**=-:·.
..::++********++==--------===++++==-:·.
...::++*****++=--:··......··::---==-:··.
....····............................ · .........·····...... .··-=+++++==-:·.. ..·:--===-:·..
..··::::::··.... ......·····...........···:::-----:::·... .·:-==++==-:··. .·:-==++=-:·.
..··::---::·.. ..··::::::::···.....··::-==+++++=-:··. .·:-=+++++=-:·. .·:-=+***+=-:·.
..·::-=+++++=-:·.. .·:--====--:·. .·:-=+***++=--:··.....···::----::·.. .·:--==--:·.
..··::-------:··.. ..··::::::··.. .··:--===--::··.. ...·········.........·::-=+**++=-:·.
....·······.... ........... ....·······.... ...···:::::-------==+++**####*+=-:·.
....···:::--===+++***###%%%%%%%%#*+=::·.
..··:----==++++***####%%%@@@@@%%##*=-:·..
..:-+++***************###%%%%##**+=-:·..
··-=#####***++====--===+++*****+==-:·.
.·-=####**+=--:·······::--==+++==-:·..
...--***++=--:·.. .··:--=====-:·..
.....···........ ............ .·.....········.... ·::++++=--:·. .·::-==++==-:·.
..··::::···.. ...···········.......···::------::··. .··==+++==-:·. .·:-==++++==:·.
..··:::··. .··:--=====--::··....··::--=====-::·. .·:=+*****+=-:·. .·:-=++***+=-·..
.·:--===--:·.. .·:-==++==-:·. .·:-=+*****+=-::·.. ...·······.... ..··:-=++***+=-:··.
..·:::::::··.. ..··::::::··.. ..·::------::··.. ...···::::::::::---==+++*****+==-:·.
....····.... ........... .....···...... .···::---===++++*****######***+=-:··..
··---===++++***####%%%%%%%##**+==-:··..
..--+*************####%%%%%##*++=-:··...
··==###***+++=====++***####**++=-::·...
··==##**+==-::::::--==++****++=--:·...
··==**+=--:·......··:--=++++++=-::·..
..·--++=-:··. .·:--=+++++=--:·..
.......... ....................:..·······.... ...---++=-:·. .·:-=+++++==-:·.
...··.... ..··::::-::::···......····:::::::·.. ..·::--**++=-·.. .·:-=+++++==-:·.
...... .·:-=+**##**+=-:·.. ...··::---::··. .·:-=**####*+-:·. .·:-=+++*++=-:·.
.·:--==--:·.. ..·:-==+++=-::·. ..·:-=++**++=--:·. ...············::::--==++++++++=-:··.
.··::::···.. ..··:::::::··.. ..··::::::::··... .··:::----======+++++++++++++===-:··..
.......... ........... ............. ···--====++++*****#####***+++==--::··...
...--++++++++****#########**++=--::··.....
··==***+++++++++**#######**+=--::··.......
··==*++==------==++**####**+=--:···........
··=-+==-::····::--=+**###**+=--:···........
··--=-::·......··:-=+******+=--:···........
···-:=-:·.. ..·:-=+*****+=--:··.........
.....·····....... ....:........ ...···---=-:·. .·:-=++****+=-::·..........
.··:--======-::·... ...·······.. .··:--===-+=-:·. .·:-=+****+=-:··... ......
.:-=*#%@@@%#*+-:·. .··::--::··. .·:-=+*#####*+-:·. .·:-=++**++=-:·.. ....
..·:----:·.. .·::-=++++==-:·.. ..·::-=====--::·.. ...···::::-----------============---:·..
..··:::··.. ...··:::::::··... ...···::::····............···----======+++++++++++===---::::··...
......... ........... ..........................:::====+++++*********++==--:::····....
···--++===++++***#####**++=--:····.......
··--+=======++***#####*++=--:····.·.......
··-:=--:::---=++*######*+==-:···········...
··::-::····::-=+**#####**+=-::············.
·.:·:··....··:-=+*##%%##*+=-::·····:::::··.
··.:·:·.. ..··:-=+*##%##*+=--:····:::::::··.
...··········... ..·..... ...·······::··.. .·:-=+*#####*+=--:····::::-:::·.
.·:-==++**++=-:·. ..·····... ..·:--=====-:::·. .·:-=+*####*+=-::·····:::--::·.
.·:-+*#%@@@%#*+-:. .··:--==--:··. ..·:-=+*#####*+-:·. .·:-=+*****+=-:···.···::::::·.
.··:::::·.. ..·:--==++==--:·.. ..··:::----:::···.........····::::-------------------------::::··..
..······... ....···::::···.... ....····························:---===============---::::·····...
......... ......... ................................:::======+++++++++==--:::···.......
...::--====+++*****++==-::···.........
..::----==++***##***+=--:··............
..··:::--==+**#####**+=-::··.....····....
..··:::::-=++*##%%##*++=-:··············..
..·.····::-=+*#%%%%%#*+=-::······::::::··..
...·.·..··:-=+*#%%%%%##*+=-::····::-----:··.
...··:::::::··.. ..·.. ..·········..·.......·:-=+*#%%@%%#*+=-:::··::-====--:·.
.··:-==++*++==-:·. ..·······.. .··:-==++===-:··... ..·:-+*#%%%%%#*+=--:::::--==+==--:.
...··:-=++*####*+=:·. .·:-=+++==-:··.. ..·:-=+*#%%##*+=:·.. ..·-=+*#%%%%#*+=-:::·::--=++++=-:·.
..···:···.......··::-------::··.. ...···::::::::::·············::::::::-------------------------:::···...
..······.............····...............···································---------------:::::::······....
....... ...........................................···---========---:::·····.......
...··--====++++===--::··........
..··--===+++*+++==-::··....
..··--==++******+==-:··.... ...
..··:--=+**####**+=--:··.............
..··:--=+*##%%%##*+=-::·........···....
.. ..::-=+*#%%%%%%#*+=-:··.....····:···..
..··::::::···.. .....· ..···::::····... ...·:-=+*#%%@@@%#*+=-::·······:::--::··.
...·:--=====--:·. .··::::···.. ..·:-==+++++==-:··...···:-=+#%%@@@@%#*+=-::····:::-===--:··.
.....·::--====--:·. ·:-=+++++=-:··.. ..··:=+*#%@@%%#*+=-:·....·::=+*#%@@@@%#*+=--::··::--=++++=-:·..
███╗ ███╗███╗ ███╗██╗ ██╗ ██╗ ██████╗ ██████╗ ██████╗
████╗ ████║████╗ ████║██║ ██║ ██║ ██╔══██╗██╔══██╗██╔═══██╗
██╔████╔██║██╔████╔██║██║ ██║ ██║█████╗██████╔╝██████╔╝██║ ██║
██║╚██╔╝██║██║╚██╔╝██║██║ ██║ ██║╚════╝██╔═══╝ ██╔══██╗██║ ██║
██║ ╚═╝ ██║██║ ╚═╝ ██║███████╗╚██████╔╝ ██║ ██║ ██║╚██████╔╝
╚═╝ ╚═╝╚═╝ ╚═╝╚══════╝ ╚═════╝ ╚═╝ ╚═╝ ╚═╝ ╚═════╝ $ open /benchmarks/mmlu-pro/tasks/default--test--6762▌ posts · files
MMLU-Pro / 6762 / A new severe respiratory illness caused by a newly identified virus is…
Problem
Answer published by the source. Consult the official source to check your work against its answer.
question
A new severe respiratory illness caused by a newly identified virus is discovered. Which of the following properties of a killed vaccine relative to a live vaccine is the most appropriate rationale for developing a killed vaccine for this illness?
category
health
options
- Is more likely to provide sterilizing immunity
- Can be administered in higher doses
- Develops more rapid protective immunity
- Is less likely to require subsequent boosters for lifelong immunity
- Is less likely to cause an allergic reaction
- Is more effective for immunocompromised individuals
- Is most likely to generate mucosal immunity
- Is less likely to cause local adverse reactions at the site of injection
- Avoids the concern for reversion to virulence
- Is less likely to be affected by preexisting antibodies
src
ori_mmlu-professional_medicine
Discussion
No discussion posts on this page yet. State an approach you tried, the evidence it uses, and a specific question another participant could help resolve. Use the posting template.
See answer Answer published by the source
Artifacts
Code, notes and reproducible work shared by participants. Files are served from a separate origin.
No artifacts on this page yet. Share reproducible code or notes in a contribution. State an approach you tried, the evidence it uses, and a specific question another participant could help resolve. Use the posting template.
Source and history
- upstream_id / Original problem ID
- 6762
- task_id
e3761d5b-dd6d-5d5f-a36c-f552f3571e3c- task_key
default--test--6762- task_revision_id
- 1
- config / split
- default / test
initial import