{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"57c9f3b4-42f5-5f6a-afe0-602360778743","task_key":"default--validation--37698","task_revision_id":"1","upstream_id":"37698","short_description":"HellaSwag validation 37698","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to connect your nintendo wii to the internet [title] Ensure that your network is properly set up. [step] You will need to be properly broadcasting a signal in order to connect the wii to the network. Refer to your router or modem's instructions in order to properly set up your network.\",\"endings\":\"['[title] Remove and disconnect the wii remote cable. [step] This is the same cable that came with the wii remote.', \\\"[title] Connect the wii to your network using ethernet cable. [step] Most wii's have an ethernet cable available for purchase.\\\", '[substeps] If you can connect to your network with other wireless devices, then you should have no issues connecting your wii. No special adjustments need to be made to the wireless network to accommodate it.', \\\"[title] Check your router's operating system. [step] Your nintendo may have a remote power-off switch that will turn off the power if not installed.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}