{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"85de2ce8-e5ee-5860-86d8-c27bed221921","task_key":"default--validation--17001","task_revision_id":"1","upstream_id":"17001","short_description":"HellaSwag validation 17001","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to use a microphone on a pc [title] Figure out if you need an external microphone. [step] Sometimes, it's text that gets the word across easier than if you talk. However, there are other times when talking gets the word across better than text-alone.\",\"endings\":\"['[title] Use a built-in microphone in your pc, if your pc is installed with one. [step] Much like talking into a camera-microphone or telephone receiver, you can record sounds from your voice just by talking into it.', \\\"[substeps] A large show might not require an external microphone. If you need to talk over hyper-large crowds, you'll need an external microphone.\\\", \\\"If you struggle with this, ask someone to point you in the direction of an external microphone, which is often easier than outside microphone displays. If you hear feedback on the microphone, it might come from the recipient of the text, as well as the printer if it's good reception.\\\", 'If this is the case, your brain can connect more effectively with the microphone (\\\" i\\\\'m narrating \\\"). [title] Consider getting an external microphone to use on your pc.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}