{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c4cee16e-47fd-56c1-9548-c86aa67854c7","task_key":"default--validation--10338--variant-973c8488b920","task_revision_id":"1","upstream_id":"10338--variant-973c8488b920","short_description":"HellaSwag validation 10338","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to convert bin files using power iso [title] Download power iso. [step] One common application used to convert bin files is power iso. It's a program that turns bin files into iso file formats, a much more readable file version.\",\"endings\":\"['[substeps] This program is available through the iso store app on your smart device. Click on the power iso case or icon to launch it.', 'Power iso is available for both mac and pc. [substeps] Before installing the program, you will need your computer to recognize the file theme in which you downloaded.', '[title] Select the file (first) you want to convert (\\\" iso \\\"). [title] Delete the file (\\\" iso \\\").', 'You can download power iso for free here :. [title] Click the downloaded file to open it.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}