{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"72c2455c-69df-542d-904e-15357583707a","task_key":"default--validation--18415","task_revision_id":"1","upstream_id":"18415","short_description":"HellaSwag validation 18415","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to install fonts [title] Find some fonts. [step] You can find fonts for purchase or for free at various sites online. There are numerous sites that offer free, open-source fonts that don't require any registration or extra programs.\",\"endings\":\"['[substeps] Feel free to browse font websites like mortgwin.com. You can search for fonts online by typing in \\\" fonts \\\" or \\\" font \\\" in the search bar of an internet search engine and \\\" fonts.', '[substeps] Still, almost any one of them will work for you. You can download a one-page version of how to install fonts later on.', 'For example, you might find fonts for the u.s. international post office online, which can be found at.', 'Some of the more popular sites include, dafont, google fonts, font squirrel , 1001 fonts, and fonts.com [title] Download the font of your choice. [step] Make sure to download from a reputable location, as font files are a classic virus-prone file.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}