{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"142e45f0-db68-51b5-a8d1-fb79a7f8db63","task_key":"default--validation--19953","task_revision_id":"1","upstream_id":"19953","short_description":"HellaSwag validation 19953","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to write a well written research paper [title] Choose your topic. [step] Get online or do book research. For your online research, do not use wikipedia, ask, etc...use only documented sites such as time, college sites, and government websites.\",\"endings\":\"['[title] When taking notes, do not copy word for word, that is plagiarism! [step] You will not get credit for doing that. Use a maximum of three to five words and document the web address and page number.', \\\"[substeps] Make sure you know in advance all the statistics that you need to get done before you write. You'll need these data to support your report or potential writing assignment.\\\", 'Get your research on a sheet of paper before writing your research paper. On your research paper, write the important, immediate, etc.', \\\"This will look sloppy; it's better to use an academic topic rather than a scientific one. [title] Consider your topic when deciding on the paper.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}