{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"24099376-60b3-5329-9807-8c0d85d22173","task_key":"default--validation--25075","task_revision_id":"1","upstream_id":"25075","short_description":"HellaSwag validation 25075","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to cite social media using mla and apa [title] Cite a' tweet'. [step] For a tweet on twitter, begin with the author's last name, followed by his or her first name and the username in parenthesis. Follow it with the full tweet in quotations, the date it was posted, the time it was posted, and the word \\\" tweet.\",\"endings\":\"['\\\" then, add 2-3 very short paragraphs which describe why it was posted to the twitter website. Follow it with 2-3 paragraphs.', '\\\" it should look something like this : [substeps] \\\" knight, joe (cakesforlife). \\\\' always sift your flour before adding it to the cake.', '\\\" [substeps] The focus is on the two consecutive keyword words in your tweet. Be sure to leave a blank space and don\\\\'t type an empty \\\" ex.', '\\\" [substeps] For example, write: \\\" @mla. \\\" [substeps] If you only need the author\\\\'s middle name, you could type \\\" @mla \\\" instead.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}