{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9c2a2aac-f5e8-5632-ba62-1b7d8005986d","task_key":"default--validation--1947","task_revision_id":"1","upstream_id":"1947","short_description":"HellaSwag validation 1947","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to use action verbs in public speaking [title] Comb the text of your speech, circling every verb. [title] Analyze all verbs that denote a state of being like \\\" is, \\\" \\\" was \\\" and \\\" had. [step] \\\" [substeps] Ignore, for now, the instances when these verbs are used in combination with other verbs to such as \\\" had begged.\",\"endings\":\"['\\\" you can also see how someone writing a speech may use these in combination with other verbs, as if the subject before the verb was \\\" beg. \\\" [title] Practice your verbs before you use them in a public speech.', '\\\" the main idea of action verbs is \\\" wanted is. \\\" it should be a phrase often used in public speeches.', '\\\" look for the verbs that are standing on their own, such as in the phrases \\\" she was angry \\\" or \\\" they are happy. \\\" reword the sentences to replace these verbs with those that are more vivid.', '\\\" [title] Anticipate the response from the audience. [step] This has the effect of freezing up the text.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}