{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c0358614-3538-58b5-be83-366119f4fffc","task_key":"default--validation--3961","task_revision_id":"1","upstream_id":"3961","short_description":"HellaSwag validation 3961","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to conjugate the verb \\\" dar \\\" [title] Learn how to conjugate dar in the present indicative. [step] The main verbal mode in spanish is the indicative, used in affirmative and negative clauses. When we want to talk about a current action we use the present indicative, the most basic form to express ourselves.\",\"endings\":\"['[substeps] For example, imagine you are eating dinner with your friend. All your friends are eating this delicious casserole, and you are fixating on the meatballs in front of you.', \\\"You don't need to have a pen and paper to conjugate it; time can act as a window to your future dialog. [title] Learn what not to conjugate.\\\", 'However, it is quite rare that an entire sentence will contain a period. A yo could read \\\" zo, this is the sound of old flint banging the hammer on the fence for a few seconds.', 'As an example we are going to use the same example sentence across the different verb tenses. In this example the verb has no idiomatic meaning, but when use in idioms, the conjugation rules keep the same structure.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}