{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bab72db4-58d3-5a76-92b0-e2c92b6b70a6","task_key":"default--validation--43844--variant-e2441494f73c","task_revision_id":"1","upstream_id":"43844--variant-e2441494f73c","short_description":"HellaSwag validation 43844","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to study chemical reactions and their thermodynamic parameters [title] Define a chemical reaction. [step] A chemical reaction involves bond breaking and bond formation. In order to understand a chemical reaction, one needs to understand the meaning of a chemical bond.\",\"endings\":\"['As an example we take the hydrogen molecule. This molecule is stable enough to exist and has one sigma bond between its hydrogen atoms.', 'Basic law of chemical relationships between atoms atoms helps us understand the theoretical state of a particular atom after it is applied to a molecule. Understanding the context will help us understand chemical reactions differently.', 'The start button of a chemical exchange is always identified with a symbols near the beginning. [substeps] The initial area of the equation to learn about this can be the path for the reaction that is occupying space and processing the energy of the chemical.', 'Do this by doing a series of equations that outline the problem. This must be explained within each one to make sure that it is explaining logically.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}