{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1e2d7040-1e8a-577b-87db-63b6e169271b","task_key":"default--validation--34497","task_revision_id":"1","upstream_id":"34497","short_description":"HellaSwag validation 34497","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to write a while loop [title] Get into the coding environment. [step] Open up the program and get to the portion of code where the while loop is needed. [title] Identify your variables.\",\"endings\":\"[\\\"[step] Once you've reached the main coding zone (dij), you need to understand what you are looking for in the code. Your variables will be present in the time loop.\\\", '[step] The construct of the code you are writing is essentially a short set of variables. Create a code for when you enter a variable.', '[step] Many times, a while loop uses a variable for definition. For instance, if your variable \\\" x \\\" will be the value that determines how long the loop lasts, it\\\\'s important that you define \\\" x \\\" as a whole number or similar data type.', \\\"[step] The default length code usually summarizes the much of the work that you are doing and enables you to enter the terms into the code, as well as the variables you are putting in. The correct length code in this case would be' type point'.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}