{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"55119545-57b8-5e4e-b8f5-83d195eb7eec","task_key":"default--validation--13895","task_revision_id":"1","upstream_id":"13895","short_description":"HellaSwag validation 13895","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to do short division [title] Write the problem. [step] To write the problem correctly, place the divisor, the number that you're dividing into another number, outside the long division bar. Place the dividend, the number that you'll be dividing by the divisor, inside the long division bar.\",\"endings\":\"['[substeps] Think about defining the two dividencies and separating them. Doing this may help you organize the problem so you can choose a solution that makes sense for you.', 'Do the same with all the dividend bars, including the one that starts, then switches, then/or continues all the way to the end. [title] Make a formula to solve the problem.', 'Place the dividend right next to the first divisor-the dividend bar, if you have them-and the divisor in the middle of the rest of the world. [title] Divide each divisor into a total group.', 'The quotient, or your result, will go on top of the division bar. Remember that for short division to work, your divisor has to be less than 10.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}