{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fe3c5708-3a1b-52a4-802d-fe213f5cdecc","task_key":"default--validation--12119","task_revision_id":"1","upstream_id":"12119","short_description":"HellaSwag validation 12119","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to warp an object in adobe illustrator [title] Open an existing or new document in adobe illustrator. [step] Use the \\\" place \\\" option under the file menu to import an object, or create an object using the shape builder tool or the rectangle tool. [title] Make changes to the color, border, size or style using the tools in the tool panel.\",\"endings\":\"['[step] Click on the object you have created. Ensure you have selected the right layer in the layer panel before you start to warp your object.', '[title] When done, click \\\" file \\\" and select \\\" export \\\" in the dialogue box. [step] In the \\\" insert new font \\\" screen, select \\\" picture set \\\" from the drop down menu and click \\\" export \\\" to make the name of the font that just opened.', '[title] Create a new document with formatting techniques you would use when creating an existing one, such as illustrating pictures with tabs. [title] Blend the picture into the background using the combos tool.', '[step] In the layer palette, click \\\" be quick and add \\\". Choose the size and border bar and then click on the selected location in the palette.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}