{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"79be80b8-3623-51e7-873c-8a68c2959507","task_key":"default--validation--24097","task_revision_id":"1","upstream_id":"24097","short_description":"HellaSwag validation 24097","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to airbrush in adobe cs4 [title] Open the photo or image you want to edit in your photoshop cs4. [step] Duplicate your image layer by going to your layers window and dragging it to the \\\" create a new layer \\\" icon. Then, create a new group folder by clicking on the \\\" create a new group \\\" icon.\",\"endings\":\"['Remove your entire layer from the group folder. [substeps] This will save your layers in a single file folder, but you can add more layers later as you like.', 'Drag the duplicate layer to the folder; the folder will serve as the holder of all your edited layers. [title] Apply a blur filter on your duplicated layer by going to filter] blur] surface blur.', '[title] Click on your image and select \\\" text layer. [step] \\\" you can change your text layer by clicking on the \\\" web panel \\\" icon located at the top right corner of the new layer.', 'You should be viewing all of your new versions in full size here. All of the original photos and templates can be viewed as you recreate the range that you created earlier.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}