{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"16e12c71-699a-55f5-b7ba-f291b9e3ff81","task_key":"default--validation--6837","task_revision_id":"1","upstream_id":"6837","short_description":"HellaSwag validation 6837","config":"default","split":"validation","body":"{\"activity_label\":\"Pets and Animals\",\"ctx\":\"[header] How to make a high ponytail [title] Use this style on day-old hair. [step] While you can use this style anytime, it can actually work better on hair that's not freshly washed. If you did just wash your hair, it can help to add a little dry shampoo.\",\"endings\":\"[\\\"All you need to do to make the style work better on hair is squeeze or scrunching, then rinsing it out with water. [substeps] You can also still comb your hair to loosen it up, if it doesn't seem to be completely tangle-free.\\\", \\\"[substeps] Find a section of your hair that's around chest level and run your fingers through your hair to create a part. The part should be pretty wide, while still allowing the brush to run through the middle.\\\", \\\"You can also add hairspray, if that's your preference. These products will help make it easier to style.\\\", '[substeps] Pour some conditioner into your hands. Lather up your hands for about 30 seconds.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}