{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5ad365ab-79a6-58e3-8c68-41432f169d11","task_key":"default--validation--15371","task_revision_id":"1","upstream_id":"15371","short_description":"HellaSwag validation 15371","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to use wax on your hair [title] Start with dry or slightly damp hair. [step] Use wax on dry hair to hold your style in place or define certain pieces. To create a sleeker style with similar holding power, slightly dampen your hair first.\",\"endings\":\"['Then, start working your way through the damp hair, starting from the root and moving down to the ends. [substeps] For example, let your hair air dry for a couple of minutes at a time.', 'Wash it with a low-moisture styling agent and apply a very light blow dryer to the end of the hair just outside of the forehead. Use your fingers to distribute the wax evenly throughout to the ends.', 'Run your fingers over hair from root to tip until all sections are dry. [substeps] Consider using unscented wax if you want your hair to smell less like old-fashioned products.', 'You can spritz a bit of water onto your hair with a spray bottle for this. [substeps] Do not use wax on wet hair.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}