{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"70484630-47de-5dd0-8a81-c4980aee11e1","task_key":"default--validation--1428","task_revision_id":"1","upstream_id":"1428","short_description":"HellaSwag validation 1428","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to treat razor burn [title] Don't shave the affected area for a while. [step] The most sure-fire way to overcome razor burn is to let the hair grow out. As you do this, keep the skin clean and exfoliated to prevent clogging the pores and further encouraging ingrown hairs.\",\"endings\":\"['[substeps] After shaving, set the razor to its lowest setting. Position the blade approximately ½ to ¾ of an inch from the skin and continue to slide it slowly up and down your skin.', '[title] Put on some loose clothes made from natural fibers. [step] Wearing loose clothes is key to preventing razor burn.', 'Taking your razor and shaving away the dead hair, however, will only put razor burn in the area of your skin which could cause ingrown hairs to form and create skin ulcers. Do not shave the region of the area which has any hair growth or ingrown hairs.', '[title] Use shaving cream or lotion to help open wounds. [step] A few drops of water or baby shampoo on the skin can help open up deep wounds and promote blood circulation.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}