{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bc899d09-8e57-5cfc-ad0b-34d6dc422a83","task_key":"default--validation--10938","task_revision_id":"1","upstream_id":"10938","short_description":"HellaSwag validation 10938","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to prevent acne after shaving [title] Give yourself a hot towel treatment before you shave. [step] Using a warm moist towel on your face and neck before you start shaving may help to prevent acne. A warm moist towel can moisturize your skin and may help to open up your pores as well.\",\"endings\":\"['You could also close your eyes or turn on a blow dryer. [substeps] Avoid applying all-natural oils to your skin and pat it dry with a soft washcloth or hair towel, as these can turn your skin off.', '[substeps] You may want to take a warm bath before shaving to help you get the juices flowing. Hot water can help to hydrate and relax your skin, which in turn may prevent acne.', '[substeps] You can also get a hot tootsie and apply it to your face before applying the shaving cream. Be sure to not rub the hot tootsie on your skin as this can dry it out, reducing the areas that are sensitive and irritating.', '[substeps] To give yourself a hot towel treatment, hold a clean washcloth or hand towel under warm to hot running water until it is saturated. Then, wring out the excess water and place the towel over your face and neck.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}