{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"30fd7a05-ea46-5edb-bbf6-5a7b2ced96cc","task_key":"default--validation--13545","task_revision_id":"1","upstream_id":"13545","short_description":"HellaSwag validation 13545","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to add massage services to a beauty salon [title] Make a private space for massage clients. [step] Setting a room aside for your massage therapist and their clients allows for maximum comfort and privacy. Make sure the room is large enough to house the necessary products, lay out a massage table, and allow your therapist to work comfortably.\",\"endings\":\"['Most of the time, massage therapists enjoy leaving private spaces open, which may mean going out more and spending more time with your clients. Your own space also provides a chance to be alone.', 'Make sure there is ample lighting so massage oil can be seen from a distance. [substeps] You may arrange for your massage therapist to be in the top third of the room so that the space can be especially dim.', 'The minimum size of the room should be 9 feet (2.7 m) by 12 feet (3.7 m). [substeps] Sometimes, a massage therapist will provide their own lotions and massage oils, so talk with potential therapists to determine whether or not you need to purchase the supplies.', '[substeps] Make sure there is plenty of space to easily apply and apply oil. Make sure your massage mat is big enough to stand on.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}