{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5bb5f085-9c6d-59a6-9396-2d3df56fdf71","task_key":"default--validation--18286","task_revision_id":"1","upstream_id":"18286","short_description":"HellaSwag validation 18286","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to give a facial massage [title] Have them remove their makeup. [step] Whomever is getting the massage should remove any makeup that they have on. Makeup clogs the pores and will interfere with restorative massage products that you will be using on their face.\",\"endings\":\"['[substeps] Any makeup that gets in the way of the massage can be removed. [title] Wash the makeup off with cold water.', '[substeps] When removing makeup, do so using gentle motions, using short, circular strokes that do not irritate the face. Avoid using pressure or prolonged \\\" checks \\\" on the face while doing so.', 'Therefore, have them gently peel away makeup, and let them breathe before you massage them. [title] Wait 3 minutes or up until they have finished.', \\\"[substeps] You might suggest that they wash their face in a shower just prior to the massage. Since you'll be working with them closely, they will want to be as fresh and clean as possible.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}