{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6bc4d634-64fe-52de-8e7b-a2c293464ccc","task_key":"default--validation--15924--variant-59191f52ef9c","task_revision_id":"1","upstream_id":"15924--variant-59191f52ef9c","short_description":"HellaSwag validation 15924","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to grow long hair as a guy [title] Give yourself a hot oil massage. [step] Growing hair starts from the roots-which means that taking care of your scalp and the roots of your hair can stimulate growth. Oil, which conditions hair, warmed and massaged onto your scalp will help to prompt hair growth.\",\"endings\":\"['[substeps] Direct your provider or hair specialist to massage the oil onto your scalp, working in small, circular motions for about 5 to 10 minutes. Use a clarifying shampoo to wash your hair and scalp.', 'You can get a dollop of hair oil at a pharmacy or hair care store. [substeps] Make sure that you warm your head before applying the oil to your scalp.', 'Heat up a bit of olive, coconut, or argon oil until warm to the touch. Gently rub this into your scalp for 5-10 minutes, and allow the oil to soak into your hair for an additional 30 minutes.', 'This can help to stimulate voluminous hair growth, hair that roughly occurs at the roots. [substeps] Do not apply any oil to your scalp.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}