{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6b87a9c3-dfa6-53a7-a508-cd0b1d30f287","task_key":"default--validation--7450","task_revision_id":"1","upstream_id":"7450","short_description":"HellaSwag validation 7450","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to grow your hair in a week [title] Do a warm oil scalp massage. [step] A warm oil scalp massage uses natural oils to improve the health of your scalp and encourage hair growth. Oils like coconut oil, olive oil, jojoba oil, and argan oil can all be used during your scalp massage.\",\"endings\":\"['[substeps] You can buy essential oils at your local beauty counter or at your local hair salonroom store. [title] Consult a shampoo, conditioner, and face wash.', 'Keep in mind warm scalp massages have not been scientifically proven to lead to faster hair growth. [substeps] Start by warming up the oil in a bowl of hot water.', 'These oils are essential oils that will strengthen your hair for coming out. Run some coconut oil or jojoba oil under cool running water.', 'Choose a warm oil scalp massage for your scalp, or a nicer massage oil for your hair. [substeps] Apply a warm oil to your scalp area.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}