{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a06f347a-8d3c-5127-b59b-98329a3bbc1b","task_key":"default--validation--28451","task_revision_id":"1","upstream_id":"28451","short_description":"HellaSwag validation 28451","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get sexy hair [title] Condition your hair first. [step] Sexy hair is voluminous and bouncy-the residue left behind by conditioners weigh your hair down! To elevate your locks to bombshell status, condition your hair with a basic formula before shampooing your scalp. [substeps] A basic conditioner is not formulated with additional oils or minerals.\",\"endings\":\"['However, a conditioner will keep your hair in good shape without damaging its fibers. Conditioners that are clean work well as styling implements.', 'A deep conditioner works with all types of hair and can easily cover up problem spots. You can apply conditioner throughout your hair starting with the roots and working your way up to the crown of your head.', 'You can use any product you want, shampoo, or condition, but most body products contain both oil and conditioner. Use at least 1 ounce of olive oil in a lather and avoid dairy products or products containing honey.', 'For a silkier finish, apply a conditioning hair mask to your dry locks. After ten minutes, rinse out the treatment and wash your hair with a cleansing shampoo.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}