{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"09bb65b7-038e-5764-bcd3-936e9f782afc","task_key":"default--validation--5495--variant-46e803b06a8b","task_revision_id":"1","upstream_id":"5495--variant-46e803b06a8b","short_description":"HellaSwag validation 5495","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get beautiful hair (by using a hair rinse ) [title] Decide what type of rinse you want to do. [step] There are lots of different types of rinses, and which one you choose will depend on what you want to do to your hair. [substeps] Beer can be used as a rinse once a month to increase shine.\",\"endings\":\"[\\\"Pineapple juice can be used as a rinse once a week to make your hair shinier. It's best to talk with a beauty aide or hair care professional before you decide what sort of rinse to use to get beautiful hair.\\\", \\\"Some washes like shampoos, gels, or hair salves can be used to add shine, but others can be used two times a week. Look for a good flow method and don't use a liquid for a rinse.\\\", 'Apple cider vinegar can be used instead of a conditioner after washing your hair. Lemon juice can enhance natural highlights and can help if you have problems with an oily scalp.', 'Beer works by neutralizing both oil and shampoo smells that are naturally released into the hair. It can also boost circulation in the hair follicles.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}