{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7bc98afa-b086-579e-95c5-3397f8fa5a8a","task_key":"default--validation--18741","task_revision_id":"1","upstream_id":"18741","short_description":"HellaSwag validation 18741","config":"default","split":"validation","body":"{\"activity_label\":\"Youth\",\"ctx\":\"[header] How to buy a blackhead remover [title] Learn your options. [step] You should not squeeze or pick at blackhead, as this can lead to infection or scarring. However, you can remove pesky or unsightly blackheads with several different types of products that may not necessarily irritate your skin or require treating it with chemicals.\",\"endings\":\"['Learning your different options can help you identify the best product for your specific blackhead removal needs. Products that can remove blackheads include : [substeps] Extractor tools pore strips clay masks topical creams [title] Identify the best remover for your skin type.', 'For example, cleansing a burnt face can peel pores, like blackheads, and subtly remove blackheads. Deep pore pimples, which are a common factor for blackheads, are not tended to dry out.', \\\"[substeps] Avocado, keratin, and brewer's yeast all work well in reducing the inflammation and scarring of blackheads. [title] Pick a chemical neutralizer for stubborn blackheads.\\\", 'Some of the well known brands that are known for their blackheads include tootane, steam, huawba, and celandine. As noted above, these products are more environmentally friendly than other skincare products, especially for those kids.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}