{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d3443e9d-f722-59d3-8e88-03731469b3bf","task_key":"default--validation--18814--variant-a738e867340e","task_revision_id":"1","upstream_id":"18814--variant-a738e867340e","short_description":"HellaSwag validation 18814","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to use depilatory cream [title] Choose a product formulated for the area you wish to remove hair from. [step] Most creams come in two versions; one for your body and one for your face. Do not use a cream designed for your body on your face, as it contains a higher concentration of chemicals which could damage the sensitive skin on your face.\",\"endings\":\"['( they are not a good idea if you have sensitive skin because they can cause skin cancer. ) [substeps] An alternative to depilatory cream is to buy the thing specifically formulated for your dermatologist.', 'If you use both treatments, you may cause scarring or discoloration. [substeps] Most dermatologists recommend using creams containing the secretion of glycolic acid, which is a great exfoliant for dry or oily skin.', '[substeps] Research brands to see which kinds other people like the best. Popular brands of depilatory creams include veet and nair.', '[substeps] Sensitive skin, by definition, is the most vulnerable area for depilatory creams. If the product you chose is full of chemicals and does not contain any therapeutic properties for your skin, you may not need a cream at all.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}