{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3dd491b7-830b-575d-973b-61569fb0cb12","task_key":"default--validation--31709","task_revision_id":"1","upstream_id":"31709","short_description":"HellaSwag validation 31709","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to clear your skin [title] Cleansing your skin accurately is one of the most surefire methods to receive a clear, radiant tone. [step] However, if you aren't doing this correctly, you could be doing more harm than good. For instance, lukewarm water, rather than hot, is sufficient for entering the pore and rinsing away dirt and oil.\",\"endings\":\"['You should avoid soaps that are labeled \\\" depilatory \\\" or \\\" soothing. \\\" these can irritate and dry out your skin, forcing the color into the dermis.', 'Running a water-bath, in which your face is submerged in warm water, could significantly reduce your dry skin due to the oil. [title] Try using colloidal oatmeal instead of regular oats.', 'Even the rays of the sun can do this. [substeps] When washing, use a gentle cleanser with emollients-benzoyl peroxide, salicylic acid, and baking soda.', 'Scrubbing too hard can exacerbate oil production and break down collagen, leaving you with an oily face and fine lines. Make sure to take your skin type into account when choosing a cleanser.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}