{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5b96692c-ca60-5590-a62e-e6b7b8e26fdd","task_key":"default--validation--18292","task_revision_id":"1","upstream_id":"18292","short_description":"HellaSwag validation 18292","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to take care of your face (females ) [title] The first thing you should do when caring for your face is to get into a routine of cleansing it. [step] Twice a day with your optimal product will fight many of the most common skin problems and leave your face feeling healthy and looking great. Blemishes on your face can be combated by either the use of a product or an organic solution.\",\"endings\":\"['Deciding which to use really depends on your skin type and acne severity. More sensitive skin may need a gentler product, while less sensitive skin may require a harsher product to see results.', '[substeps] Spend 30 minutes every day cleansing your face twice a day with a gentle cleanser and warm water. Allow your face 15 minutes to dry completely between cleanings.', '[title] These two hygiene strategies are how you always look. [step] If your face is clean and well put together, treat it with respect: you want it the best you do.', 'Make sure your own skin is clean and healthy before you start. [substeps] Apply a cleanser that feels good on your face everyday.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}