{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"356d5f30-2dc0-5fc6-b7f7-ba8414f577f2","task_key":"default--validation--49060","task_revision_id":"1","upstream_id":"49060","short_description":"HellaSwag validation 49060","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to clear bad skin [title] Make sure you are drinking enough water. [step] If you are dehydrated, your epidermis (the outer layer of your skin) dries out along with the rest of you. As a result, your skin will lose its smoothness and bounce.\",\"endings\":\"[\\\"Water helps hydrate, but it also stimulates your body to promote production of more sun-regulating cells. [substeps] Dehydration slows down your body's production of biotin, which helps keep the skin dry, soft, and smooth.\\\", \\\"For this reason, you should aim to drink around 8 glasses of water a day, preferably while not gaming. [substeps] However, you don't have to be an alcoholic to clear bad skin by drinking plenty of water.\\\", 'Drinking plenty of water before and during the day, of course, will help you to maintain that smoothness. [substeps] Water can dry out your skin more if you sit on an extremely hot surface for prolonged periods.', \\\"If you already drink enough water, though, extra won't really help your skin. [substeps] Make sure you drink at least eight 8-oz glasses (2 liters) each day.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}