{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2d5cc736-7e9a-5c63-b07a-d9db3fc1d078","task_key":"default--validation--33536","task_revision_id":"1","upstream_id":"33536","short_description":"HellaSwag validation 33536","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get rid of cellulite [title] Drink plenty of water. [step] Hydrating your body keeps your skin cells looking fresh and renewed, which can reduce the appearance of cellulite. Drink at least 8 glasses of water a day to make sure your system is getting all the water it needs.\",\"endings\":\"[\\\"Drink between 8 and 12 glasses per day of water to hydrate yourself. Don't sit in front of the radiator, fan, or fireplace for longer than this, as this can cause additional weight gain.\\\", 'You may need more or less than you think. [substeps] Fill up a large glass with filtered water and add one ice cube to the glass of water.', 'That way, with proper hydration, your body will process water more efficiently and stop producing fat. Coffee and tea are also great sources of water.', '[substeps] Start drinking a glass of water first thing in the morning, before you have your morning coffee or tea. Carry a bottle of water with you as you go about your day.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}