{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c6ebea55-acba-5a76-95d0-9db22d315397","task_key":"default--validation--32522","task_revision_id":"1","upstream_id":"32522","short_description":"HellaSwag validation 32522","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to deal with peeling skin [title] Cool the skin to prevent peeling. [step] If your skin is starting to peel, it's a good idea to immediately jump in a cold shower or bath. The cold water will soothe your skin, and it will also prevent your skin from peeling so fast by cooling it down.\",\"endings\":\"['[substeps] Do not apply ice to your skin. It can freeze onto your skin, slowing down the drying process.', \\\"The cold temperature causes peeling to happen quicker because your skin will be able to get used to the temperature more easily. [substeps] It's best to cool off the skin prior to peeling, although it's good to warm up before peeling.\\\", '[substeps] How long you lay in a warm bathroom can vary widely. Allowing your skin to rest for a short period of time can help prevent peeling, especially if you keep it under close observation for a little while.', '[substeps] Pat your skin in order to dry it with a clean and soft towel. If you rub the skin with the towel, you could make the peeling worse.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}