{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"886ff569-d0e7-5d9b-a256-c4bffb388d5c","task_key":"default--validation--19318","task_revision_id":"1","upstream_id":"19318","short_description":"HellaSwag validation 19318","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to look sexy in the morning [title] Take a warm bath. [step] For healthy skin, make sure your nighttime bath or shower is warm, not hot. If it's too hot, it can strip your skin.\",\"endings\":\"[\\\"Plus, make sure you don't scrub your skin too much, as it can irritate it. Make sure you pick a gentle soap for your skin.\\\", 'Lightly bathe yourself in lukewarm water. Invite your skin to become warm by \\\" heating up \\\" your body using a splash of cool water.', '[title] Apply a body scrub made with ingredients in it such as lemon, spf, olive oil, or avocado to your skin. [step] This will help your body rest and hydrate the entire day, which will keep your skin looking healthy and fresh.', 'Not showering quickly, bathing and drying can set up the whole day in a sweat stain and make it darker. [title] Use a moisturizing lotion.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}