{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"577fb70a-460c-51f7-9e0d-e7db58dad121","task_key":"default--validation--45467","task_revision_id":"1","upstream_id":"45467","short_description":"HellaSwag validation 45467","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make your fingernails look good [title] Don't bite, pick, or peel! [step] The first step to having healthy nails is to avoid biting them. This will increase the chance of having those nails you so desire! Moreover, damaging the nail bed can invite bacteria and fungi and can cause infections. [title] Clean your nails.\",\"endings\":\"['[step] This means washing, scrubbing, and tweezing. Only use a base coat and keep it healthy.', '[step] You can prepare your nails yourself or hire a manicurist to do this for you. If your own nails are naturally dry, wash them thoroughly with soap and water.', '[step] Cleaning with a nail brush is a gentle way to remove dirt, dead skin, and bacteria from underneath your nails. This is especially important if you bite your nails.', '[step] Before you put them in, use a gentle saline such as beet (a cheap but effective over-the-counter treatment) or dawn (an over the counter cleaning solution) to remove dirt and grit and debris. This is essential to looking and feeling the nails.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}