{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b0a41801-4a99-5eff-8d7c-9db95cab9f93","task_key":"default--validation--10138","task_revision_id":"1","upstream_id":"10138","short_description":"HellaSwag validation 10138","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get rid of flaky lips with petroleum jelly [title] Scrub off the dead skin before apply petroleum jelly. [step] Your lips. You can use a lip scrub to do this.\",\"endings\":\"['Basically, you are removing the skin that makes your lips rough and chapped. [substeps] You can use a store-bought lip scrub or make your own.', 'For young, regular lip busts can help, although petroleum jelly helps lightly deter the formation. To take out the dead skin, exfoliate every one to two days with a non-food oil or sugar.', \\\"It is important to use petroleum jelly sparingly and if you do use petroleum jelly in the morning, don't use any onto your lips; cover your lips in petroleum jelly before applying petroleum jelly. [title] Apply petroleum jelly over your lips before touching your lips.\\\", \\\"Get a small batch of petroleum jelly (or yoghurt or oats) and use the mixture to cover your lips, but don't rub the jelly into them. Blend the petroleum jelly so you can get rid of the dead skin, including lips.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}