{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b4369b51-2897-56e4-b1c7-08aaf13e986b","task_key":"default--validation--49917","task_revision_id":"1","upstream_id":"49917","short_description":"HellaSwag validation 49917","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to remove sunless tanner from skin [title] Apply baby oil. [step] In most cases, moisture will help you retain your sunless color. However, baby oil has the opposite effect and will loosen the skin cells pigmented with sunless tanner.\",\"endings\":\"['Using a baby oil treatment can tone down or completely remove self-tanner without harming your skin. [substeps] Soak your skin in baby oil and leave it on for ten minutes.', 'Apply baby oil a little at a time and knead it to loosen the dry patches. [substeps] You can use baby oil a small amount at a time and only use a little bit of oil on sunless skin.', 'Use a soft cotton washcloth or sponge to gently soak up some the liquid. Then you can place a soft cotton towel over your head and cover your face.', 'Try using a small amount of baby oil 3 times a week, and use your fingertips to gently wipe off dead skin cells. As mentioned before, you should not wash, moisturize, or remove sunless tanning cream, as these can actually prevent sunless tanner from adhering to your skin.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}