{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"483afa43-da90-5f85-b0d4-d39cd290449a","task_key":"default--validation--37553","task_revision_id":"1","upstream_id":"37553","short_description":"HellaSwag validation 37553","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to use lip powder [title] Exfoliate your lips. [step] Just like with any other lip color, it's important to start with a smooth base. Dry, flaky lips will make the lip powder look patchy and uneven.\",\"endings\":\"['Use a gentle exfoliant for a matte, even lip. Or go the extra mile with a lip scrub, lip makeup cream, and a small dash of cocoa powder to achieve a flawless lip makeup.', 'The last thing you want is for the lip powder to get on your teeth. Get it off now and keep it there.', \\\"To exfoliate your lips, you can purchase a lip exfoliator at a beauty supply store. If you'd rather go the diy route, you can whip up an easy batch of homemade lip exfoliator with some sugar (brown or white) and a bit of honey, coconut oil, or olive oil.\\\", 'Removing dead skin will give your lips a professional look. Naturally, harsh exfoliating agents can clog your pores, and their chemicals will make them more prone to flaking on your skin, which will reduce your lip color.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}