{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"07ae1ecb-0e65-523d-8bf6-50bee0ff4dd7","task_key":"default--validation--2120","task_revision_id":"1","upstream_id":"2120","short_description":"HellaSwag validation 2120","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to bake your makeup [title] Apply your liquid foundation. [step] If you use an all-over liquid foundation as part of your makeup routine, you should apply this before beginning the baking process. Do not apply any sort of powder foundation.\",\"endings\":\"['[substeps] Before you begin the baking process, wash your face using your fingers. As you are doing this, gently scrub your face to get out all dirt and oil as well as along any noticeable acne spots.', 'Products containing silicone and alpha hydroxy acids can transfer to your skin, leading to thin foundations. Simply apply your primer all over your face, but do not use your fingers, as the primer may have potential residue.', 'This will most likely make your foundation peel easily and leave a medium layer on your face. [substeps] Before applying your liquid foundation, you should make sure you wet your face with warm water before using it.', 'Baking will only set any liquid products on your face. Use your liquid foundation to even out your skin tone, creating a smooth base.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}