{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"442a65a9-71d9-5a36-9f4f-1e8ff95e444e","task_key":"default--validation--25818","task_revision_id":"1","upstream_id":"25818","short_description":"HellaSwag validation 25818","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to fix common smokey eye mistakes [title] Apply a makeup primer to your lids before beginning. [step] This is a step that is often skipped, but it can make all the difference in your smoky eye. Makeup primer creates a smooth, even base for the eyeshadow.\",\"endings\":\"['It also helps the primer hold and last longer. [title] Apply a little mascara to your eyelashes before applying your eyeshadow.', 'To apply makeup primer, start from the lower eyelid and go all the way down to the bottom eyelid. [substeps] If you do not have a primer, there are several types of makeup primer that are available: non-latex, liquid, foam, rubber, cotton and mica based.', \\\"[substeps] Fill in your lids with your concealer to help make them look like they've been sprayed with a primer. This will also help to keep your eyeshadow from weighing down your eye shadow in a pinch, which may be combined with heavy eyeliner eyeliner.\\\", 'It evens out imperfections in your skin while giving makeup something to really adhere to. It helps prevent creasing, and it helps keep your eyeshadow exactly where you want it.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}