{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ecfea74c-318f-5978-938d-c179ed0763a3","task_key":"default--validation--22603","task_revision_id":"1","upstream_id":"22603","short_description":"HellaSwag validation 22603","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to extend your eyebrows [title] Sweep translucent powder over your brow bone with a clean brush. [step] A dusting of translucent setting powder with a fluffy brush will help the makeup stick to your skin. It will also absorb any excess oil that could cause your makeup to run.\",\"endings\":\"['[substeps] If you have trouble with this, consider using a makeup sponge to rub translucent powder over your brow bone using the same swiping motion as you did with your brush. [title] Pull your brow hair into two buns out from under your ears and fold the sides inward at the center.', \\\"[substeps] Translucent powder doesn't completely cover your eyebrow bones. It will actually help keep them clear and not cause them to wrinkle.\\\", '[substeps] This technique prevents the makeup from sticking to your eyebrows and problem areas. You can apply translucent powder directly to the outer outer part of your brow bone to smooth it out.', 'Dip your fluffy brush into the powder, tap the brush against the sink or counter to get rid of the excess, and then quickly dust a layer over both brows. [substeps] Alternatively, use a primer designed for use on your eyes to help your makeup stick.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}