{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9d9839eb-fb6b-5fd2-9c70-291803a5d2f6","task_key":"default--validation--24342","task_revision_id":"1","upstream_id":"24342","short_description":"HellaSwag validation 24342","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to apply blush on oval faces [title] Pick the right brush. [step] There are a number of different brushes you can use to apply blush, and the one you choose depends on the result you want to achieve. For instance, you won't use the same brush to achieve a heavier and more noticeable blush job than if you want to go for a soft and natural look.\",\"endings\":\"['Which brush you use depends largely on the object you are applying your blush to. [substeps] Look for a brush that is able to extend past the brow bone.', '[substeps] For an oval face, use a brush on the forehead and directly under your eyebrows, following the contours. For smaller, heavier faces, look for a medium or fluffy brush.', '[substeps] Choose a precision brush if you want to apply more color and a heavier coat. Choose and angled brush for a lighter and softer coat.', '[substeps] When choosing a brush, note that if you would use the same brush on certain contouring, it would be more flattering to use it for your oval face. Still, you should generally use blush sparingly.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}