{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"623e15ff-10dd-5045-b549-1f9fa08f6eff","task_key":"default--validation--16894","task_revision_id":"1","upstream_id":"16894","short_description":"HellaSwag validation 16894","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to apply draping blush [title] Use the right type of brush. [step] The kind of brush depends on where you are going to apply the blush. Since you will be applying blush to more than just the apples of your cheeks, you will want to use a smaller brush for smaller areas.\",\"endings\":\"['For the cheeks, you can use a regular blush brush. [substeps] Some suggest using a setting brush for the smaller areas of your face.', 'The smaller brush you use, the bigger the blush you will need to add to your cheeks. Check the packaging for the correct brush size for this area.', '[title] Pick the brush that works best for your hair type. [step] For people with curly hair, use a larger brush for thinner hair and a smaller brush for thin hair.', 'You can use a tube brush for larger areas, or a brush of a different color to avoid clashing. [substeps] Use a brush that has brush bristles that are the same colors as your foundation so that the rounded bristles appear less noticeable.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}