{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"89f1552a-2070-5c3d-98cd-44f97c1150b3","task_key":"default--validation--24202","task_revision_id":"1","upstream_id":"24202","short_description":"HellaSwag validation 24202","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to use a makeup blur stick [title] Go for a blur stick that is suited to your skin type. [step] Blur sticks appear colored in the package, usually a warm medium shade, but they are actually transparent when applied. This means you do not need to worry if the blur stick will match your skin tone.\",\"endings\":\"['It also allows you to easily distinguish between clear and neutral tones. [substeps] The blur stick measures up to 150 fps.', \\\"Since there are a range of different color blur sticks available online, it's probably best to shop around a few before making your choice. [substeps] Use non-metallic blur sticks such as xyzh, zh, cervo, and zyrtec brands.\\\", 'However, you should make sure the blur stick will work with your skin type. Blur sticks are often good for people who have oily or combination skin, as they reduce shine and minimize your pores.', \\\"Get a black blur stick if you have pale skin. [substeps] Don't limit yourself to applying your blur stick to skin types with white or translucent skin.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}