{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"84179055-fbaa-556a-915e-de14aae6e8e8","task_key":"default--validation--25167","task_revision_id":"1","upstream_id":"25167","short_description":"HellaSwag validation 25167","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to dye naturally black hair gray [title] Choose your method wisely. [step] Consider whether to use an at-home dye kit or professional dyes, or go to the salon. Carefully consider the costs, processes, and risks involved in each method.\",\"endings\":\"[\\\"Although dyes can be pretty pricey, they're not considered ethically necessary to dye your hair. Professional dyes cost anywhere from $100-2500 usd.\\\", '[substeps] Professional dyes are chemicals that can cause hair to become dull or dark blonde. Professional dyes should not be used in extremely hot weather, or they may strip hair of its natural color.', '[substeps] You may opt to stand in the shower for an hour before applying your dye. If you have dark hair and desire your color to remain longer, you may opt to either use a commercial dyes kit, or purchase a color stripper kit at your local beauty salon.', '[substeps] For the salon method, familiarize yourself with the salons in your area. Costs and products will vary amongst salons.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}