{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1cf70af0-875b-5fec-b359-963dc204ac9d","task_key":"default--validation--35749--variant-8d4c02d3eec4","task_revision_id":"1","upstream_id":"35749--variant-8d4c02d3eec4","short_description":"HellaSwag validation 35749","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to use bath salts [title] Choose your bath salts. [step] You can buy or make your own bath salts. Most bath salts are made using epsom salts or dead sea salts.\",\"endings\":\"['Choose your bath salts according to your bathtub size and the type of tub you have. [substeps] Cold bath salts (10 drops or less) are best because they can absorb water.', 'Try to use only pure epsom salts, as they are considered safe in water and non-toxic. [substeps] If you are having problems choosing what bath salts to use, think about which salts are the least toxic for you.', 'These salts treat-and condition-your hands by softening the skin, rubbing away dead skin cells, and a strong hydrogen peroxide. They also help soften the body so that the individual with more typically oily hands gets an opportunity to dry up, too.', 'You can also look for products that contain pink sea salt, dendritic salt, or icelandic geothermal brine. Your bath salts may be fine, grainy, or coarse depending on the texture you prefer.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}