{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a1d34ed0-3f88-5d16-9ce1-43d573f4513a","task_key":"default--validation--3009","task_revision_id":"1","upstream_id":"3009","short_description":"HellaSwag validation 3009","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to prepare for laser hair removal [title] Avoid tanning and using sunless tanners for at least a month to prepare for laser hair removal. [step] The skin should be as light as possible at the time of treatment. For this reason, many people choose to undergo laser treatment during winter.\",\"endings\":\"['Use sunscreen in the weeks leading up to the procedure, make sure you read the instructions in the instruction and take it off before you get out of the room or move to the salon. Wear protective clothing to protect your skin from the sun.', 'However, sunless tanning can be harmful for even more vulnerable skin, especially older people with facial hair or bangs. If you have darker facial hair or an outdated hairstyle, you might opt for laser hair removal once and for all.', 'This makes some people more prone to skin damage than others. Sunless allows fewer wrinkles, pimples, and blemishes.', '[substeps] Apply sunscreen with at least an spf 15 if you do need to spend time outdoors, and the area you wish to have hair removed by laser will be exposed to uva/uvb rays. [title] Refrain from plucking or waxing your skin.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}