{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b5b7aea0-4cfd-555d-9c8c-02f382b3445b","task_key":"default--validation--34982","task_revision_id":"1","upstream_id":"34982","short_description":"HellaSwag validation 34982","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to look good while growing out a short haircut [title] Pin back fly-aways. [step] If you have strands of hair that are too short to pull up but too long to let hang, try pinning them back. Bobby pins will more often than not be your constant companion in the weeks and months it takes to grow out a short haircut.\",\"endings\":\"['Plus they can help prevent flying-aways if you really want them. [title] Enhance your liking of most hairstyles.', \\\"Here's a quick guide for those a little out of practice : [substeps] Make a deep part on one side of your forehead just above the center of one of your eyes. Then sweep that portion of hair to the side, using pins to hold it back.\\\", '[substeps] If you only have a single-strand look, try to keep your hair as loose as possible for when you grow it out. Working with a loose afro and layering layers can help you tame and protect the split ends.', \\\"A few good bobby pins can provide great support while this is happening. [substeps] Hat pins are good, too-bobby pins will help set your look while you're doing certain tasks or shopping.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}