{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a5283eb0-9570-5544-8922-f63adc99e55b","task_key":"default--validation--10054","task_revision_id":"1","upstream_id":"10054","short_description":"HellaSwag validation 10054","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to do wedding updos [title] Start by getting your hair in top form. [step] All hairstyles will look more polished once done and be easier to create when your hair is healthy. If it's not in its best shape, start fixing that early.\",\"endings\":\"['[substeps] Although head-to-toe updos can contain a lot of styling, these are going to be more expensive and more intricate-looking. [title] Make sure your hair is clean and tangle-free.', 'Start by getting a deep conditioning and an allover trim. Continue these, in addition to maintaining the necessary balance of moisture and protein in your hair, through washing and conditioning.', 'For \\\" healthy hair \\\" enough, you\\\\'re in luck: ) [substeps] Try a classic ponytail. If your hair is straight, you can use loose knots or dos.', '[substeps] With your hair to your preference, the goal is to do the wedding-like updos in the sunlight. If you go outside, you might want to spray flowers on your hair using a spray bottle.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}