{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bdf04705-2677-573e-aab4-0996c424e384","task_key":"default--validation--48484","task_revision_id":"1","upstream_id":"48484","short_description":"HellaSwag validation 48484","config":"default","split":"validation","body":"{\"activity_label\":\"Sports and Fitness\",\"ctx\":\"[header] How to increase stamina levels for ballet [title] Drink lots of water. [step] Especially if it is warm, water is crucial for building stamina. Bring a bottle of water and maybe an energy drink and refill it during breaks.\",\"endings\":\"['This is important for maintaining physical performance while dancing and will help you drink plenty of water during ballet. [title] Do backbends to help you increase stamina and improve your balance while dancing.', 'In addition to water, try to drink a lot of water. [title] Try a warm bath and some close meditating and reflection activity.', 'Ice is an idea if you know the weather is hot-warm water is not pleasant! Alternatively, ask if your dance school or theatre has a fridge you can keep your spare bottles in. If the answer is yes, name your bottle! Lots of people will take advantage of the fridge.', 'A good rule of thumb is to drink at least nine glasses a day. Water is best, and 2 bottles of water for every person at a time.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}