{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b1471561-b094-5313-9d91-1a9acf47b341","task_key":"default--validation--12175","task_revision_id":"1","upstream_id":"12175","short_description":"HellaSwag validation 12175","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to reduce the stress of your commute [title] Listen to something enjoyable. [step] Changing your environment by creating something that is pleasing to your ears may make your ride less stressful and more pleasant. You may even start to look forward to your commute.\",\"endings\":\"[\\\"[substeps] Observe the weather outside the car and try looking at the sun to make sure it isn't drafting too much of a anxiety. Consider listening to a couple of nature songs, or music that reminds you that it's time to be active.\\\", \\\"When you arrive at work, you may feel some anxiety that's worse when you need to get moving. Eliminate these fears, and replace them with something you enjoy, as this may help.\\\", 'Since watching television and looking at your phone while driving are extremely dangerous, listening to something while driving can help to entertain you and keep your mood elevated. [substeps] For instance, listening to a comedy podcast or an audiobook can make driving fun, particularly if you only allow yourself to listen to them during your commute.', '[substeps] If you find yourself stuck behind a traffic light, try closing your eyes and drifting slowly to the side, like in a car. When you turn around, stop, open your eyes, and observe the scenery around you.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}