{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8c4883e6-1529-55f9-bcef-4d524004858c","task_key":"default--validation--35952","task_revision_id":"1","upstream_id":"35952","short_description":"HellaSwag validation 35952","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to make time pass quickly when looking forward to something [title] Avoid watching the clock. [step] Turn your clocks over or put them in a closet or drawer where you can't see them. Set each clock for a slightly different time.\",\"endings\":\"[\\\"When you check the time, you'll have to remember how you adjusted this clock. This will help you redirect your thinking away from the passage of time.\\\", \\\"Be sure to look back to the time every now and then so that you don't miss one hour of work. Try watching what other people do so that you feel like you're in charge of how much time you have left.\\\", 'That way, you get to see how long an hour passed, and that will make your time pass faster. Also consider keeping a regular alarm clock in your room so you can hear it a lot better.', 'See below for example how to do this. [title] Think about what time you need to get up to grab dinner.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}