{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b668ed86-aa1f-5b74-929e-2315dde1e75b","task_key":"default--validation--13316","task_revision_id":"1","upstream_id":"13316","short_description":"HellaSwag validation 13316","config":"default","split":"validation","body":"{\"activity_label\":\"Youth\",\"ctx\":\"[header] How to pay attention in a dull class [title] Create small goals and mini-rewards to go with them. [step] For example, tell yourself that if you pay attention for the next 15 minutes, you can have a few peanut m&ms from the bag you've stashed in your backpack. For every additional 15 minutes, you get a couple more.\",\"endings\":\"['You may want to redistribute what you bring in to share with other students. Or, you may need some helpful volunteer help to progress towards your goal.', 'As the two days continue to pass by, make it more realistic with small rewards. One day you can read out loud to your kids but at dinner time, reward them with a small conversation.', 'Or, instead of m&ms, you can allow yourself to check your phone briefly. [substeps] You could also tell yourself that if you take good notes through the entire class, you can play your new video game for an hour when you get home.', \\\"The next 15 minutes, you get a treat, an extra minute of class. [title] Don't be a perfectionist.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}