{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"334a715c-df89-554e-b4e6-05a5ffaa1919","task_key":"default--validation--19253","task_revision_id":"1","upstream_id":"19253","short_description":"HellaSwag validation 19253","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to spend more time in nature as a family [title] Go to a park. [step] Do an online search to find local parks. Whether it's a smaller local park or a larger national park, a day-trip is an excellent way to spend a couple of hours outdoors with your family.\",\"endings\":\"['If you have young kids, consider taking them to a place that has activities, such as a playground, to maintain their attention. [substeps] If there are no parks near you, you can plan a camping trip in your own backyard.', 'You can play your instrument under trees, go sledding, hike together, etc. Your family member, enjoy the beauty and nature while also doing something great to their garden.', '[substeps] Lake brook park has an annual outdoors adventure for all children. They offer free activities like playing frisbee or swimming or even reading a book together.', 'This is especially helpful to children as they can see nature through the canopy. Weather permitting, visit a park as often as the weather permits.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}