{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f6a8a1e8-8349-5a79-924d-5cb5d8d2430e","task_key":"default--validation--43053","task_revision_id":"1","upstream_id":"43053","short_description":"HellaSwag validation 43053","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to plan an outing for your toddler [title] Look for something to do near your home. [step] Read local newspapers or join parenting groups to find out about activities or events that are happening in your area. Doing things in the area means that you won't have to travel far with your toddler, which can make an event stressful.\",\"endings\":\"[\\\"If you have to return home, you're only a short trip away. [substeps] Planning an event nearby also means that you have more flexibility.\\\", '[substeps] Driving to and from work typically is your primary route, but you can also drive your toddler to see the sights after an outing. If you go with your toddler to the movies or dinner at your home, include this experience in your schedule.', 'If the weather is too rainy, you can take your toddler for a walk outside right after school, or bring your toddler to a play park. [substeps] A fun activity can be anything from going for long walks to playing on the trampoline at the park.', 'If your toddler is in a daycare or are on his or her way home, there may be something to do near you-such as attending an arts program or taking a tour of a nearby park. [title] Invite your toddler to hang out with you.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}