{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f7149d25-8372-59bc-8a5d-b41bec92539a","task_key":"default--validation--20050","task_revision_id":"1","upstream_id":"20050","short_description":"HellaSwag validation 20050","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to be a great parent to a toddler [title] Show your love. [step] You simply cannot be too loving toward your child. Children aren't \\\" spoiled \\\" by an overabundance of affection.\",\"endings\":\"[\\\"Some toddlers don't feel loved at all. Instead, parents want their children to feel like parents, which can be very difficult.\\\", \\\"But that doesn't mean you need to be selfish. Show your love to your child by : [substeps] Putting your child first.\\\", '\\\" spoiling \\\" is the result of substituting things for affection. Toddlers, in particular, need time when they can just \\\" be, \\\" snuggling on your lap or enjoying a long hug.', 'If you love them, this will be evident. Instead, show that love is definitely appreciated by your child.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}