{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fa0ebbd8-2e83-5382-9723-25aac121b91c","task_key":"default--validation--3537","task_revision_id":"1","upstream_id":"3537","short_description":"HellaSwag validation 3537","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to diet while breastfeeding [title] Let your body naturally lose weight first. [step] You won't have to force the dieting in order to shed those post baby pounds. Breastfeeding naturally burns calories (about 500 a day) and much of the weight will go away naturally as your body shrinks.\",\"endings\":\"['[substeps] At the same time, you should be going slowly and avoiding any diet that suggests you are underweight. Your body is growing, especially in utero, and you can lose significant weight sooner than you would otherwise.', 'While you might feel embarrassed to cut back on your calories, you should do it anyway. This will help you gain the weight you need to stay healthy.', 'It will also offer you a much lower intake of mono calories during the pregnancy. So give your body a break from the exercise/cold turkey diet to give yourself time to make your body change.', \\\"Even your lactating breasts can add a couple pounds, so don't worry too much about dieting. Losing those 30 pounds will be easier than you think.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}