{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8dcc5119-66e0-5710-9162-d346e534b80f","task_key":"default--validation--3101","task_revision_id":"1","upstream_id":"3101","short_description":"HellaSwag validation 3101","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to get pregnant with polycystic ovary syndrome (pcos ) [title] Reduce your circulating insulin levels with lifestyle changes. [step] Many women with pcos will need help regulating their ovulation and protecting against miscarriage, which requires supervision of a trained doctor. Your doctor will help you with this, as well as monitor you early in your pregnancy.\",\"endings\":\"['Your doctor may recommend sleeping and eating healthily and exercising regularly. Reduce your intake of foods that may harm your uterus by switching to plant-like foods and drinking adequate fluids.', '[substeps] Medications you are taking to manage your pcos may not be safe for use in pregnancy, and they will need to be changed or discontinued. This is another excellent reason to see your doctor right away.', '[substeps] You may try a variety of lifestyle changes, from improving your diet to increasing your exercise routine. Any changes to this may put you at higher risk for developing pcos.', 'Start by: taking up to 1 , 000 calories from your diet at least 3 days before you start using pcos treatment. Switching to more low-calorie foods for the first 2 weeks.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}