{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b8b89e28-fbaa-5024-b56f-06dcc7c1ec66","task_key":"default--validation--29112","task_revision_id":"1","upstream_id":"29112","short_description":"HellaSwag validation 29112","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to take an ept pregnancy test [title] Take the test the day of your expected period for best results. [step] Early pregnancy tests can also be taken up to five days prior to your period, but results are not as accurate. Missing a period is usually considered a sign that you might be pregnant.\",\"endings\":\"['[substeps] Ovulation usually occurs about halfway between the start dates of two consecutive periods. Most women ovulate between 11 and 21 days into their menstrual cycle.', 'To find out if you are pregnant, talk to your doctor, or sign up to take the test the day of your planned, scheduled period. [substeps] The test should only have been taken six hours before your scheduled period.', \\\"If you haven't skipped an appointment with your physician, they may order the test the night before your scheduled period. In the past, people simply missed a period.\\\", '[substeps] You need to stop taking the test from your doctor right before your expected period. This might be during the first few days after your scheduled period or even after the first day after it starts.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}