{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"bbh","formal_name":"BIG-Bench Hard","introduction":"BIG-Bench Hard is the set of 23 BIG-Bench tasks on which models of the time scored below the average human rater. It is best known for showing how much chain-of-thought prompting changes the result.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/suzgunmirac/BIG-Bench-Hard","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3d383dfd-6323-5c4c-b7e4-6e17cd1f4cf0","task_key":"temporal~5fsequences--main--3d383dfd-6323-5c4c-b7e4-6e17cd1f4cf0","task_revision_id":"1","upstream_id":"","short_description":"Today, Elizabeth went to the park. Between what times could they have gone?","config":"temporal_sequences","split":"main","body":"{\"input\":\"Today, Elizabeth went to the park. Between what times could they have gone?\\nWe know that:\\nElizabeth woke up at 10am.\\nEmily saw Elizabeth buying a bike at the bike shop from 10am to 11am.\\nLeslie saw Elizabeth buying lunch at the deli from 11am to 2pm.\\nSarah saw Elizabeth playing tennis at the tennis court from 4pm to 8pm.\\nThe park was closed after 8pm.\\nBetween what times could Elizabeth have gone to the park?\\nOptions:\\n(A) 10am to 11am\\n(B) 11am to 2pm\\n(C) 4pm to 8pm\\n(D) 2pm to 4pm\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/suzgunmirac/BIG-Bench-Hard","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}