{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"bbh","formal_name":"BIG-Bench Hard","introduction":"BIG-Bench Hard is the set of 23 BIG-Bench tasks on which models of the time scored below the average human rater. It is best known for showing how much chain-of-thought prompting changes the result.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/suzgunmirac/BIG-Bench-Hard","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8ffce2aa-cac6-5eb7-ab31-eccd69550afe","task_key":"temporal~5fsequences--main--8ffce2aa-cac6-5eb7-ab31-eccd69550afe","task_revision_id":"1","upstream_id":"","short_description":"Today, Jessica went to the dance studio. Between what times could they have…","config":"temporal_sequences","split":"main","body":"{\"input\":\"Today, Jessica went to the dance studio. Between what times could they have gone?\\nWe know that:\\nJessica woke up at 5am.\\nJennifer saw Jessica taking photos near the Leaning Tower of Pisa from 8am to 1pm.\\nSusan saw Jessica reading at the library from 1pm to 3pm.\\nJason saw Jessica taking photos near the Eiffel Tower from 3pm to 6pm.\\nSarah saw Jessica working out at the gym from 6pm to 7pm.\\nBetty saw Jessica fixing their computer at the electronic store from 7pm to 8pm.\\nThe dance studio was closed after 8pm.\\nBetween what times could Jessica have gone to the dance studio?\\nOptions:\\n(A) 6pm to 7pm\\n(B) 3pm to 6pm\\n(C) 5am to 8am\\n(D) 7pm to 8pm\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/suzgunmirac/BIG-Bench-Hard","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}