{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"bbeh","formal_name":"BIG-Bench Extra Hard (BBEH)","introduction":"BIG-Bench Extra Hard evaluates language-model reasoning through challenging task categories. It offers full and mini distributions; this import contains the full distribution: 4,520 questions across all 23 task categories.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-deepmind/bbeh","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0a92d286-6a2e-5cff-a1ba-9f6f0a165973","task_key":"bbeh~5ftime~5farithmetic--full--0a92d286-6a2e-5cff-a1ba-9f6f0a165973","task_revision_id":"1","upstream_id":"","short_description":"Let the answer to Question1 be X.","config":"bbeh_time_arithmetic","split":"full","body":"{\"input\":\"Let the answer to Question1 be X.\\n\\nQuestion1: Christina and Brad were born on 2014-Nov-13 and 2015-Jul-19 respectively. When Brad was 174 days old, how old was Christina in days? Your answer should be the number of days without the unit (for example, 233).\\n\\nLet the answer to Question2 be Y.\\n\\nQuestion2: The war had been going on for 247 days on 2019-11-24. How many days had it been going on for on 2020-04-30, if it never stopped in between the 2 dates? (Answer in days). Your answer should be the number of days without the unit (for example, 233).\\n\\nLet the answer to Question3 be Z.\\n\\nQuestion3: Today is 2007-08-20 and I was born on 2006-03-20. I am M months old. Compute M. You can assume the time between the same date in two consecutive months to be 1 month. Eg: the time between 02/13/2020 and 03/13/2020 is 1 month. Your answer should be the number of months without the unit (for example, 12).\\n\\nLet X' = X - 418, Y' = Y - 378, and Z' = Z + 2049.\\n\\nUse these values to solve Question4.\\n\\nQuestion4: If Jason, Emma, Lily, Dan, Kyle have their exams at (date_times separated by ;): on December 15, 1897 at 07:06:23 AM; on Oct 28, 1775; in February 1954; on X'-Y'-Z' at 06:45:07 PM; on 26-10-1925 at 13:02:25 (24hr) respectively, arrange them in ascending order. If a date/time is at a lower granularity, assume the earliest value for the missing information. Eg: if the date is Feb, 2020, assume the complete time to be 1 Feb 2020 00:00:00. \\\" Your answer should be an ordered list (for example, [answer1, answer2, ...]).\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-deepmind/bbeh","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}