{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"bbeh","formal_name":"BIG-Bench Extra Hard (BBEH)","introduction":"BIG-Bench Extra Hard evaluates language-model reasoning through challenging task categories. It offers full and mini distributions; this import contains the full distribution: 4,520 questions across all 23 task categories.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-deepmind/bbeh","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"06d91f85-c102-5ebc-88ba-8c54523f9258","task_key":"bbeh~5ftime~5farithmetic--full--06d91f85-c102-5ebc-88ba-8c54523f9258","task_revision_id":"1","upstream_id":"","short_description":"Let the answer to Question1 be X.","config":"bbeh_time_arithmetic","split":"full","body":"{\"input\":\"Let the answer to Question1 be X.\\n\\nQuestion1: Today is 2009-09-22 and I was born on 2008-10-22. I am M months old. Compute M. You can assume the time between the same date in two consecutive months to be 1 month. Eg: the time between 02/13/2020 and 03/13/2020 is 1 month. Your answer should be the number of months without the unit (for example, 12).\\n\\nLet the answer to Question2 be Y.\\n\\nQuestion2: Elizabeth was born on 1997-Sep-20 and Mason was born on 1998-Apr-20. Mason is M months younger than Elizabeth. Compute M.  You can assume the time between the same date in two consecutive months to be 1 month. Eg: the time between 02/13/2020 and 03/13/2020 is 1 month. Your answer should be the number of months without the unit (for example, 12).\\n\\nLet the answer to Question3 be Z.\\n\\nQuestion3: Bob was born on 1995-07-25. Compute his age in days on 1999-03-19. Both dates are in yyyy-mm-dd format. Your answer should be the number of days without the unit (for example, 233).\\n\\nLet X' = X - 5, Y' = Y + 23, and Z' = Z - 1316.\\n\\nUse these values to solve Question4.\\n\\nQuestion4: In a movie, here are some activities Alex did. He was traveling on Jun 25, 1829. He also did some camping and fishing in October 2022 and on 15 Mar, 2071 respectively. He was also hunting in September 1782 and gardening on 20 November, 1839 at X':Y':Z' (24hr). Arrange the activities Alex did in descending order. If a date/time is at a lower granularity, assume the earliest value for the missing information. Eg: if the date is Feb, 2020, assume the complete time to be 1 Feb 2020 00:00:00. \\\" Your answer should be an ordered list (for example, [answer1, answer2, ...]).\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-deepmind/bbeh","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}