{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"bbeh","formal_name":"BIG-Bench Extra Hard (BBEH)","introduction":"BIG-Bench Extra Hard evaluates language-model reasoning through challenging task categories. It offers full and mini distributions; this import contains the full distribution: 4,520 questions across all 23 task categories.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-deepmind/bbeh","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e9be39f1-04a0-518e-b09c-123d256ba244","task_key":"bbeh~5ftime~5farithmetic--full--e9be39f1-04a0-518e-b09c-123d256ba244","task_revision_id":"1","upstream_id":"","short_description":"Let the answer to Question1 be X.","config":"bbeh_time_arithmetic","split":"full","body":"{\"input\":\"Let the answer to Question1 be X.\\n\\nQuestion1: Hannah and Chris were born on 2006-Dec-28 and 2007-Nov-05 respectively. When Chris was 838 days old, how old was Hannah in days? Your answer should be the number of days without the unit (for example, 233).\\n\\nLet the answer to Question2 be Y.\\n\\nQuestion2: If the current date is 1997-10-16 and I was born on 1996-01-30, what is my age in days? Your answer should be the number of days without the unit (for example, 233).\\n\\nLet the answer to Question3 be Z.\\n\\nQuestion3: Today is 2008-04-27 (yyyy-mm-dd format) and I was born on 2006-08-27. I am M months old. Compute M. You can assume the time between the same date in two consecutive months to be 1 month. Eg: the time between 02/13/2020 and 03/13/2020 is 1 month. Your answer should be the number of months without the unit (for example, 12).\\n\\nLet X' = X - 1146, Y' = Y - 608, and Z' = Z + 27.\\n\\nUse these values to solve Question4.\\n\\nQuestion4: In a movie, here are some activities David did. He was meditating at  22:01 (24hr). He also did some shopping and cooking at X':Y':Z' AM and 09:00 (24hr) respectively. He was also working out at 06:07 PM and plant watering at 10:26:24 AM. Arrange the activities David did in descending order. If a time is at a lower granularity, assume the earliest value for the missing information. Eg: if the time is 2:40 PM, assume the complete time to be 2:40:00 PM. Your answer should be an ordered list (for example, [answer1, answer2, ...]).\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-deepmind/bbeh","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}