{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"bbeh","formal_name":"BIG-Bench Extra Hard (BBEH)","introduction":"BIG-Bench Extra Hard evaluates language-model reasoning through challenging task categories. It offers full and mini distributions; this import contains the full distribution: 4,520 questions across all 23 task categories.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-deepmind/bbeh","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8ef3ed5b-da8f-5b61-b6d6-a5d63aa26893","task_key":"bbeh~5ftemporal~5fsequence--full--8ef3ed5b-da8f-5b61-b6d6-a5d63aa26893","task_revision_id":"1","upstream_id":"","short_description":"Charlotte, Victoria, Nancy, Karen, Sarah and Yolanda work from 9 to 5 their…","config":"bbeh_temporal_sequence","split":"full","body":"{\"input\":\"Charlotte, Victoria, Nancy, Karen, Sarah and Yolanda work from 9 to 5 their local time on weekdays. They want to have a meeting some time this week.\\n\\nThe schedule for Charlotte's week in their local time is as follows:\\nMonday: Booked at the following times: from 9:30 to 9:45, from 10:05 to 10:35, from 10:55 to 12:00, from 12:35 to 12:50\\nTuesday: Free only at the following times: from 9:10 to 10:30, from 11:35 to 11:35, from 12:45 to 17:00\\nWednesday: Free only at the following times: anytime before 10:15, from 10:25 to 11:20, from 12:30 to 13:10, anytime after 14:15\\nThursday: Free only at the following times: from 9:00 to 9:35, from 9:55 to 11:25, from 11:55 to 12:25, from 12:45 to 17:00\\nFriday: Free only at the following times: from 9:00 to 9:30, from 9:50 to 11:15, from 12:30 to 13:55, from 14:00 to 14:25, from 14:50 to 17:00\\n\\n\\nThe schedule for Victoria's week in their local time is as follows:\\nMonday: Free only at the following times: anytime before 10:20, from 11:35 to 12:10, from 12:40 to 17:00\\nTuesday: Booked at the following times: from 9:00 to 9:20, from 10:40 to 11:30, from 11:50 to 12:10\\nWednesday: Free only at the following times: anytime before 9:05, from 9:20 to 10:10, anytime after 11:30\\nThursday: Free only at the following times: anytime before 9:35, from 10:55 to 12:25, from 12:55 to 13:00, from 13:55 to 15:05, from 15:20 to 17:00\\nFriday: Free only at the following times: from 9:00 to 9:35, from 10:40 to 11:05, from 12:10 to 12:10, from 12:15 to 17:00\\n\\n\\nThe schedule for Nancy's week in their local time is as follows:\\nMonday: Booked at the following times: from 9:25 to 10:00, from 10:55 to 12:25, from 12:40 to 13:25, from 14:25 to 15:45\\nTuesday: Free only at the following times: anytime before 10:20, from 11:50 to 12:50, from 14:20 to 14:55, anytime after 15:40\\nWednesday: Free only at the following times: from 9:00 to 9:45, from 10:00 to 10:15, from 11:10 to 12:25, from 13:55 to 17:00\\nThursday: Booked at the following times: from 9:45 to 10:40, from 11:20 to 11:30\\nFriday: Booked at the following times: from 9:15 to 10:40, from 11:25 to 12:25, from 12:25 to 13:40\\n\\n\\nThe schedule for Karen's week in their local time is as follows:\\nMonday: Free only at the following times: anytime before 9:25, from 10:25 to 10:25, from 11:50 to 12:50, from 13:35 to 17:00\\nTuesday: Free only at the following times: from 9:00 to 10:15, from 10:40 to 11:20, from 11:30 to 17:00\\nWednesday: Booked at the following times: from 9:50 to 10:30, from 11:00 to 12:25\\nThursday: Free only at the following times: from 9:00 to 9:30, from 10:30 to 10:35, from 10:40 to 11:35, from 12:50 to 13:50, anytime after 14:20\\nFriday: Booked at the following times: from 10:15 to 11:00, from 11:00 to 12:00, from 13:15 to 13:25, from 14:30 to 15:15\\n\\n\\nThe schedule for Sarah's week in their local time is as follows:\\nMonday: Booked at the following times: from 9:00 to 10:20, from 11:10 to 11:45\\nTuesday: Booked at the following times: from 9:25 to 10:50, from 11:30 to 12:55, from 13:45 to 14:20, from 14:35 to 15:45\\nWednesday: Booked at the following times: from 9:30 to 10:05, from 11:05 to 12:10, from 12:10 to 12:30\\nThursday: Booked at the following times: from 9:10 to 9:30, from 10:05 to 10:30\\nFriday: Booked at the following times: from 9:30 to 9:45, from 9:50 to 11:20\\n\\n\\nThe schedule for Yolanda's week in their local time is as follows:\\nMonday: Booked at the following times: from 10:30 to 10:35, from 11:20 to 12:50, from 13:15 to 13:25, from 14:05 to 15:00\\nTuesday: Booked at the following times: from 9:35 to 9:55, from 10:15 to 11:35\\nWednesday: Booked at the following times: from 9:40 to 10:15, from 11:00 to 12:20, from 13:10 to 13:30\\nThursday: Booked at the following times: from 9:35 to 10:50, from 11:30 to 12:40, from 13:05 to 13:25\\nFriday: Free only at the following times: from 9:00 to 9:25, from 10:00 to 11:15, from 11:20 to 12:40, from 13:30 to 17:00\\n\\n\\nCharlotte prefers short meetings on Mondays and Thursdays and accepts new meetings on these two days only if they are at most 1 hour long\\nVictoria feels tired late in the day and requires the meeting to end before 4pm\\nNancy is flexible to miss the last (at most) 10 minutes of the meeting\\nKaren asks the meeting to be scheduled such that she has at least 10 minutes of free time before the meeting (the free time must fall within her 9am to 5pm)\\nSarah is in a timezone that is one hour ahead of other participants\\nYolanda asks the meeting to be scheduled such that she has at least 10 minutes of free time after the meeting (the free time must fall within her 9am to 5pm)\\nLet X be the length of the longest meeting (in minutes) that can be scheduled if the meeting has to start on the hour or half hour. Also, let Y be number of possible options of such meetings. Compute X and Y and report them separated by a comma (e.g., 45, 3). If X is 0, report 0, 0.\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-deepmind/bbeh","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}