{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"bbeh","formal_name":"BIG-Bench Extra Hard (BBEH)","introduction":"BIG-Bench Extra Hard evaluates language-model reasoning through challenging task categories. It offers full and mini distributions; this import contains the full distribution: 4,520 questions across all 23 task categories.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-deepmind/bbeh","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"093d40a2-503d-5ec6-9ca3-567919e6c641","task_key":"bbeh~5ftemporal~5fsequence--full--093d40a2-503d-5ec6-9ca3-567919e6c641","task_revision_id":"1","upstream_id":"","short_description":"Amelia, Ava, Zoey, Rachel and Nancy work from 9 to 5 their local time on…","config":"bbeh_temporal_sequence","split":"full","body":"{\"input\":\"Amelia, Ava, Zoey, Rachel and Nancy work from 9 to 5 their local time on weekdays. They want to have a meeting some time this week.\\n\\nThe schedule for Amelia's week in their local time is as follows:\\nMonday: Booked at the following times: from 10:05 to 10:10, from 11:05 to 11:40, from 11:55 to 12:30\\nTuesday: Free only at the following times: from 9:00 to 9:50, from 10:15 to 11:40, from 12:45 to 17:00\\nWednesday: Booked at the following times: from 9:05 to 9:35, from 10:35 to 11:20, from 11:45 to 12:40, from 13:55 to 14:10\\nThursday: Booked at the following times: from 9:30 to 9:50, from 9:50 to 10:10, from 11:25 to 12:30\\nFriday: Booked at the following times: from 9:15 to 9:45, from 11:15 to 11:55, from 12:35 to 14:05\\n\\n\\nThe schedule for Ava's week in their local time is as follows:\\nMonday: Booked at the following times: from 9:10 to 9:40, from 10:50 to 12:10, from 12:15 to 13:20, from 14:40 to 15:20\\nTuesday: Booked at the following times: from 9:35 to 10:45, from 11:00 to 11:15, from 12:00 to 12:30\\nWednesday: Free only at the following times: from 9:00 to 9:05, from 10:35 to 11:55, from 12:35 to 17:00\\nThursday: Free only at the following times: anytime before 9:45, from 10:30 to 11:40, from 12:25 to 13:50, from 14:25 to 15:30, from 16:50 to 17:00\\nFriday: Booked at the following times: from 10:25 to 11:35, from 12:55 to 13:40\\n\\n\\nThe schedule for Zoey's week in their local time is as follows:\\nMonday: Free only at the following times: from 9:00 to 9:50, from 10:25 to 10:50, anytime after 12:20\\nTuesday: Booked at the following times: from 10:30 to 10:55, from 11:15 to 12:15\\nWednesday: Booked at the following times: from 9:45 to 10:50, from 11:20 to 12:10, from 12:35 to 14:05\\nThursday: Free only at the following times: from 9:00 to 9:15, from 9:20 to 10:30, from 11:50 to 17:00\\nFriday: Booked at the following times: from 10:15 to 10:40, from 11:10 to 12:30, from 13:35 to 14:05\\n\\n\\nThe schedule for Rachel's week in their local time is as follows:\\nMonday: Free only at the following times: from 9:00 to 9:05, from 9:10 to 10:15, anytime after 10:20\\nTuesday: Booked at the following times: from 9:35 to 10:25, from 11:10 to 12:20, from 13:05 to 14:05, from 14:10 to 14:50\\nWednesday: Booked at the following times: from 10:00 to 11:20, from 12:50 to 13:50, from 14:40 to 15:55, anytime after 16:55\\nThursday: Free only at the following times: from 9:00 to 10:10, from 11:05 to 11:35, from 11:40 to 12:15, from 13:15 to 13:55, from 14:15 to 17:00\\nFriday: Free only at the following times: from 9:00 to 10:05, from 10:15 to 10:55, from 11:50 to 17:00\\n\\n\\nThe schedule for Nancy's week in their local time is as follows:\\nMonday: Booked at the following times: from 10:10 to 11:15, from 11:30 to 12:40, from 13:05 to 14:15, from 14:15 to 15:00\\nTuesday: Free only at the following times: from 9:00 to 10:20, from 10:25 to 10:35, from 11:15 to 17:00\\nWednesday: Booked at the following times: from 10:25 to 11:50, from 11:50 to 12:40\\nThursday: Free only at the following times: from 9:00 to 9:30, from 10:00 to 10:30, from 11:00 to 17:00\\nFriday: Booked at the following times: from 9:40 to 10:25, from 11:10 to 12:15, from 12:45 to 13:25, from 14:45 to 16:00\\n\\n\\nAmelia can clear any meeting of 30 minutes or less from their schedule to accommodate the meeting\\nAva is fine to stay until 6pm to accommodate the meeting\\nZoey prefers long meetings on Tuesdays and Fridays and accepts new meetings on these two days only if they are at least 30 minutes long\\nRachel needs a break for lunch on Wednesday from 12:30 to 1:00\\nNancy is in a timezone that is one hour ahead of other participants\\nLet X be the length of the longest meeting (in minutes) that can be scheduled if the meeting has to start on the hour or half hour. Also, let Y be number of possible options of such meetings. Compute X and Y and report them separated by a comma (e.g., 45, 3). If X is 0, report 0, 0.\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-deepmind/bbeh","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}