{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"bbeh","formal_name":"BIG-Bench Extra Hard (BBEH)","introduction":"BIG-Bench Extra Hard evaluates language-model reasoning through challenging task categories. It offers full and mini distributions; this import contains the full distribution: 4,520 questions across all 23 task categories.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-deepmind/bbeh","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"69df8335-e38d-5a3c-866e-18144d49d30f","task_key":"bbeh~5ftemporal~5fsequence--full--69df8335-e38d-5a3c-866e-18144d49d30f","task_revision_id":"1","upstream_id":"","short_description":"Karen, Alice, Nancy, Yolanda and Ava work from 9 to 5 their local time on…","config":"bbeh_temporal_sequence","split":"full","body":"{\"input\":\"Karen, Alice, Nancy, Yolanda and Ava work from 9 to 5 their local time on weekdays. They want to have a meeting some time this week.\\n\\nThe schedule for Karen's week in their local time is as follows:\\nMonday: Free only at the following times: from 9:00 to 9:15, from 10:30 to 11:20, anytime after 11:35\\nTuesday: Booked at the following times: from 10:25 to 11:55, from 13:05 to 14:15, from 14:55 to 15:10, from 15:45 to 16:15\\nWednesday: Free only at the following times: from 9:00 to 9:10, from 9:35 to 10:10, from 11:05 to 12:15, anytime after 13:35\\nThursday: Free only at the following times: from 9:00 to 9:55, from 11:00 to 11:00, from 11:50 to 13:20, anytime after 14:15\\nFriday: Free only at the following times: anytime before 10:30, from 11:00 to 11:00, from 11:55 to 17:00\\n\\n\\nThe schedule for Alice's week in their local time is as follows:\\nMonday: Free only at the following times: from 9:00 to 10:10, from 10:20 to 10:50, from 12:10 to 12:55, from 13:45 to 13:50, anytime after 15:15\\nTuesday: Booked at the following times: from 9:55 to 11:15, from 11:55 to 13:15, from 14:20 to 15:10\\nWednesday: Free only at the following times: anytime before 10:00, from 10:50 to 11:40, from 12:45 to 13:45, from 13:55 to 14:20, anytime after 14:45\\nThursday: Free only at the following times: anytime before 9:15, from 9:35 to 10:35, from 11:30 to 17:00\\nFriday: Free only at the following times: anytime before 9:20, from 10:40 to 12:05, from 12:35 to 13:50, from 14:10 to 15:25, from 16:40 to 17:00\\n\\n\\nThe schedule for Nancy's week in their local time is as follows:\\nMonday: Free only at the following times: anytime before 10:20, from 11:30 to 12:40, from 14:00 to 14:05, anytime after 14:15\\nTuesday: Free only at the following times: anytime before 10:15, from 11:45 to 12:55, from 13:00 to 17:00\\nWednesday: Free only at the following times: anytime before 9:25, from 10:55 to 11:00, anytime after 12:10\\nThursday: Booked at the following times: from 9:50 to 10:55, from 11:40 to 13:05, from 13:40 to 14:30\\nFriday: Booked at the following times: from 9:20 to 10:50, from 11:40 to 13:05, from 13:20 to 13:40, from 14:50 to 15:20\\n\\n\\nThe schedule for Yolanda's week in their local time is as follows:\\nMonday: Free only at the following times: anytime before 9:55, from 10:05 to 10:40, from 11:35 to 11:55, from 12:45 to 13:25, anytime after 13:35\\nTuesday: Booked at the following times: from 10:10 to 11:25, from 11:40 to 12:30, from 13:40 to 13:45, from 14:00 to 14:10\\nWednesday: Booked at the following times: from 9:45 to 10:25, from 11:45 to 12:55, from 14:05 to 14:55\\nThursday: Booked at the following times: from 9:45 to 10:35, from 10:55 to 11:30, from 12:10 to 13:15\\nFriday: Free only at the following times: anytime before 10:15, from 10:25 to 11:30, anytime after 12:15\\n\\n\\nThe schedule for Ava's week in their local time is as follows:\\nMonday: Booked at the following times: from 9:50 to 10:25, from 10:25 to 11:25, from 12:55 to 14:25, from 15:30 to 16:00\\nTuesday: Free only at the following times: from 9:00 to 10:30, from 11:10 to 11:15, from 12:35 to 17:00\\nWednesday: Free only at the following times: anytime before 9:35, from 10:20 to 10:30, from 11:05 to 12:25, from 12:55 to 13:30, anytime after 14:50\\nThursday: Booked at the following times: from 10:30 to 11:25, from 11:30 to 12:55\\nFriday: Free only at the following times: from 9:15 to 10:10, anytime after 10:45\\n\\n\\nKaren feels tired late in the day and requires the meeting to end before 4pm\\nAlice needs a break for lunch on Wednesday from 12:30 to 1:00\\nNancy prefers short meetings on Mondays and Thursdays and accepts new meetings on these two days only if they are at most 1 hour long\\nYolanda is flexible to miss the last (at most) 10 minutes of the meeting\\nAva is in a timezone that is one hour ahead of other participants\\nLet X be the length of the longest meeting (in minutes) that can be scheduled if the meeting has to start on the hour or half hour. Also, let Y be number of possible options of such meetings. Compute X and Y and report them separated by a comma (e.g., 45, 3). If X is 0, report 0, 0.\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-deepmind/bbeh","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}