{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"noindex","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[]}},"task_id":"a7ccf082-0473-5691-b65a-3af4a488bb47","task_key":"default--validation--a7ccf082-0473-5691-b65a-3af4a488bb47","task_revision_id":"2","upstream_id":"","short_description":"did my name is earl finish his list","config":"default","split":"validation","body":"{\"passage\":\"I had always had an ending to Earl and I'm sorry I didn't get the chance to see it happen. You've got a show about a guy with a list so not seeing him finish it is a bummer. But the truth is, he wasn't ever going to finish the list. The basic idea of the ending was that while he was stuck on a really hard list item he was going to start to get frustrated that he was never going to finish it. Then he runs into someone who had a list of their own and Earl was on it. They needed to make up for something bad they had done to Earl. He asks them where they got the idea of making a list and they tell him that someone came to them with a list and that person got the idea from someone else. Earl eventually realizes that his list started a chain reaction of people with lists and that he's finally put more good into the world than bad. So at that point he was going to tear up his list and go live his life. Walk into the sunset a free man. With good karma. --Greg Garcia\",\"question\":\"did my name is earl finish his list\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}