{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"465a7432-8e17-57e9-a7e7-e7036c05b377","task_key":"default--validation--465a7432-8e17-57e9-a7e7-e7036c05b377","task_revision_id":"1","upstream_id":"","short_description":"does marley die in a little bit of heaven","config":"default","split":"validation","body":"{\"passage\":\"One morning, Marley and Sarah sit in the park. Marley confesses to Sarah that she is no longer afraid to die, even though Sarah is terrified at the prospect of having to live without her. Marley drifts off and Sarah is unable to wake her. Knowing it's almost time, Marley is visited by everyone in the hospital who surround her bed and wait with her until the end. The exception is Renee, who is in labor with her son. Julian makes it in the nick of time to say goodbye and, in that final moment, Marley realizes her third wish was to fall in love. The film ends with Marley's funeral, a colorful celebration of her life with all of her friends and family.\",\"question\":\"does marley die in a little bit of heaven\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}