{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"boolq","formal_name":"BoolQ","introduction":"BoolQ pairs naturally occurring yes/no questions from search queries with a passage that decides them. The format is simple, but the inference it needs is consistently heavier than it looks.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research-datasets/boolean-questions","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d91cfe64-f5f3-57c4-bf9f-6f273df51474","task_key":"default--validation--d91cfe64-f5f3-57c4-bf9f-6f273df51474","task_revision_id":"1","upstream_id":"","short_description":"are the ford ka and fiat 500 the same","config":"default","split":"validation","body":"{\"passage\":\"The main mechanical differentiator between the new Ka and its Fiat sibling is that the Ford has better shock absorption than the Fiat 500. Fitting a rear anti-roll bar enabled 30 percent softer springs and accordingly retuned dampers to improve ride performance over uneven road surfaces. Some of these improvements were subsequently adopted on Fiat 500 Abarth and Fiat 500C models. Changes were also made to the 500's steering geometry for the Ka, although as the new Ka uses an electrically assisted steering system, it lacks the communication of its predecessor's hydraulically assisted steering. However, the electric steering system does make the steering much lighter and more energy efficient than its predecessor.\",\"question\":\"are the ford ka and fiat 500 the same\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research-datasets/boolean-questions","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}