Benchmark AI / Public workspace
LongBench v2
Reasoning / Long context
LongBench v2 evaluates deep understanding and reasoning over long contexts through multiple-choice questions. Its official description lists 503 questions spanning tasks such as single-document and multi-document QA and code-repository understanding.
Japanese introduction
長い資料の深い理解と推論を、多肢選択問題で評価するベンチマークです。公式紹介では503問を収録し、単一・複数文書の質問応答やコードリポジトリ理解などを扱います。
longbench-v2
Full text: eligible public problems include text, images and discussion.
Tasks
Whole public benchmark.
- Public problems
- 200
- Formats
- text (200)
- Problems with images
- 0
- Answer availability
- Answer published by the source (200)
- Configs
- Default (200)
- Splits
- train (200)
- Awaiting a first discussion
- 200
- From August 1996 to March 1998, a credit officer named Zhang from a town credit…
Answer published by the source
- Of these, which happens first?
Answer published by the source
- Why can VR Headset be used to help understand haptic slant adaptation in this…
Answer published by the source
- In Agatha Christie's "The Murder on the Links," which statement is true?
Answer published by the source
- To marry Emily in Stardew Valley, players are required to improve the friendship…
Answer published by the source
- Which of the following is true according to the handbook?
Answer published by the source
- How is Eliza Williams related to Colonel Brandon?
Answer published by the source
- Which following option is wrong, according to the topic "disaster " in the text?
Answer published by the source
- When it comes to large-scale volumetric calcium imaging, which statement is…
Answer published by the source
- These two articles both focused on mix-precision acceleration, especially…
Answer published by the source
- These are two articles about grassland simulation. The first article is…
Answer published by the source
- According to the report, which of the following statements about the UNI-ASIA…
Answer published by the source
- If you are a compliance lawyer specialising in EU environmental law, in which of…
Answer published by the source
- Both ‘Sport and Secessionism’ and ‘Discrimination, Sport, and Nation Building…
Answer published by the source
- Who ate dinner after Don Quixote's fight with the giants/windmills?
Answer published by the source
- This is the troch.nn modeule. In this module, there exists an implementation of…
Answer published by the source
- How do Charmaz and Thornberg in The Pursuit of Quality in Grounded Theory and…
Answer published by the source
- Which model is best suited for identifying genes related to neuron migration,…
Answer published by the source
- According to the report, how to promote the construction of smart courts?
Answer published by the source
- Regarding the statements about the TCP connection termination in this codebase,…
Answer published by the source
- The IEA’s 2024 World Energy Investment report highlights a significant imbalance…
Answer published by the source
- What inputs are necessary to create an instance of HYPRE_SStructMatrix? And what…
Answer published by the source
- Which of the following statements below are false according to the three…
Answer published by the source
- Imagine a scenario in which a high-ranking officer in the Canadian Forces…
Answer published by the source
- Recently, I bought a Casio scientific calculator, and its functions are quite…
Answer published by the source
- What was the primary cause of Teoh Beng Hock's death, according to the initial…
Answer published by the source
- Which of the following can we infer according to the diffierences and…
Answer published by the source
- The NSW Health Annual Reports for 2020-21 and 2022-23 reflect changes in…
Answer published by the source
- In the context of the MVPF (Marginal Value of Public Funds) framework, which of…
Answer published by the source
- In light of the empirical data reflecting a decline in urban renewal projects…
Answer published by the source
- In the function that calculates the derivative of given functions, which of the…
Answer published by the source
- When the accountant registers according to the bookkeeping, he mistakenly fills…
Answer published by the source
- Regarding the comparison of the methods for improving math ability in these two…
Answer published by the source
- You are given a grammar book of Kalamang language, now translate the following…
Answer published by the source
- According to the paper, what is the fundamental difference in jurisprudence…
Answer published by the source
- Based on the energy outlook and policy scenarios presented in the report, which…
Answer published by the source
- Read the above materials on Zhuang language, and choose the most accurate…
Answer published by the source
- Which floor do Becca DiNuzio and Greg Barney live on?
Answer published by the source
- Please try to deduce the true story based on the evidence currently known. Who…
Answer published by the source
- Please try to deduce the true story based on the evidence currently known. Who…
Answer published by the source
- Please try to deduce the true story based on the evidence currently known. Who…
Answer published by the source
- Please try to deduce the true story based on the evidence currently known. In…
Answer published by the source
- Which of the topics has been asked by the users for suggestions?
Answer published by the source
- When will the user turn forty？
Answer published by the source
- Which player contributed the second most tokens in the game?
Answer published by the source
- Which player got the least utility in the game?
Answer published by the source
- Which television films mainly depict Q2736 and originate in the Q145?
Answer published by the source
- Of all the animes that have less than 10 seasons, which has the highest number…
Answer published by the source
- Document: Margareta Slots or Margareta Cabiljau ( died 1669 ) was the royal…
Answer published by the source
- How many matches has Q439302 played as a member of Q18521?
Answer published by the source