{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"155804d3-7e49-58fc-9f7a-3b698b51c2df","task_key":"default--validation--3789","task_revision_id":"1","upstream_id":"3789","short_description":"HellaSwag validation 3789","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to cross examine an expert witness [title] Read the expert report. [step] An expert must provide a written report of their findings, and the other side's lawyer must give it to you ahead of time. You should read it several times.\",\"endings\":\"['Law experts never provide all the information they can get across in one paragraph. Additionally, you should write down key facts to rebut the expert report.', 'A rule of thumb is to skim through the report before you make a possible counter-claim. Your opponent is entitled to be at least partially impartial-and potentially the most so.', \\\"[substeps] Make sure you read everything that goes into the expert's report. It is helpful for expert witnesses to have pictures taken of how they felt when they were cross-examined.\\\", \\\"The expert report should form the basis of the expert's testimony in your case. [substeps] If the expert relied on tests or data, that information should be provided as well (not simply the summary provided in the expert report).\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}