{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"29362384-1d15-5c2f-b237-3243f53916a4","task_key":"default--validation--454","task_revision_id":"1","upstream_id":"454","short_description":"HellaSwag validation 454","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to choose a boarding school in dehradun [title] Decide why dehradun is the chosen location. [step] Dehradun is considered to be a hub of top reputed boarding schools in india. It is the area where many parents are keen to send their child for schooling.\",\"endings\":\"[\\\"[substeps] Arriving in india in 2014 will pay more than 2 thousand points. In order to get accepted to an indian boarding school, you'll need to demonstrate that you are a bright, energetic student and you can pass the financial challenges and placement test.\\\", '[title] Prepare a list of all the schools in dehradun that you favour. [step] Check the school websites and video tours.', 'Exhaust other considerations before choosing a boarding school. [substeps] Think back over which boarding schools are located in india and which one is undesirable.', 'Do the research that will determine the best boarding school for you. Look into the websites that list your location and determine which schools are right for you.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}