{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"68f301ce-fe2a-537d-b989-6dc622b5aa39","task_key":"default--validation--18629","task_revision_id":"1","upstream_id":"18629","short_description":"HellaSwag validation 18629","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to adopt a japanese baby [title] Ensure that you qualify. [step] Before you can actually begin the adoption process, you should take steps to ensure that you qualify for an international adoption. Because the adoption is an international coordination, there are certain conditions that must be met in order for the process to be approved.\",\"endings\":\"['[substeps] The adopting parents must typically live in japan throughout the entire court process. This requires a minimum stay of six months, but the court process may take up to 18 months.', 'You need to ensure that you meet all of the following requirements for the custody and child support process : [substeps] You are approved for an international adoption if you are able to provide adequate financial support for your travel expenses and pay out of pocket all expenses. Your income will be that of your adopted baby.', 'You should review your passport closely to determine if you are eligible to adopt a japanese baby. [substeps] You should also consider your weight and age.', 'These include : [substeps] You will be traveling with your child. It might be necessary to hire an organization to conduct the adoption.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}