{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"99c5ea4a-cf3f-5d12-8aa3-3209ae29f238","task_key":"default--validation--19635","task_revision_id":"1","upstream_id":"19635","short_description":"HellaSwag validation 19635","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to blend and create a new family through open adoption [title] Contact and work with an adoption agency that performs open adoptions. [step] Open adoptions are where the adopted child knows his birth parents and family along with his adoptive family. [title] Realize finding the right adoptive family is much like courtship.\",\"endings\":\"['[step] Through open adoptions your child learns that a child will be available for adoption even though he will not be socialized physically. The adoption agency requires important knowledge about your child in order to perform open adoption and to guide the adoption process.', '[step] Search the internet for open adoption agency names. Upon meeting a potential adoptive family, you will be charged a fee for adopting.', '[step] Finding a group in your area and family close to that will be tricky when attempting to force an open adoption, but can be done in many ways. [substeps] Find an adoption agency with an english language pedigree system.', '[step] Once you meet the \\\" right \\\" family the magic will happen. Try to find a family that has similar values and outlook as yours.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}