{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b6908a7c-ad91-5202-b8b2-bdf6a788d850","task_key":"default--validation--3244","task_revision_id":"1","upstream_id":"3244","short_description":"HellaSwag validation 3244","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to trace your ancient ancestry through dna sampling [title] Know that complete dna tests will tell you ethnic breakdown. [step] By looking at all of your dna, it can give you a rough percentage of your ancestry by country or region. [substeps] Know that there are inaccuracies in the tests.\",\"endings\":\"['There are some things the tests cannot tell very well, because the dna is similar between some countries. As an example, rarely can a test distinguish between english and scottish, or russian and polish.', 'Point out the most researched and reliable sources when you go look at these records. [substeps] You can find the missing book based on which country you originate in by searching online or by calling local databases.', 'For example, many test tests do not allow you to trace your ancestry even after determining your ancestry from that place. Look at your website: https: // www.youtube.com/about-spectrum-experimentation/lc8-biology/2917168.html to find out how to replicate your ancestry.', 'While the test is detailed, people usually have a disproportionate range of ancestry. [title] Use a racist tester to find out which results are human origins.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}