{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"40054a41-1355-5fe3-922b-cee86c1b2068","task_key":"default--validation--20166","task_revision_id":"1","upstream_id":"20166","short_description":"HellaSwag validation 20166","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to prevent kidney stones from recurring [title] Determine which kind of kidney stone you have had. [step] Ask your doctor to identify your particular kind. It is important to know which particular type you have had, so you can work on specific ways to prevent it from recurring.\",\"endings\":\"['For example, there is a more specific type of kidney stone commonly known as chronic kidney stones. The most common type of kidney stones are a cystine kidney stone.', '[title] Think about who will be doing the surgery. [step] You will have to decide what type of surgery is most appropriate for you.', '[title] Ask your doctor to study your kidney stones. [step] Your doctor will dissect your kidney stones and perform a simple exam to determine what type of kidney stone you have.', 'Ensure your doctor checks your parathyroid to rule it out as a factor in the formation of kidney stones. [substeps] Calcium stones are caused by unused calcium not flushed out in urine and is collected in the kidneys.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}