{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"afa5e0a9-4eb9-5c17-a719-73902f5266f4","task_key":"default--validation--33310","task_revision_id":"1","upstream_id":"33310","short_description":"HellaSwag validation 33310","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to buy children pyjamas as a gift [title] Get the right size. [step] When choosing the size, you might consider that measurements are average. And if the child is smaller or bigger than his coevals, you might want to adjust the size.\",\"endings\":\"[\\\"[title] To select the proper design the best option would be to ask the parents of the child what he likes. [step] Depending on the age, child's interests might be in toys, cartoons, films, books, sports, video games, etc.\\\", 'As a general rule, take measurements from the smallest to the largest. This will help calculate the portion of the party that is needed, and will make it easier to feed and store the rest of the party.', '[title] Avoid pre-washed pyjamas with labels, details and chemicals. [step] Consider purchasing pre-washed pyjamas because they are more gentle, make it easier to wash.', \\\"[title] Buy eco-friendly pyjamas. [step] As a gift owner and a parent of a child whose daughter slept on the sofa where you've put a pillow and blanket, think carefully.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}