{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5dc36fd0-67d2-596b-a03a-d1bc45f5e267","task_key":"default--validation--19186","task_revision_id":"1","upstream_id":"19186","short_description":"HellaSwag validation 19186","config":"default","split":"validation","body":"{\"activity_label\":\"Work World\",\"ctx\":\"[header] How to be a squidminder intern [title] Express your interest. [step] Think about the following questions and submit your answers in this questionnaire :. [title] Be open minded to what being an \\\" intern \\\" means.\",\"endings\":\"['[step] In squidminders, interns are encouraged to be very self-directed, developing their own goals and activities. How genuinely interested are you in exploring the possibilities of your mind and others around you? This includes trying to help people develop skills for maximizing quality of life.', \\\"[step] You are already comfortable about what the work regimen will be like, and if you aren't open minded enough you'll be at risk of this developing into something that takes off your. Working for a young swfomer is a far more interesting experience and will experience you sharing new experiences and ideas with other people.\\\", '[step] Are there any learning opportunities available? Is the internship accredited (at least 2003)? Are there any particular supplemental or supervisory degrees that you will acquire? If so, define it. Are there any certifications that you will need to pass? [title] Become proficient in the software that you are working with.', '[step] If possible, display two different degrees of interest in various subjects related to the job you want to pursue. Be sure to do some research prior to going in for the interview process.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}