{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bd10d22d-8546-545d-8962-cfc627661f14","task_key":"default--validation--10627","task_revision_id":"1","upstream_id":"10627","short_description":"HellaSwag validation 10627","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to be quietly confident [title] Keep your chin up and shoulders back. [step] Nervous or insecure people often walk around with their chins pointed down and their eyes trained on the floor. Show confidence by lifting your chin as if there was an invisible thread pulling your head up.\",\"endings\":\"['[substeps] Keeping your chin level helps with posture as a whole. Sometimes, when you are uncertain you might slouch or cower.', \\\"If you feel confident when you're standing, you're better at it. This is a bit like fidgeting with a bag.\\\", \\\"Raised chin conveys a submissive feeling. [title] Greet others whenever you see them, even if you're not very close.\\\", '[substeps] You can learn to speak with more volume through practice. Instead of shutting down when a group of people are rowdy or mean, keep your shoulders pulled back and your chin down.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}