{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cff8f0d4-da22-55f9-bcd3-47c441f596f9","task_key":"default--validation--33395--variant-eac98ab373e4","task_revision_id":"1","upstream_id":"33395--variant-eac98ab373e4","short_description":"HellaSwag validation 33395","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to buy pads without being embarrassed [title] Buy several other items while purchasing pads. [step] Many people feel having only one purchase calls more attention to what they're buying. If you want to feel more discreet purchasing feminine products, buy several other items at the same time.\",\"endings\":\"[\\\"[substeps] Buying pads with cover can serve as a buffer. The reason women don't like a name brand pad is that the name brand pad was designed to be oversized.\\\", \\\"Some people report sales up to $10 per item. [substeps] If you're seeing a big trend happening, don't hesitate to buy pads.\\\", \\\"[substeps] If you tend to go for heavy attention, don't purchase much gel pads. These are going to be heavier and less discreet.\\\", 'This can take some attention away from your pads. [substeps] However, be careful of the other items you add.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}