{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2e813fa8-ec5c-5f3d-8f1f-04e531135ad3","task_key":"default--validation--26927","task_revision_id":"1","upstream_id":"26927","short_description":"HellaSwag validation 26927","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to close pores [title] Understand that pore size is hereditary. [step] Pores are the oil-producing openings of hair follicles, and their size is essentially determined by your genes, which means it can't be permanently changed. Pores can also be affected by your skin type: pores appear larger and more visible on skin that's naturally oily, while dry skin can seem almost poreless.\",\"endings\":\"['[substeps] Create a chart to measure your pore size. Make an \\\" x \\\" in front of each pore to indicate how much skin there is per pore.', '[substeps] Pores can also get larger if dead skin cells and oil are allowed to accumulate. They can become larger if your collagen is weakened by aging or exposure to uv rays.', \\\"[substeps] Take a good look at your upper lip now and then to verify your skin's dryness. You'll probably have to do some extra prep work to achieve this exact measurement.\\\", 'As such, pore size is difficult to predict. [title] Select cosmetic tools to close pores.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}