{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4e29e1aa-b38f-5c12-8ea0-dd99e05312d4","task_key":"default--validation--15862","task_revision_id":"1","upstream_id":"15862","short_description":"HellaSwag validation 15862","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to use eyelash growth serum [title] Research over-the-counter growth serums. [step] There are a variety of growth serums that you can purchase at your local pharmacy, beauty shop, or department store. These products are advertised to increase the thickness and fullness of your eyelashes.\",\"endings\":\"['[substeps] Serums are available in sprays, creams, or gel forms. The thinner the product, the healthier your lashes will be.', 'However, remember that these serums could cause your lashes to grow too quickly, if they are used too frequently, or even if your lashes wear out. These are some of the best growth serums available.', 'Read over all of the labels carefully and make sure you use products that are compatible with your eyelash growth serum. Some of the best applications include : [substeps] Eyelids.', 'They often contain various ingredients such as natural peptides, vitamins, and oils. Review the label on each product to see what it contains, or ask a specialist at a beauty salon or cosmetic shop for recommendations.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}