{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"59cdc01c-c16a-5d51-acb2-50e0c727c31a","task_key":"default--validation--6256","task_revision_id":"1","upstream_id":"6256","short_description":"HellaSwag validation 6256","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to grow out baby hairs [title] Take a daily supplement containing proteins or amino acids. [step] These are some of the building blocks of healthy hair and can stimulate hair growth. Many supplements that use marine products, such as fish oil, as their primary ingredients are good for your hair, too.\",\"endings\":\"[\\\"[substeps] Occasionally you might get a boost of protein from oysters and salmon, depending on age. Always follow the manufacturer's directions, even if you're a beginner.\\\", 'However, talk with your doctor before starting any supplementation. [substeps] Read the directions on the supplement carefully and follow them closely.', '[substeps] Work a topical gel or a combination of shampoo and body spray onto your hair. Tap water works well as well, but make sure not to use hot water as this will immediately cause burning.', \\\"[substeps] Research has shown that androgens (drs), hormone imbalances, and skin conditions increase hair growth in the body. [title] Wash your baby's hair often.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}