{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e3f25880-5c0f-5ba2-a21d-9e878b0f03ab","task_key":"default--validation--48055","task_revision_id":"1","upstream_id":"48055","short_description":"HellaSwag validation 48055","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to evaluate the protein silk fusion hair attachment method [title] Ask yourself about the condition of your natural hair. [step] Be honest with yourself and you may be able to rule out protein silk infusions as a good match for your situation. [substeps] Protein silk fusion is ideal for those who have healthy hair.\",\"endings\":\"['As we all know, we are usually the result of deep dermatitis. But if your hair follicles are dark or stained with a deep nutrient for protein silk production then it is a sign that protein silk fusion is not a good match for you or your hair as an individual.', \\\"[title] Be aware that the protein silk only performs functions on the strands of hair. [step] It can't replicate the proportions of the protein silk which may be a counter in the statement.\\\", 'However, if you have severely damaged hair that needs extra care, such as dry hair or excessively waxed hair, this method should be avoided. Protein silk infusions occur only after your hair is completely dry.', 'If you have had recent chemical treatments or have any visible damage, protein silk infusions are probably not right for you. You should carefully examine other methods before returning to further consider this method.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}