{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b1157e89-ccc0-536f-86ea-a8f664cae346","task_key":"default--validation--8173","task_revision_id":"1","upstream_id":"8173","short_description":"HellaSwag validation 8173","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to detect split ends [title] Distinguish between split ends and frizz. [step] Split ends are usually found at the tips of your hair. In general, you should be able to brush your hair like normal and style it without much problem if you have split ends.\",\"endings\":\"[\\\"But, if you find that you're having trouble getting your hair to cooperate, you probably just have frizzy hair. [substeps] For example, if you're having trouble getting your hair to lie flat and it's humid out, you're probably dealing with frizz.\\\", 'However, if you have split ends, you may be experiencing even more frizz as you get older. [substeps] Frizz is the way that hair and frizz change during the course of your life.', 'This can be a frustrating part, but it can also be a great way to monitor how your hair looks. [substeps] Split ends are hair that starts at the tips of your hair (cut back to a half-inch at the roots) and ends at the roots.', \\\"When, however, you have split ends, you can reduce frizz by fine-tuning your hair. [substeps] Deep-conditioning can keep your hair from standing out too much, but don't use it right after a shower.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}