{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d898eb84-de92-59c9-b0e5-82a43db16941","task_key":"default--validation--18411","task_revision_id":"1","upstream_id":"18411","short_description":"HellaSwag validation 18411","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make concealer [title] Use moisturizer as a base. [step] To begin, squeeze a small amount of moisturizer into your hand or a small container. If possible, use moisturizer that is non-comedogenic: that will not cake onto your skin and create acne.\",\"endings\":\"['You can use very soft gel moisturizer, or you can use a thicker or more rigid product like vaseline. Either way, use one that has an spf.', '[substeps] Some moisturizer products will cake onto your skin and clog your pores, creating an ideal environment for acne. If you tend to get acne, then a non-comedogenic moisturizer might truly be a wiser choice.', 'Additionally, since moisturizer should look like liquid or gel, people with makeup under their eyes do not need it. [substeps] Look for cream, powder, and liquid moisturizers that have a \\\" ingredients \\\" setting to them.', '[substeps] Avoid using non-comedogenic products that are rich in vitamin c and sodium, as they are too rich in oil. Instead, use a water-based moisturizer, as these are not as good for your skin.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}