{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d3733262-e097-5a39-afe8-e931b15efa31","task_key":"default--validation--31969","task_revision_id":"1","upstream_id":"31969","short_description":"HellaSwag validation 31969","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to exfoliate, steam and use face masks [title] Cleanse your face. [step] It's important to start with a clean face before you exfoliate. Wet your face with warm water, and massage a cleanser that fits your skin type into your skin.\",\"endings\":\"[\\\"Rinse the cleanser off with lukewarm running water. While soap helps to remove dirt, it won't scrub off with hot water, which will make your mask resistant to removal.\\\", \\\"Rinse your face off with cold water when you're done. [substeps] Your face is more sensitive to chemicals than it is your skin, which can cause clogged pores and facial blemishes.\\\", 'This will help break up the tonsil, the dry, flaky outer layer of skin and free up your pores and prevent pimples from forming. [substeps] If you have oily skin, you may want to wash your face more often to get rid of the sebum.', \\\"Rinse off the cleanser with lukewarm water. [substeps] You can pat your face with a clean towel so it's not dripping but it's not necessary to dry it completely.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}