{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1690beeb-38c7-5605-afdd-cd5bc7ca5733","task_key":"default--validation--19769","task_revision_id":"1","upstream_id":"19769","short_description":"HellaSwag validation 19769","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make blemish balm (bb cream ) [title] Gather everything listed in the things needed section. [step] You're now ready to start! [title] Pump in about 5 to 10 squirts of moisturizer into your container. [step] You can add more or less depending on how much bb cream you're making and how moisturizing you want it to be.\",\"endings\":\"['[substeps] As said in step one, bb cream is essential for making blackheads, and can easily be substituted for bb cream. Keep in mind that if you use bb cream on your skin, your skin will absorb it without realizing.', 'Use a little bit at a time to avoid wetting your skin. [title] Add one or two drops of your favorite essential oil blend.', '[title] Bb creams have sunscreen protection in them usually, so squirt a little of your favorite sunscreen into the jar. [title] Add in some foundation! [step] This will give your bb cream its color.', '[title] Dip your brush into the non-stick spray. [step] Then, fill it up about 5 to 6 centimeters with your chosen moisturizer.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}