{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"47c8c380-bd9f-5f53-874b-2446ea47a381","task_key":"default--validation--48520","task_revision_id":"1","upstream_id":"48520","short_description":"HellaSwag validation 48520","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to use moroccan argan oil [title] Double-cleanse with argan oil, followed by your normal facial cleanser. [step] Double-cleansing produces brilliant results: first you cleanse with an oil, then with your normal facial cleanser, maximizing the benefits of each to your skin. [substeps] Apply four drops of argan oil to your face and rub gently in circular motions with your finger tips.\",\"endings\":\"['Spread the oil over your face and neck in short, zig-zged motions. Rinse with lukewarm water and pat dry with a clean towel.', 'Massage for 60 seconds and wipe off with a disposable facial cleansing cloth. Rinse with lukewarm water and pat dry.', 'Using your other hands, use your palms to massage the oil into your face. Repeat once or twice a day for best results.', 'The temperature of the oil should be slightly below boiling (4.5 degrees fahrenheit) at all times. You may need to scrub occasionally to keep the oil from irritating your skin further.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}