{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"562fb016-6065-5f6b-bc1b-a54550e857ec","task_key":"default--validation--7169","task_revision_id":"1","upstream_id":"7169","short_description":"HellaSwag validation 7169","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to clean your back [title] Take warm showers instead of hot showers. [step] Hot showers can dry out your skin and strip it of its natural oils. Taking warm showers will help you keep your back moisturized.\",\"endings\":\"['[title] Put body wash on a loofah and scrub your upper back with it. [step] Hold the loofah in your left hand and reach over your right shoulder to scrub the upper right section of your back.', 'To keep it moisturized, keep it covered at all times when you shower or bathe. [substeps] As such, you may want to use an extra protective covering over your back during days of exercise or hot weather, such as a dress or sweater.', '[title] Use at least lukewarm water. [step] Lukewarm water also removes oils, dead skin cells, and debris from your spine, leaving it supple and fresh.', \\\"As a bonus, hot water can also help prevent acne, a dermatologist should prescribe lukewarm water that's at least 70 ° f (10 ° c). Warm showers should be just about one part of your regular routine.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}