{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2b939e71-b323-5470-ae0d-a91fd9f3c03d","task_key":"default--validation--11934","task_revision_id":"1","upstream_id":"11934","short_description":"HellaSwag validation 11934","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get rid of dark elbows [title] Use lemon juice. [step] Lemon juice contains citric acid which is a natural bleaching agent. Therefore, applying lemon juice to elbows can help to lighten the skin.\",\"endings\":\"['[substeps] Squeeze lemon juice over the dark areas of your elbows. Wait 15 to 30 minutes and apply the juice to your elbows.', 'Lemon juice can also help to remove the puffiness of those scars. [substeps] Place the lemon juice directly on your scars, then cover with a clean cotton towel.', 'Apply lemon juice three times a day, according to the instructions on the bottle. [substeps] Alternatively, you can also spray lemon juice onto dark elbows by placing sun exposure detergent on the underarms and a load of laundry detergent in your wash machine.', 'To use : [substeps] Cut a large lemon in half. Squeeze out some of the juice from both halves so that you have two hollow halves or \\\" cups \\\".']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}