{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"18b98657-e7e0-5eb3-bcaf-20dcf345c69d","task_key":"default--validation--28492","task_revision_id":"1","upstream_id":"28492","short_description":"HellaSwag validation 28492","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to transform yourself using makeup [title] Cleanse your face using warm water and your bare hands. [step] Dab it dry with a soft clean towel. [title] Use a good foundation and rub evenly on the face, being careful not to use to much in an area.\",\"endings\":\"['[step] Start from the far corner of your face, as shown, but the middle of your face is always the most natural. Blend again with a moistened tissue or a swipe of clear makeup remover.', '[title] If you have any spots, use a good quality concealer stick and blend it in with the foundation. [title] Now get a bronzer and a brush, and gently apply over the face to give you that glowing goddess look.', '[step] Make sure that the foundation is left on your face for three minutes before moving on. [title] Use a makeup sponge to remove excess powder/finish from the face.', '[step] Show off! Good makeup affects the shape of our face, making our appearance the way it is. The first layer of foundation should be a powder, not a gel.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}