{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"57d78ce8-9ac8-53f6-9421-43c90dca1573","task_key":"default--validation--39091--variant-be1394a90600","task_revision_id":"1","upstream_id":"39091--variant-be1394a90600","short_description":"HellaSwag validation 39091","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to apply eyelash extensions [title] Evaluate the condition of your natural lashes. [step] If your eyelashes are naturally short and thin, dramatically long or thick extensions won't last long and may damage them. Before selecting extensions, examine your own lashes.\",\"endings\":\"[\\\"The longer and healthier they are, the more weight they can withstand. [substeps] If you've never applied extensions before, consider starting with a half set to see how your natural lashes hold up.\\\", \\\"Make sure they're healthy and properly maintained. Root lashes are more susceptible to damage than natural lashes.\\\", 'Most look best with moderately thick, delicate lashes, but a few look best full and lush. [title] Opt for extensions when you have the extra length needed to create an effect.', \\\"Make sure they are in good condition and that they don't contain harmful chemicals that may cause false lashes. [substeps] Remove any lashes that appear just a shade or darker than their natural length.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}