The increasing complexity of optical communication systems and networks necessitates advanced methodologies for extracting valuable insights from vast and heterogeneous datasets. Machine learning (ML) and deep learning (DL) have emerged as pivotal tools in this domain, revolutionizing data analysis and enabling automated self-configuration in optical communication systems. Their adoption is fueled by the growing intricacy of systems and links, driven by numerous adjustable and interdependent parameters. This complexity is particularly evident in areas such as coherent transceivers, advanced digital signal processing, optical performance monitoring, cross-layer network optimizations, and nonlinearity compensation. While ML and DL offer immense potential, their application in optical communications is still in its early stages, with significant opportunities remaining unexplored. Many algorithms have yet to be fully deployed in practical settings, underscoring the emerging nature of this research area. This paper presents a comprehensive survey of ML and DL applications across optical fiber communication (OFC), optical wireless communication (OWC), and optical communication networking (OCN), highlighting the challenges, current advancements, and future potential of these approaches. To address the identified gaps, this survey evaluates and compares ML and DL algorithms in terms of their performance, complexity, objectives, input data, metrics, and applications in optical communication. Specific emphasis is placed on identifying how these algorithms enhance system performance and optimization. Furthermore, the advantages and limitations of existing methods are analyzed, offering a clear perspective on the role of ML and DL in this domain. The survey also includes updated visual representations and domain-specific examples to elucidate the practical applications of ML and DL in OFC, OWC, and OCN. It concludes by discussing the open challenges, proposing potential soluti...

Keywords