Optimization of RF and Microwave Filters using ML techniques Capstone Report Kadyrzhan Tortayev Nazarbayev University Department of Electrical and Computer Engineering School of Engineering and Digital Sciences Copyright © Nazabayev University This project report was created on TexStudio editing platform using LATEX. All the figures were drawn using draw.io online software tool. Electrical and Computer Engineering Nazarbayev University http://www.nu.edu.kz Title: Optimization of RF and Microwave Fil- ters using ML techniques Theme: RF Engineering Project Period: Spring 2024 Project Group: RF circuit design Participant(s): Kadyrzhan Tortayev Supervisor(s): Mohammad Hashmi Copies: 1 Page Numbers: 29 Date of Completion: April 23, 2024 Abstract: Designing high-performance mi- crowave and millimeter-wave filters presents a significant challenge due to the sensitivity of filter characteristics to variations in geometric dimensions and electrical sizes. Typically, filter design involves optimizing design variables, starting from initial values. However, if these initial values are too far from the optimal solution, optimization often fails to yield satis- factory results. To address this issue, this project analyzes current methods used in optimization of microwave and millimeter-wave filters. The content of this report is freely available, but publication (with reference) may only be pursued due to agreement with the author(s). http://www.nu.edu.kz Contents Preface vi 1 Introduction 1 2 Background 3 2.1 Particle Swarm Optimization . . . . . . . . . . . . . . . . . . . . . . . 3 2.2 Genetic Algorithms . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4 2.3 Homotopy Optimization . . . . . . . . . . . . . . . . . . . . . . . . . . 5 3 Methodology 7 3.1 Circuit Design of Filters . . . . . . . . . . . . . . . . . . . . . . . . . . 7 3.2 Training ML model . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8 3.2.1 Data Collection and Preprocessing . . . . . . . . . . . . . . . . 8 3.2.2 Training and model selection . . . . . . . . . . . . . . . . . . . 9 3.3 Integration with Optimization Methods . . . . . . . . . . . . . . . . . 9 3.4 Validation and Practical Considerations . . . . . . . . . . . . . . . . . 11 4 Results and Discussions 12 4.1 Results . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12 4.1.1 Circuit Design . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12 4.1.2 Training ML model . . . . . . . . . . . . . . . . . . . . . . . . . 13 4.1.3 Integration with optimization . . . . . . . . . . . . . . . . . . . 14 4.1.4 Validation and Practical Design . . . . . . . . . . . . . . . . . 16 4.2 Discussion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19 5 Conclusion 21 Bibliography 22 A Circuits 25 B Waveguide 27 v Preface In the dynamic landscape of modern technology, the design and optimization of microwave and millimeter-wave filters stand as critical challenges. These intricate devices play a pivotal role in shaping the efficiency and performance of commu- nication systems, radar systems, and numerous other applications at the heart of our interconnected world. To unlock their full potential, engineers and researchers have long sought innovative solutions to tackle the inherent complexity of filter design. Within this area of engineering, several approaches have emerged as a bea- con of promise. Yet, as we delve deeper into the complexities of filter optimization, a parallel revolution has been underway—the rise of Artificial Neural Networks (ANNs). These computational marvels have rapidly evolved, proving themselves as invaluable tools for modeling complex systems, accelerating simulations, and aiding in the optimization process. . Nazarbayev University, April 23, 2024 Kadyrzhan Tortayev vi Chapter 1 Introduction Microwave filter design can be a challenging task, and there are several common problems that designers can encounter. One of the primary challenges in filter de- sign is meeting the desired performance specifications. These specifications may include requirements for the frequency response, phase response, group delay, and stopband attenuation. It can be difficult to achieve the desired performance while also considering other design constraints such as cost, size, and complex- ity. The goal is to develop more efficient and accurate methods for designing and optimizing filters with better performance metrics such as low insertion loss, high selectivity, and wide bandwidth. Some of the most popular optimization algo- rithms are Particle Swarm Optimization (PSO), Genetic Algorithms (GA) which are considered to be iterative optimization algorithms. Other methods include Electromagnetic Simulators and Coupling matrices. Coupling matrices in high-performance narrowband filters can be effectively optimized through various analytical techniques aimed at diagnosing the coupling matrix from either measured or simulated S-parameters [1], [2]. By discerning the variance between the realized coupling matrix and the intended design target- coupling matrix, and establishing a direct correspondence between coupling matrix elements and the associated physical tuning components, one can readily deter- mine the necessary adjustments to the design parameters [3]. Liu et al. [2]pro- posed a general lumped element matrix synthesis method for cross-coupled and inline wideband BPF with multiple zeros for direct circuit implementation. Using the proposed method, the elements in the synthesized coupling matrix can corre- spond to the values of capacitance and inductance in the actual circuit without any optimization, which simplifies the design process of wideband lumped element filters. Sandhu et al. [1] created a new class of frequency-variant reactive cou- pling networks with singular responses. These networks are intended to be used as building blocks for generalized-Chebyshev-type bandpass filters serving as non- ideal frequency-variant inverters while providing two TZs and one pole. Wu et al. 1 2 Chapter 1. Introduction [3] were able to reconfigure a coupling matrix from the transversal topology to an arbitrary required topology, which is viewed as a simple optimization problem, where the developed error function is computationally efficient. This article also explores the homotopy method [4] to the local optimization of microwave filters. Homotopy, a concept in topology and differential geometry, has found utility in numerical methods for solving nonlinear equations and differen- tial equations [5]. Rather than directly tackling the target filter design problem, the homotopy method establishes a sequence of intermediate optimization prob- lems. Utilizing previous solutions as initial values, an existing local optimization technique can solve these intermediate problems. Through this iterative process of homotopy optimizations, the filter response can gradually converge towards the desired specification. Even when the initial values for the filter design are far from optimal, the homotopy method offers a high likelihood of reaching the optimal solution. Another valuable application of the homotopy optimization method arises in filter bank design for frequency multiplexing systems. Here, if a filter design is available, it can serve as the initial values for optimizing other filters with varying center frequencies and bandwidths. The optimization outcomes of multiple filters operating at different center frequencies and bandwidths can further inform the necessary parameter variations for designing tunable filters. Chapter 2 Background 2.1 Particle Swarm Optimization Particle Swarm Optimization (PSO) is a popular optimization algorithm inspired by the social behavior of birds and fish. Developed by Eberhart and Kennedy in 1995, PSO is used to find approximate solutions to optimization and search problems. In the context of optimization, a population of potential solutions is re- ferred to as a "swarm," and each solution is a "particle." Each particle in the swarm represents a potential solution to the optimization problem. The position of a par- ticle corresponds to a point in the search space, and the quality of that solution is evaluated using an objective function Particle Swarm Optimization (PSO) has been applied successfully to filter optimization problems in various research pa- pers [6], [7], [8], [9]. Neural network architectures often require optimized filters for tasks such as feature extraction or convolutional operations. PSO can be par- ticularly effective in tuning these filters, especially when the relationships between filter parameters and network performance are complex. The ability of PSO to navigate high-dimensional spaces makes it valuable in optimizing filters for neural networks. 3 4 Chapter 2. Background Figure 2.1: PSO . 2.2 Genetic Algorithms Genetic Algorithms (GAs) are optimization algorithms inspired by the process of natural selection and genetics. Developed by John Holland in the 1960s, genetic al- gorithms are part of a broader class of evolutionary algorithms and are used to find approximate solutions to optimization and search problems. GAs are particularly useful in complex, multidimensional search spaces where traditional optimization methods may struggle. Genetic Algorithms (GAs) have been widely employed in the optimization of filters across various applications [10], [11], [12], [13]. Genetic Algorithms represent filters as chromosomes or individuals. Each chromosome en- codes the parameters of the filter, such as coefficients or frequency response charac- teristics. GAs are capable of handling complex, non-linear optimization problems. They provide a global search strategy, enabling the exploration of a large solu- tion space. The adaptability of GAs makes them suitable for diverse filter design requirements. 2.3. Homotopy Optimization 5 Figure 2.2: GA . 2.3 Homotopy Optimization Homotopy optimization is an optimization technique that combines elements of homotopy continuation and optimization methods. It is particularly useful for solving nonlinear optimization problems, especially those with multiple local min- ima or when the objective function is non-convex. While the application of Ho- motopy methods in filter optimization may not be as widespread as some other optimization techniques like Genetic Algorithms or Particle Swarm Optimization, there is research exploring the potential of Homotopy for this purpose. Homo- topy optimization involves the continuous deformation of a complex optimization problem into a simpler, more solvable form [14]. The application of homotopy optimization to filters can be particularly advantageous in scenarios where the filter design problem is complex, has multiple solutions, or involves challenging optimization landscapes. It provides a systematic and controlled way to navigate through the solution space, potentially overcoming some of the difficulties associ- ated with traditional optimization methods. For instance if we define variable P as: P = [ f 1 f 2 f 3 f 4r] (2.1) where the stopband edge frequencies are f1 and f4 and the passband is between frequency f2 and f3 with f1 < f2