ENERGY EFFICIENT CLOCK SYNCHRONIZATION IN IOT USING REINFORCEMENT LEARNING

Simple item page
dc.contributor.authorNadirkhanova, Aizhuldyz
dc.contributor.authorAssylbek, Damir
dc.date.accessioned2024-06-26T11:30:13Z
dc.date.available2024-06-26T11:30:13Z
dc.date.issued2024-04-19
dc.description.abstractThis project addresses the vital challenge of achieving precise clock synchronization within the Internet of Things (IoT), a foundational element for the seamless and efficient operation of interconnected devices. Such synchronization is indispensable for critical IoT functions like coordinated actions, streamlined communication, and power management. The project introduces a novel approach leveraging Reinforcement Learning (RL), specifically the State-Action-Reward-State-Action (SARSA) algorithm. This method equips devices with the capability to autonomously learn and anticipate the timing of data transmissions, fostering self-synchronization without manual intervention or pre-programmed schedules. It's a significant shift from traditional manual adjustments of clock drift, accommodating the unique timing characteristics of each device's crystal oscillator. Small testbeds with ESP32 devices using the ESP-NOW protocol have validated the approach's adaptability to transmission timing variances, maintaining a high success rate in data receipt. Furthermore, the project continues to work on incorporating knowledge transfer techniques and Huffman coding to compress trained data, facilitating rapid convergence to optimal behavior and fostering an environment where devices benefit from shared learning experiences.en_US
dc.identifier.citationAssylbek, D., Nadirkhanova, A.(2024). Energy efficient Clock Synchronization in IoT Using Reinforcement Learning. Nazarbayev University School of Engineering and Digital Sciencesen_US
dc.identifier.urihttp://nur.nu.edu.kz/handle/123456789/8031
dc.language.isoenen_US
dc.publisherNazarbayev University School of Engineering and Digital Sciencesen_US
dc.rightsAttribution-NonCommercial-ShareAlike 3.0 United States*
dc.rights.urihttp://creativecommons.org/licenses/by-nc-sa/3.0/us/*
dc.subjectMachine Learningen_US
dc.subjectReinforcement Learningen_US
dc.subjectInternet of Things, Synchronization, Wireless networksen_US
dc.subjectSynchronizationen_US
dc.subjectWireless networksen_US
dc.subjectType of access: Open Accessen_US
dc.titleENERGY EFFICIENT CLOCK SYNCHRONIZATION IN IOT USING REINFORCEMENT LEARNINGen_US
dc.typeBachelor's thesis, capstone projecten_US
workflow.import.sourcescience

Files

Original bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
Final_Report_Team_17_Spring2024 (1).pdf
Size:
5.13 MB
Format:
Adobe Portable Document Format
Description:
Bachelor thesis, report
Download
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
6.28 KB
Format:
Item-specific license agreed upon to submission
Description:
Download

Collections

03. Bachelor's Thesis