Narrow Results

In order to solve the problem of environment generalization in continuous state space, an obstacle avoidance method based on region location is proposed. The method is divided into three steps: (1) Using Region Proposal Network (RPN) to localize the obstacle area; (2). The environment map is established by the regional position mapping relation; and (3). The Deep Q-Learning Network (DQN) is used to realize collision detection of the robot, then pixel collision detection module is introduced and finally the pixel collision simulation distance sensor is combined to obtain the distance between the robot and obstacle and whether the collision or not. In this paper, the experiments were carried out in static obstacle environment and in dynamic and static obstacle environment for robot obstacle avoidance tasks. Experimental results show that the problem of environment generalization can be effectively solved by introducing pixel collision detection in the process of robot obstacle avoidance, and the network model trained in a dynamic environment has some generalization ability.

Reasonable allocation of resources is an important guarantee for efficient support of power business in edge IoT agents. Facing the above problems of the current power Internet of Things, this paper proposes a resource optimization allocation method based on deep Q-learning. This method first comprehensively considers the communication performance and network security. Involving indicators such as latency and service satisfaction, a complete and reliable mathematical model of the edge Internet of Things proxy network is constructed to achieve efficient and reliable modeling of the power Internet of Things (pIoT), aiming to better fit the practical interaction needs for efficient and secure communication. The Q-learning network model is optimized, and the method combining Reinforcement learning and deep learning is used to solve the model. Used by this network, the optimization and improvement of the deep network model is realized, so that the status, action and other parameters of the network model can be solved in a timely manner, so as to better support the reliable and efficient information interaction of the communication network. The test results prove that the delay of the proposed method can be maintained within 12ms in more complex scenarios, and the interaction success rate reaches 0.975, confirming that the proposed method can provide good information interaction guarantee services.

The prediction of price trends in the stock market has always been a hot research topic in the financial field. However, due to the high instability and volatility of stock prices, it is very difficult to accurately predict stock trends. How to remove the noise of stock data, extract effective features, and pursue maximum value returns has always been a challenge. This paper proposes a hybrid model (DWT-DQN) that combines discrete wavelet transform with deep reinforcement learning to improve the accuracy and return rate of stock predictions. First, the model captures price fluctuation information on different scales by performing discrete wavelet transformation on the difference between long- and short-term moving averages of stock prices, and well extracts the changing characteristics of stock price data in the time domain and frequency domain. Then the feature data are input into the built DQN network for model training. The network can select the optimal trading action based on market status and historical experience and returns. At the same time, during the data sampling process, an attention mechanism is introduced to allow the model to further learn in the direction of maximizing returns. Through testing and verification on SSEC, HSI, NDX and SPX data sets, experiments show that the hybrid model proposed in this paper has excellent performance in terms of accuracy and return rate.