- Objectivity Through The Experiment Let The Students Deeply Understand The Key Idea Of Bp Algorithm And Programming Pr 1 (160.07 KiB) Viewed 19 times
- Objectivity Through the experiment, let the students deeply understand the key idea of BP algorithm and programming pr
-
- Site Admin
- Posts: 899603
- Joined: Mon Aug 02, 2021 8:13 am
- Objectivity Through the experiment, let the students deeply understand the key idea of BP algorithm and programming pr
- Objectivity Through the experiment, let the students deeply understand the key idea of BP algorithm and programming process. Content 1. Use BP algorithm to solve the MLP network 2. There are 8 training samples and 8 testing samples (in table one). 3. Training type: Random 4. Architecture: Three layers, three input nodes in 1st layer, two nodes for the hidden layer, one node for the output layer. The number of nodes for the hidden layer can be changed from 2 to 30 in the experiments. 5. Activation function: f(x)=1/[1+exp(-x)] 6. Target values: 0.9/0.1 7. Learning rate: 0.5 8. Initial weights: random values in [-0.5, 0.5] Table 1: The training and testing samples for MLP Training Testing Input values Input Target values (0 0 0) 0.9 (000) 0.9 (001) 0.1 (111) 0.1 (010) 0.1 (0 0 0.2) 0.9 (011) 0.9 (0 0 0.8) 0.1 (100) 0.1 (0 0.2 0) 0.9 (101) 0.9 (0 0.8 0) 0.1 0.9 (0 0.2 0.2) 0.9 (110) (111) 0.1 (0 0.8 0.8) 0.9 E. Experiment Steps 1. print out the values of the test samples (2 nodes for hidden layer, stop error=0.01), refer to Fig 1. 除结点增广矩阵维 学习速率为0.5,惯性常量为6.5,训练集结束误差值为8.81。 一共运行了125822次,测试集错误率为0.880。 输入层到隐层权重, 11.728 -7.948 -7.936 -7.939 2.263 -1.527 -1.522 -1.521 隐层到输出层权重: 3.218 -18.455 16.964 测试集算出的Z值. M: 8.844 1: 8.156 21 8.767 31 8.255 M: 8.766 5: 8.251 8.637 8.841 Fig 1. The output values of the testing samples 2. change the number of nodes for hidden layer (from 2 to 30), plot the iteration number as a function of the number of hidden nodes. 3. Change the learning rate (0.1, 0.2 0.3,---,1), print the iteration number as a function of the learning rate Requirement: Understand the principle of the above-informed algorithms and write an experiment report. (write the details of your algorithms here, including the source codes and results) 4. Analysis and Discussion Through the experiment, analyse the advantage and disadvantages of ID3 algorithm, describe the difficulties you encountered in the experiment and give some discussion.