The Underside layers that are nearer to your inputs (the ParallelConv1D blocks in the diagram) are frozen as well as the parameters will keep unchanged at even more tuning the design. The layers which aren't frozen (the higher layers which can be closer for the output, prolonged small-time period memory http://bihao.xyz