深度殘差網路+自適應引數化ReLU啟用函式（調參記錄12）
本文在調參記錄10的基礎上，在資料增強部分新增了zoom_range = 0.2，將訓練迭代次數增加到5000個epoch，批次大小改成了625，測試Adaptively Parametric ReLU（APReLU）啟用函式在Cifar10影像集上的效果。
Adaptively Parametric ReLU（APReLU）啟用函式的原理如下：
Keras程式：
#!/usr/bin/env python3
# -*- coding: utf-8 -*-
"""
Created on Tue Apr 14 04:17:45 2020
Implemented using TensorFlow 1.10.0 and Keras 2.2.1
Minghang Zhao, Shisheng Zhong, Xuyun Fu, Baoping Tang, Shaojiang Dong, Michael Pecht,
Deep Residual Networks with Adaptively Parametric Rectifier Linear Units for Fault Diagnosis,
IEEE Transactions on Industrial Electronics, 2020, DOI: 10.1109/TIE.2020.2972458
@author: Minghang Zhao
"""
from __future__ import print_function
import keras
import numpy as np
from keras.datasets import cifar10
from keras.layers import Dense, Conv2D, BatchNormalization, Activation, Minimum
from keras.layers import AveragePooling2D, Input, GlobalAveragePooling2D, Concatenate, Reshape
from keras.regularizers import l2
from keras import backend as K
from keras.models import Model
from keras import optimizers
from keras.preprocessing.image import ImageDataGenerator
from keras.callbacks import LearningRateScheduler
K.set_learning_phase(1)
# The data, split between train and test sets
(x_train, y_train), (x_test, y_test) = cifar10.load_data()
# Noised data
x_train = x_train.astype('float32') / 255.
x_test = x_test.astype('float32') / 255.
x_test = x_test-np.mean(x_train)
x_train = x_train-np.mean(x_train)
print('x_train shape:', x_train.shape)
print(x_train.shape[0], 'train samples')
print(x_test.shape[0], 'test samples')
# convert class vectors to binary class matrices
y_train = keras.utils.to_categorical(y_train, 10)
y_test = keras.utils.to_categorical(y_test, 10)
# Schedule the learning rate, multiply 0.1 every 1500 epoches
def scheduler(epoch):
if epoch % 1500 == 0 and epoch != 0:
lr = K.get_value(model.optimizer.lr)
K.set_value(model.optimizer.lr, lr * 0.1)
print("lr changed to {}".format(lr * 0.1))
return K.get_value(model.optimizer.lr)
# An adaptively parametric rectifier linear unit (APReLU)
def aprelu(inputs):
# get the number of channels
channels = inputs.get_shape().as_list()[-1]
# get a zero feature map
zeros_input = keras.layers.subtract([inputs, inputs])
# get a feature map with only positive features
pos_input = Activation('relu')(inputs)
# get a feature map with only negative features
neg_input = Minimum()([inputs,zeros_input])
# define a network to obtain the scaling coefficients
scales_p = GlobalAveragePooling2D()(pos_input)
scales_n = GlobalAveragePooling2D()(neg_input)
scales = Concatenate()([scales_n, scales_p])
scales = Dense(channels, activation='linear', kernel_initializer='he_normal', kernel_regularizer=l2(1e-4))(scales)
scales = BatchNormalization(momentum=0.9, gamma_regularizer=l2(1e-4))(scales)
scales = Activation('relu')(scales)
scales = Dense(channels, activation='linear', kernel_initializer='he_normal', kernel_regularizer=l2(1e-4))(scales)
scales = BatchNormalization(momentum=0.9, gamma_regularizer=l2(1e-4))(scales)
scales = Activation('sigmoid')(scales)
scales = Reshape((1,1,channels))(scales)
# apply a paramtetric relu
neg_part = keras.layers.multiply([scales, neg_input])
return keras.layers.add([pos_input, neg_part])
# Residual Block
def residual_block(incoming, nb_blocks, out_channels, downsample=False,
downsample_strides=2):
residual = incoming
in_channels = incoming.get_shape().as_list()[-1]
for i in range(nb_blocks):
identity = residual
if not downsample:
downsample_strides = 1
residual = BatchNormalization(momentum=0.9, gamma_regularizer=l2(1e-4))(residual)
residual = aprelu(residual)
residual = Conv2D(out_channels, 3, strides=(downsample_strides, downsample_strides),
padding='same', kernel_initializer='he_normal',
kernel_regularizer=l2(1e-4))(residual)
residual = BatchNormalization(momentum=0.9, gamma_regularizer=l2(1e-4))(residual)
residual = aprelu(residual)
residual = Conv2D(out_channels, 3, padding='same', kernel_initializer='he_normal',
kernel_regularizer=l2(1e-4))(residual)
# Downsampling
if downsample_strides > 1:
identity = AveragePooling2D(pool_size=(1,1), strides=(2,2))(identity)
# Zero_padding to match channels
if in_channels != out_channels:
zeros_identity = keras.layers.subtract([identity, identity])
identity = keras.layers.concatenate([identity, zeros_identity])
in_channels = out_channels
residual = keras.layers.add([residual, identity])
return residual
# define and train a model
inputs = Input(shape=(32, 32, 3))
net = Conv2D(16, 3, padding='same', kernel_initializer='he_normal', kernel_regularizer=l2(1e-4))(inputs)
net = residual_block(net, 9, 16, downsample=False)
net = residual_block(net, 1, 32, downsample=True)
net = residual_block(net, 8, 32, downsample=False)
net = residual_block(net, 1, 64, downsample=True)
net = residual_block(net, 8, 64, downsample=False)
net = BatchNormalization(momentum=0.9, gamma_regularizer=l2(1e-4))(net)
net = Activation('relu')(net)
net = GlobalAveragePooling2D()(net)
outputs = Dense(10, activation='softmax', kernel_initializer='he_normal', kernel_regularizer=l2(1e-4))(net)
model = Model(inputs=inputs, outputs=outputs)
sgd = optimizers.SGD(lr=0.1, decay=0., momentum=0.9, nesterov=True)
model.compile(loss='categorical_crossentropy', optimizer=sgd, metrics=['accuracy'])
# data augmentation
datagen = ImageDataGenerator(
# randomly rotate images in the range (deg 0 to 180)
rotation_range=30,
# Range for random zoom
zoom_range = 0.2,
# shear angle in counter-clockwise direction in degrees
shear_range = 30,
# randomly flip images
horizontal_flip=True,
# randomly shift images horizontally
width_shift_range=0.125,
# randomly shift images vertically
height_shift_range=0.125)
reduce_lr = LearningRateScheduler(scheduler)
# fit the model on the batches generated by datagen.flow().
model.fit_generator(datagen.flow(x_train, y_train, batch_size=625),
validation_data=(x_test, y_test), epochs=5000,
verbose=1, callbacks=[reduce_lr], workers=10)
# get results
K.set_learning_phase(0)
DRSN_train_score = model.evaluate(x_train, y_train, batch_size=625, verbose=0)
print('Train loss:', DRSN_train_score[0])
print('Train accuracy:', DRSN_train_score[1])
DRSN_test_score = model.evaluate(x_test, y_test, batch_size=625, verbose=0)
print('Test loss:', DRSN_test_score[0])
print('Test accuracy:', DRSN_test_score[1])
實驗結果：
Epoch 2500/5000 80/80 - 32s 399ms/step - loss: 0.0996 - acc: 0.9930 - val_loss: 0.4074 - val_acc: 0.9203 Epoch 2501/5000 80/80 - 32s 399ms/step - loss: 0.0986 - acc: 0.9937 - val_loss: 0.3996 - val_acc: 0.9202 Epoch 2502/5000 80/80 - 32s 399ms/step - loss: 0.0980 - acc: 0.9933 - val_loss: 0.3950 - val_acc: 0.9236 Epoch 2503/5000 80/80 - 32s 400ms/step - loss: 0.0997 - acc: 0.9928 - val_loss: 0.4173 - val_acc: 0.9190 Epoch 2504/5000 80/80 - 32s 400ms/step - loss: 0.1003 - acc: 0.9927 - val_loss: 0.4020 - val_acc: 0.9210 Epoch 2505/5000 80/80 - 32s 400ms/step - loss: 0.0983 - acc: 0.9935 - val_loss: 0.4114 - val_acc: 0.9209 Epoch 2506/5000 80/80 - 32s 400ms/step - loss: 0.0992 - acc: 0.9929 - val_loss: 0.4048 - val_acc: 0.9212 Epoch 2507/5000 80/80 - 32s 400ms/step - loss: 0.0991 - acc: 0.9935 - val_loss: 0.4153 - val_acc: 0.9205 Epoch 2508/5000 80/80 - 32s 400ms/step - loss: 0.0982 - acc: 0.9939 - val_loss: 0.4106 - val_acc: 0.9202 Epoch 2509/5000 80/80 - 32s 400ms/step - loss: 0.0978 - acc: 0.9937 - val_loss: 0.4142 - val_acc: 0.9214 Epoch 2510/5000 80/80 - 32s 400ms/step - loss: 0.0986 - acc: 0.9932 - val_loss: 0.4161 - val_acc: 0.9208 Epoch 2511/5000 80/80 - 32s 400ms/step - loss: 0.0996 - acc: 0.9931 - val_loss: 0.4168 - val_acc: 0.9213 Epoch 2512/5000 80/80 - 32s 401ms/step - loss: 0.0993 - acc: 0.9933 - val_loss: 0.4125 - val_acc: 0.9202 Epoch 2513/5000 80/80 - 32s 400ms/step - loss: 0.0991 - acc: 0.9932 - val_loss: 0.4072 - val_acc: 0.9203 Epoch 2514/5000 80/80 - 32s 399ms/step - loss: 0.0989 - acc: 0.9930 - val_loss: 0.4077 - val_acc: 0.9190 Epoch 2515/5000 80/80 - 32s 400ms/step - loss: 0.0983 - acc: 0.9933 - val_loss: 0.4031 - val_acc: 0.9212 Epoch 2516/5000 80/80 - 32s 400ms/step - loss: 0.0995 - acc: 0.9927 - val_loss: 0.4060 - val_acc: 0.9219 Epoch 2517/5000 80/80 - 32s 400ms/step - loss: 0.0975 - acc: 0.9933 - val_loss: 0.3955 - val_acc: 0.9247 Epoch 2518/5000 80/80 - 32s 400ms/step - loss: 0.0998 - acc: 0.9931 - val_loss: 0.4099 - val_acc: 0.9195 Epoch 2519/5000 80/80 - 32s 400ms/step - loss: 0.1007 - acc: 0.9924 - val_loss: 0.4077 - val_acc: 0.9195 Epoch 2520/5000 80/80 - 32s 399ms/step - loss: 0.0981 - acc: 0.9930 - val_loss: 0.4108 - val_acc: 0.9205 Epoch 2521/5000 80/80 - 32s 400ms/step - loss: 0.0997 - acc: 0.9931 - val_loss: 0.4017 - val_acc: 0.9233 Epoch 2522/5000 80/80 - 32s 399ms/step - loss: 0.0988 - acc: 0.9933 - val_loss: 0.4079 - val_acc: 0.9202 Epoch 2523/5000 80/80 - 32s 400ms/step - loss: 0.0989 - acc: 0.9932 - val_loss: 0.4085 - val_acc: 0.9224 Epoch 2524/5000 80/80 - 32s 399ms/step - loss: 0.0999 - acc: 0.9931 - val_loss: 0.4265 - val_acc: 0.9156 Epoch 2525/5000 80/80 - 32s 399ms/step - loss: 0.0991 - acc: 0.9928 - val_loss: 0.4078 - val_acc: 0.9198 Epoch 2526/5000 80/80 - 32s 400ms/step - loss: 0.0993 - acc: 0.9929 - val_loss: 0.4057 - val_acc: 0.9213 Epoch 2527/5000 80/80 - 32s 400ms/step - loss: 0.1016 - acc: 0.9925 - val_loss: 0.3981 - val_acc: 0.9214 Epoch 2528/5000 80/80 - 32s 399ms/step - loss: 0.1004 - acc: 0.9925 - val_loss: 0.4142 - val_acc: 0.9188 Epoch 2529/5000 80/80 - 32s 400ms/step - loss: 0.0980 - acc: 0.9938 - val_loss: 0.3881 - val_acc: 0.9244 Epoch 2530/5000 80/80 - 32s 399ms/step - loss: 0.0970 - acc: 0.9938 - val_loss: 0.4089 - val_acc: 0.9218 Epoch 2531/5000 80/80 - 32s 399ms/step - loss: 0.0982 - acc: 0.9935 - val_loss: 0.4139 - val_acc: 0.9185 Epoch 2532/5000 80/80 - 32s 400ms/step - loss: 0.1003 - acc: 0.9927 - val_loss: 0.3969 - val_acc: 0.9206 Epoch 2533/5000 80/80 - 32s 400ms/step - loss: 0.0994 - acc: 0.9927 - val_loss: 0.4123 - val_acc: 0.9180 Epoch 2534/5000 80/80 - 32s 399ms/step - loss: 0.0993 - acc: 0.9929 - val_loss: 0.4002 - val_acc: 0.9226 Epoch 2535/5000 80/80 - 32s 399ms/step - loss: 0.0957 - acc: 0.9943 - val_loss: 0.4116 - val_acc: 0.9192 Epoch 2536/5000 80/80 - 32s 399ms/step - loss: 0.0985 - acc: 0.9933 - val_loss: 0.4214 - val_acc: 0.9164 Epoch 2537/5000 80/80 - 32s 399ms/step - loss: 0.0967 - acc: 0.9940 - val_loss: 0.4219 - val_acc: 0.9163 Epoch 2538/5000 80/80 - 32s 400ms/step - loss: 0.0963 - acc: 0.9940 - val_loss: 0.4312 - val_acc: 0.9154 Epoch 2539/5000 80/80 - 32s 399ms/step - loss: 0.0959 - acc: 0.9943 - val_loss: 0.4308 - val_acc: 0.9166 Epoch 2540/5000 80/80 - 32s 400ms/step - loss: 0.0983 - acc: 0.9933 - val_loss: 0.4163 - val_acc: 0.9174 Epoch 2541/5000 80/80 - 32s 400ms/step - loss: 0.0973 - acc: 0.9935 - val_loss: 0.4336 - val_acc: 0.9172 Epoch 2542/5000 80/80 - 32s 400ms/step - loss: 0.0987 - acc: 0.9936 - val_loss: 0.4197 - val_acc: 0.9201 Epoch 2543/5000 80/80 - 32s 400ms/step - loss: 0.1006 - acc: 0.9925 - val_loss: 0.4098 - val_acc: 0.9219 Epoch 2544/5000 80/80 - 32s 400ms/step - loss: 0.0985 - acc: 0.9931 - val_loss: 0.4044 - val_acc: 0.9214 Epoch 2545/5000 80/80 - 32s 399ms/step - loss: 0.0997 - acc: 0.9929 - val_loss: 0.3958 - val_acc: 0.9251 Epoch 2546/5000 80/80 - 32s 400ms/step - loss: 0.0980 - acc: 0.9936 - val_loss: 0.3987 - val_acc: 0.9220 Epoch 2547/5000 80/80 - 32s 399ms/step - loss: 0.0985 - acc: 0.9930 - val_loss: 0.4155 - val_acc: 0.9144 Epoch 2548/5000 80/80 - 32s 399ms/step - loss: 0.0987 - acc: 0.9929 - val_loss: 0.4052 - val_acc: 0.9216 Epoch 2549/5000 80/80 - 32s 399ms/step - loss: 0.0961 - acc: 0.9943 - val_loss: 0.4019 - val_acc: 0.9248 Epoch 2550/5000 80/80 - 32s 399ms/step - loss: 0.0990 - acc: 0.9932 - val_loss: 0.4112 - val_acc: 0.9186 Epoch 2551/5000 80/80 - 32s 399ms/step - loss: 0.0970 - acc: 0.9937 - val_loss: 0.4091 - val_acc: 0.9190 Epoch 2552/5000 80/80 - 32s 399ms/step - loss: 0.0972 - acc: 0.9942 - val_loss: 0.4164 - val_acc: 0.9191 Epoch 2553/5000 80/80 - 32s 400ms/step - loss: 0.0971 - acc: 0.9939 - val_loss: 0.4206 - val_acc: 0.9156 Epoch 2554/5000 80/80 - 32s 400ms/step - loss: 0.0971 - acc: 0.9937 - val_loss: 0.4245 - val_acc: 0.9163 Epoch 2555/5000 80/80 - 32s 400ms/step - loss: 0.0988 - acc: 0.9927 - val_loss: 0.4192 - val_acc: 0.9191 Epoch 2556/5000 80/80 - 32s 399ms/step - loss: 0.0990 - acc: 0.9931 - val_loss: 0.4244 - val_acc: 0.9177 Epoch 2557/5000 80/80 - 32s 399ms/step - loss: 0.1005 - acc: 0.9928 - val_loss: 0.4160 - val_acc: 0.9195 Epoch 2558/5000 80/80 - 32s 399ms/step - loss: 0.0993 - acc: 0.9930 - val_loss: 0.4175 - val_acc: 0.9154 Epoch 2559/5000 80/80 - 32s 399ms/step - loss: 0.0994 - acc: 0.9929 - val_loss: 0.4214 - val_acc: 0.9157 Epoch 2560/5000 80/80 - 32s 399ms/step - loss: 0.0993 - acc: 0.9934 - val_loss: 0.4160 - val_acc: 0.9203 Epoch 2561/5000 80/80 - 32s 400ms/step - loss: 0.0990 - acc: 0.9931 - val_loss: 0.4251 - val_acc: 0.9156 Epoch 2562/5000 80/80 - 32s 399ms/step - loss: 0.0998 - acc: 0.9929 - val_loss: 0.4163 - val_acc: 0.9160 Epoch 2563/5000 80/80 - 32s 400ms/step - loss: 0.0980 - acc: 0.9933 - val_loss: 0.4083 - val_acc: 0.9204 Epoch 2564/5000 80/80 - 32s 400ms/step - loss: 0.0986 - acc: 0.9933 - val_loss: 0.4211 - val_acc: 0.9177 Epoch 2565/5000 80/80 - 32s 399ms/step - loss: 0.0982 - acc: 0.9929 - val_loss: 0.3990 - val_acc: 0.9198 Epoch 2566/5000 80/80 - 32s 400ms/step - loss: 0.1006 - acc: 0.9928 - val_loss: 0.4059 - val_acc: 0.9200 Epoch 2567/5000 80/80 - 32s 400ms/step - loss: 0.0982 - acc: 0.9936 - val_loss: 0.4255 - val_acc: 0.9172 Epoch 2568/5000 80/80 - 32s 399ms/step - loss: 0.0988 - acc: 0.9928 - val_loss: 0.4167 - val_acc: 0.9186 Epoch 2569/5000 80/80 - 32s 400ms/step - loss: 0.0982 - acc: 0.9937 - val_loss: 0.4128 - val_acc: 0.9216 Epoch 2570/5000 80/80 - 32s 400ms/step - loss: 0.1007 - acc: 0.9925 - val_loss: 0.4126 - val_acc: 0.9193 Epoch 2571/5000 80/80 - 32s 399ms/step - loss: 0.1005 - acc: 0.9923 - val_loss: 0.4234 - val_acc: 0.9143 Epoch 2572/5000 80/80 - 32s 400ms/step - loss: 0.0999 - acc: 0.9928 - val_loss: 0.4101 - val_acc: 0.9206 Epoch 2573/5000 80/80 - 32s 399ms/step - loss: 0.0997 - acc: 0.9935 - val_loss: 0.4210 - val_acc: 0.9181 Epoch 2574/5000 80/80 - 32s 400ms/step - loss: 0.0965 - acc: 0.9941 - val_loss: 0.4224 - val_acc: 0.9180 Epoch 2575/5000 80/80 - 32s 399ms/step - loss: 0.0967 - acc: 0.9941 - val_loss: 0.4097 - val_acc: 0.9208 Epoch 2576/5000 80/80 - 32s 399ms/step - loss: 0.0952 - acc: 0.9944 - val_loss: 0.4208 - val_acc: 0.9188 Epoch 2577/5000 80/80 - 32s 399ms/step - loss: 0.0973 - acc: 0.9937 - val_loss: 0.4197 - val_acc: 0.9157 Epoch 2578/5000 80/80 - 32s 400ms/step - loss: 0.0971 - acc: 0.9935 - val_loss: 0.4177 - val_acc: 0.9221 Epoch 2579/5000 80/80 - 32s 400ms/step - loss: 0.1009 - acc: 0.9925 - val_loss: 0.4102 - val_acc: 0.9205 Epoch 2580/5000 80/80 - 32s 400ms/step - loss: 0.0996 - acc: 0.9931 - val_loss: 0.4128 - val_acc: 0.9177 Epoch 2581/5000 80/80 - 32s 400ms/step - loss: 0.0997 - acc: 0.9934 - val_loss: 0.4057 - val_acc: 0.9193 Epoch 2582/5000 80/80 - 32s 399ms/step - loss: 0.0984 - acc: 0.9930 - val_loss: 0.3972 - val_acc: 0.9205 Epoch 2583/5000 80/80 - 32s 400ms/step - loss: 0.0937 - acc: 0.9952 - val_loss: 0.4127 - val_acc: 0.9192 Epoch 2584/5000 80/80 - 32s 399ms/step - loss: 0.0975 - acc: 0.9935 - val_loss: 0.4041 - val_acc: 0.9223 Epoch 2585/5000 80/80 - 32s 400ms/step - loss: 0.0998 - acc: 0.9926 - val_loss: 0.4125 - val_acc: 0.9182 Epoch 2586/5000 80/80 - 32s 400ms/step - loss: 0.1021 - acc: 0.9918 - val_loss: 0.4003 - val_acc: 0.9196 Epoch 2587/5000 80/80 - 32s 400ms/step - loss: 0.0987 - acc: 0.9931 - val_loss: 0.4137 - val_acc: 0.9204 Epoch 2588/5000 80/80 - 32s 399ms/step - loss: 0.0989 - acc: 0.9931 - val_loss: 0.4122 - val_acc: 0.9200 Epoch 2589/5000 80/80 - 32s 399ms/step - loss: 0.0976 - acc: 0.9936 - val_loss: 0.4021 - val_acc: 0.9193 Epoch 2590/5000 80/80 - 32s 400ms/step - loss: 0.0981 - acc: 0.9935 - val_loss: 0.4269 - val_acc: 0.9157 Epoch 2591/5000 80/80 - 32s 400ms/step - loss: 0.1002 - acc: 0.9925 - val_loss: 0.4298 - val_acc: 0.9166 Epoch 2592/5000 80/80 - 32s 399ms/step - loss: 0.1005 - acc: 0.9921 - val_loss: 0.4184 - val_acc: 0.9197 Epoch 2593/5000 80/80 - 32s 399ms/step - loss: 0.0981 - acc: 0.9936 - val_loss: 0.4072 - val_acc: 0.9192 Epoch 2594/5000 80/80 - 32s 399ms/step - loss: 0.0960 - acc: 0.9943 - val_loss: 0.4043 - val_acc: 0.9225 Epoch 2595/5000 80/80 - 32s 399ms/step - loss: 0.0964 - acc: 0.9939 - val_loss: 0.4311 - val_acc: 0.9145 Epoch 2596/5000 80/80 - 32s 399ms/step - loss: 0.0977 - acc: 0.9937 - val_loss: 0.4075 - val_acc: 0.9217 Epoch 2597/5000 80/80 - 32s 400ms/step - loss: 0.0989 - acc: 0.9934 - val_loss: 0.4333 - val_acc: 0.9161 Epoch 2598/5000 80/80 - 32s 400ms/step - loss: 0.1013 - acc: 0.9923 - val_loss: 0.4255 - val_acc: 0.9161 Epoch 2599/5000 80/80 - 32s 399ms/step - loss: 0.1015 - acc: 0.9925 - val_loss: 0.3974 - val_acc: 0.9204 Epoch 2600/5000 80/80 - 32s 400ms/step - loss: 0.0998 - acc: 0.9930 - val_loss: 0.4109 - val_acc: 0.9211 Epoch 2601/5000 80/80 - 32s 400ms/step - loss: 0.0983 - acc: 0.9935 - val_loss: 0.4120 - val_acc: 0.9208 Epoch 2602/5000 80/80 - 32s 399ms/step - loss: 0.0988 - acc: 0.9927 - val_loss: 0.4055 - val_acc: 0.9196 Epoch 2603/5000 80/80 - 32s 400ms/step - loss: 0.0996 - acc: 0.9932 - val_loss: 0.4109 - val_acc: 0.9207 Epoch 2604/5000 80/80 - 32s 400ms/step - loss: 0.0973 - acc: 0.9937 - val_loss: 0.4208 - val_acc: 0.9182 Epoch 2605/5000 80/80 - 32s 400ms/step - loss: 0.0994 - acc: 0.9929 - val_loss: 0.4018 - val_acc: 0.9223 Epoch 2606/5000 80/80 - 32s 400ms/step - loss: 0.0971 - acc: 0.9937 - val_loss: 0.4009 - val_acc: 0.9228 Epoch 2607/5000 80/80 - 32s 400ms/step - loss: 0.0985 - acc: 0.9931 - val_loss: 0.4101 - val_acc: 0.9218 Epoch 2608/5000 80/80 - 32s 399ms/step - loss: 0.0986 - acc: 0.9929 - val_loss: 0.4025 - val_acc: 0.9194 Epoch 2609/5000 80/80 - 32s 400ms/step - loss: 0.0978 - acc: 0.9935 - val_loss: 0.4306 - val_acc: 0.9177 Epoch 2610/5000 80/80 - 32s 400ms/step - loss: 0.0978 - acc: 0.9934 - val_loss: 0.3992 - val_acc: 0.9206 Epoch 2611/5000 80/80 - 32s 400ms/step - loss: 0.0968 - acc: 0.9939 - val_loss: 0.4082 - val_acc: 0.9193 Epoch 2612/5000 80/80 - 32s 400ms/step - loss: 0.0961 - acc: 0.9941 - val_loss: 0.4167 - val_acc: 0.9175 Epoch 2613/5000 80/80 - 32s 400ms/step - loss: 0.1007 - acc: 0.9924 - val_loss: 0.4278 - val_acc: 0.9139 Epoch 2614/5000 80/80 - 32s 399ms/step - loss: 0.0998 - acc: 0.9931 - val_loss: 0.3944 - val_acc: 0.9230 Epoch 2615/5000 80/80 - 32s 400ms/step - loss: 0.0980 - acc: 0.9935 - val_loss: 0.4270 - val_acc: 0.9189 Epoch 2616/5000 80/80 - 32s 400ms/step - loss: 0.0979 - acc: 0.9934 - val_loss: 0.4189 - val_acc: 0.9158 Epoch 2617/5000 80/80 - 32s 400ms/step - loss: 0.0973 - acc: 0.9938 - val_loss: 0.4085 - val_acc: 0.9197 Epoch 2618/5000 80/80 - 32s 399ms/step - loss: 0.0986 - acc: 0.9931 - val_loss: 0.4071 - val_acc: 0.9197 Epoch 2619/5000 80/80 - 32s 400ms/step - loss: 0.0988 - acc: 0.9934 - val_loss: 0.4104 - val_acc: 0.9175 Epoch 2620/5000 80/80 - 32s 399ms/step - loss: 0.0985 - acc: 0.9930 - val_loss: 0.4074 - val_acc: 0.9190 Epoch 2621/5000 80/80 - 32s 400ms/step - loss: 0.1012 - acc: 0.9922 - val_loss: 0.3955 - val_acc: 0.9221 Epoch 2622/5000 80/80 - 32s 400ms/step - loss: 0.0966 - acc: 0.9939 - val_loss: 0.4020 - val_acc: 0.9182 Epoch 2623/5000 80/80 - 32s 400ms/step - loss: 0.0972 - acc: 0.9934 - val_loss: 0.4133 - val_acc: 0.9183 Epoch 2624/5000 80/80 - 32s 400ms/step - loss: 0.0977 - acc: 0.9935 - val_loss: 0.4207 - val_acc: 0.9197 Epoch 2625/5000 80/80 - 32s 400ms/step - loss: 0.0996 - acc: 0.9930 - val_loss: 0.4089 - val_acc: 0.9212 Epoch 2626/5000 80/80 - 32s 399ms/step - loss: 0.1003 - acc: 0.9934 - val_loss: 0.4132 - val_acc: 0.9185 Epoch 2627/5000 80/80 - 32s 400ms/step - loss: 0.0977 - acc: 0.9937 - val_loss: 0.3954 - val_acc: 0.9247 Epoch 2628/5000 80/80 - 32s 399ms/step - loss: 0.0981 - acc: 0.9934 - val_loss: 0.4054 - val_acc: 0.9197 Epoch 2629/5000 80/80 - 32s 400ms/step - loss: 0.0982 - acc: 0.9932 - val_loss: 0.4149 - val_acc: 0.9201 Epoch 2630/5000 80/80 - 32s 399ms/step - loss: 0.0995 - acc: 0.9929 - val_loss: 0.4055 - val_acc: 0.9197 Epoch 2631/5000 80/80 - 32s 400ms/step - loss: 0.0983 - acc: 0.9937 - val_loss: 0.4128 - val_acc: 0.9185 Epoch 2632/5000 80/80 - 32s 400ms/step - loss: 0.0985 - acc: 0.9936 - val_loss: 0.4011 - val_acc: 0.9206 Epoch 2633/5000 80/80 - 32s 400ms/step - loss: 0.0952 - acc: 0.9942 - val_loss: 0.3949 - val_acc: 0.9207 Epoch 2634/5000 80/80 - 32s 400ms/step - loss: 0.0976 - acc: 0.9936 - val_loss: 0.3849 - val_acc: 0.9241 Epoch 2635/5000 80/80 - 32s 400ms/step - loss: 0.0991 - acc: 0.9928 - val_loss: 0.4020 - val_acc: 0.9219 Epoch 2636/5000 80/80 - 32s 399ms/step - loss: 0.0961 - acc: 0.9941 - val_loss: 0.4096 - val_acc: 0.9193 Epoch 2637/5000 80/80 - 32s 399ms/step - loss: 0.0949 - acc: 0.9944 - val_loss: 0.3974 - val_acc: 0.9247 Epoch 2638/5000 80/80 - 32s 400ms/step - loss: 0.0968 - acc: 0.9937 - val_loss: 0.4155 - val_acc: 0.9219 Epoch 2639/5000 80/80 - 32s 400ms/step - loss: 0.0991 - acc: 0.9932 - val_loss: 0.4076 - val_acc: 0.9211 Epoch 2640/5000 80/80 - 32s 400ms/step - loss: 0.0978 - acc: 0.9932 - val_loss: 0.3905 - val_acc: 0.9236 Epoch 2641/5000 80/80 - 32s 400ms/step - loss: 0.0969 - acc: 0.9939 - val_loss: 0.3885 - val_acc: 0.9236 Epoch 2642/5000 80/80 - 32s 399ms/step - loss: 0.0993 - acc: 0.9929 - val_loss: 0.4034 - val_acc: 0.9235 Epoch 2643/5000 80/80 - 32s 400ms/step - loss: 0.0979 - acc: 0.9932 - val_loss: 0.4073 - val_acc: 0.9218 Epoch 2644/5000 80/80 - 32s 399ms/step - loss: 0.0988 - acc: 0.9932 - val_loss: 0.4026 - val_acc: 0.9224 Epoch 2645/5000 80/80 - 32s 400ms/step - loss: 0.0958 - acc: 0.9940 - val_loss: 0.4014 - val_acc: 0.9220 Epoch 2646/5000 80/80 - 32s 400ms/step - loss: 0.0985 - acc: 0.9933 - val_loss: 0.4068 - val_acc: 0.9213 Epoch 2647/5000 80/80 - 32s 399ms/step - loss: 0.0974 - acc: 0.9939 - val_loss: 0.4105 - val_acc: 0.9193 Epoch 2648/5000 80/80 - 32s 399ms/step - loss: 0.1025 - acc: 0.9917 - val_loss: 0.4219 - val_acc: 0.9188 Epoch 2649/5000 80/80 - 32s 399ms/step - loss: 0.0987 - acc: 0.9933 - val_loss: 0.4090 - val_acc: 0.9211 Epoch 2650/5000 80/80 - 32s 399ms/step - loss: 0.0959 - acc: 0.9941 - val_loss: 0.4021 - val_acc: 0.9208 Epoch 2651/5000 80/80 - 32s 400ms/step - loss: 0.0992 - acc: 0.9930 - val_loss: 0.4051 - val_acc: 0.9215 Epoch 2652/5000 80/80 - 32s 399ms/step - loss: 0.0990 - acc: 0.9930 - val_loss: 0.4006 - val_acc: 0.9229 Epoch 2653/5000 80/80 - 32s 399ms/step - loss: 0.0961 - acc: 0.9942 - val_loss: 0.4091 - val_acc: 0.9222 Epoch 2654/5000 80/80 - 32s 400ms/step - loss: 0.0961 - acc: 0.9937 - val_loss: 0.4235 - val_acc: 0.9196 Epoch 2655/5000 80/80 - 32s 399ms/step - loss: 0.0988 - acc: 0.9930 - val_loss: 0.4084 - val_acc: 0.9186 Epoch 2656/5000 80/80 - 32s 400ms/step - loss: 0.0984 - acc: 0.9932 - val_loss: 0.4081 - val_acc: 0.9210 Epoch 2657/5000 80/80 - 32s 400ms/step - loss: 0.0980 - acc: 0.9935 - val_loss: 0.4156 - val_acc: 0.9190 Epoch 2658/5000 80/80 - 32s 400ms/step - loss: 0.0980 - acc: 0.9931 - val_loss: 0.4087 - val_acc: 0.9193 Epoch 2659/5000 80/80 - 32s 399ms/step - loss: 0.0977 - acc: 0.9934 - val_loss: 0.4033 - val_acc: 0.9185 Epoch 2660/5000 80/80 - 32s 400ms/step - loss: 0.0969 - acc: 0.9940 - val_loss: 0.3986 - val_acc: 0.9222 Epoch 2661/5000 80/80 - 32s 399ms/step - loss: 0.0969 - acc: 0.9939 - val_loss: 0.3965 - val_acc: 0.9218 Epoch 2662/5000 80/80 - 32s 399ms/step - loss: 0.0962 - acc: 0.9937 - val_loss: 0.3976 - val_acc: 0.9215 Epoch 2663/5000 80/80 - 32s 400ms/step - loss: 0.0950 - acc: 0.9943 - val_loss: 0.4167 - val_acc: 0.9188 Epoch 2664/5000 80/80 - 32s 399ms/step - loss: 0.0979 - acc: 0.9932 - val_loss: 0.4034 - val_acc: 0.9206 Epoch 2665/5000 80/80 - 32s 399ms/step - loss: 0.0992 - acc: 0.9929 - val_loss: 0.3969 - val_acc: 0.9234 Epoch 2666/5000 80/80 - 32s 400ms/step - loss: 0.0964 - acc: 0.9941 - val_loss: 0.3966 - val_acc: 0.9220 Epoch 2667/5000 80/80 - 32s 400ms/step - loss: 0.0973 - acc: 0.9936 - val_loss: 0.4148 - val_acc: 0.9198 Epoch 2668/5000 80/80 - 32s 399ms/step - loss: 0.0968 - acc: 0.9938 - val_loss: 0.4037 - val_acc: 0.9208 Epoch 2669/5000 80/80 - 32s 399ms/step - loss: 0.0971 - acc: 0.9935 - val_loss: 0.4084 - val_acc: 0.9209 Epoch 2670/5000 80/80 - 32s 400ms/step - loss: 0.0971 - acc: 0.9934 - val_loss: 0.4074 - val_acc: 0.9189 Epoch 2671/5000 80/80 - 32s 400ms/step - loss: 0.0977 - acc: 0.9931 - val_loss: 0.4032 - val_acc: 0.9232 Epoch 2672/5000 80/80 - 32s 400ms/step - loss: 0.0997 - acc: 0.9927 - val_loss: 0.3939 - val_acc: 0.9240 Epoch 2673/5000 80/80 - 32s 399ms/step - loss: 0.0946 - acc: 0.9947 - val_loss: 0.3953 - val_acc: 0.9237 Epoch 2674/5000 80/80 - 32s 400ms/step - loss: 0.0975 - acc: 0.9935 - val_loss: 0.3868 - val_acc: 0.9279 Epoch 2675/5000 80/80 - 32s 399ms/step - loss: 0.0990 - acc: 0.9930 - val_loss: 0.4006 - val_acc: 0.9199 Epoch 2676/5000 80/80 - 32s 400ms/step - loss: 0.0964 - acc: 0.9934 - val_loss: 0.4220 - val_acc: 0.9188 Epoch 2677/5000 80/80 - 32s 399ms/step - loss: 0.1000 - acc: 0.9929 - val_loss: 0.4106 - val_acc: 0.9204 Epoch 2678/5000 80/80 - 32s 399ms/step - loss: 0.0999 - acc: 0.9929 - val_loss: 0.4121 - val_acc: 0.9190 Epoch 2679/5000 80/80 - 32s 399ms/step - loss: 0.0965 - acc: 0.9941 - val_loss: 0.4127 - val_acc: 0.9188 Epoch 2680/5000 80/80 - 32s 399ms/step - loss: 0.0980 - acc: 0.9932 - val_loss: 0.4100 - val_acc: 0.9202 Epoch 2681/5000 80/80 - 32s 399ms/step - loss: 0.0969 - acc: 0.9940 - val_loss: 0.4025 - val_acc: 0.9228 Epoch 2682/5000 80/80 - 32s 399ms/step - loss: 0.0962 - acc: 0.9940 - val_loss: 0.4207 - val_acc: 0.9190 Epoch 2683/5000 80/80 - 32s 399ms/step - loss: 0.0992 - acc: 0.9931 - val_loss: 0.4197 - val_acc: 0.9177 Epoch 2684/5000 80/80 - 32s 399ms/step - loss: 0.0983 - acc: 0.9934 - val_loss: 0.4109 - val_acc: 0.9206 Epoch 2685/5000 80/80 - 32s 399ms/step - loss: 0.0965 - acc: 0.9938 - val_loss: 0.4025 - val_acc: 0.9218 Epoch 2686/5000 80/80 - 32s 399ms/step - loss: 0.0968 - acc: 0.9936 - val_loss: 0.4093 - val_acc: 0.9219 Epoch 2687/5000 80/80 - 32s 400ms/step - loss: 0.0970 - acc: 0.9934 - val_loss: 0.4014 - val_acc: 0.9196 Epoch 2688/5000 80/80 - 32s 400ms/step - loss: 0.0976 - acc: 0.9934 - val_loss: 0.4054 - val_acc: 0.9226 Epoch 2689/5000 80/80 - 32s 400ms/step - loss: 0.0964 - acc: 0.9936 - val_loss: 0.4357 - val_acc: 0.9176 Epoch 2690/5000 80/80 - 32s 400ms/step - loss: 0.0996 - acc: 0.9927 - val_loss: 0.4148 - val_acc: 0.9204 Epoch 2691/5000 80/80 - 32s 399ms/step - loss: 0.0999 - acc: 0.9930 - val_loss: 0.4421 - val_acc: 0.9148 Epoch 2692/5000 80/80 - 32s 399ms/step - loss: 0.1005 - acc: 0.9918 - val_loss: 0.4207 - val_acc: 0.9183 Epoch 2693/5000 80/80 - 32s 399ms/step - loss: 0.0955 - acc: 0.9942 - val_loss: 0.4128 - val_acc: 0.9198 Epoch 2694/5000 80/80 - 32s 400ms/step - loss: 0.0985 - acc: 0.9931 - val_loss: 0.4005 - val_acc: 0.9238 Epoch 2695/5000 80/80 - 32s 400ms/step - loss: 0.0960 - acc: 0.9937 - val_loss: 0.4034 - val_acc: 0.9219 Epoch 2696/5000 80/80 - 32s 399ms/step - loss: 0.0971 - acc: 0.9933 - val_loss: 0.4024 - val_acc: 0.9232 Epoch 2697/5000 80/80 - 32s 400ms/step - loss: 0.0954 - acc: 0.9942 - val_loss: 0.4048 - val_acc: 0.9216 Epoch 2698/5000 80/80 - 32s 399ms/step - loss: 0.0964 - acc: 0.9938 - val_loss: 0.4180 - val_acc: 0.9184 Epoch 2699/5000 80/80 - 32s 400ms/step - loss: 0.0962 - acc: 0.9940 - val_loss: 0.4164 - val_acc: 0.9208 Epoch 2700/5000 80/80 - 32s 399ms/step - loss: 0.0968 - acc: 0.9938 - val_loss: 0.4152 - val_acc: 0.9186 Epoch 2701/5000 80/80 - 32s 399ms/step - loss: 0.0991 - acc: 0.9929 - val_loss: 0.4133 - val_acc: 0.9202 Epoch 2702/5000 80/80 - 32s 400ms/step - loss: 0.0979 - acc: 0.9929 - val_loss: 0.3980 - val_acc: 0.9215 Epoch 2703/5000 80/80 - 32s 399ms/step - loss: 0.0965 - acc: 0.9940 - val_loss: 0.4181 - val_acc: 0.9183 Epoch 2704/5000 80/80 - 32s 400ms/step - loss: 0.0976 - acc: 0.9937 - val_loss: 0.4209 - val_acc: 0.9201 Epoch 2705/5000 80/80 - 32s 400ms/step - loss: 0.0973 - acc: 0.9936 - val_loss: 0.4127 - val_acc: 0.9203 Epoch 2706/5000 80/80 - 32s 399ms/step - loss: 0.0978 - acc: 0.9934 - val_loss: 0.4009 - val_acc: 0.9232 Epoch 2707/5000 80/80 - 32s 400ms/step - loss: 0.0963 - acc: 0.9938 - val_loss: 0.4163 - val_acc: 0.9188 Epoch 2708/5000 80/80 - 32s 400ms/step - loss: 0.1013 - acc: 0.9926 - val_loss: 0.4137 - val_acc: 0.9184 Epoch 2709/5000 80/80 - 32s 399ms/step - loss: 0.0980 - acc: 0.9933 - val_loss: 0.4121 - val_acc: 0.9202 Epoch 2710/5000 80/80 - 32s 400ms/step - loss: 0.0947 - acc: 0.9943 - val_loss: 0.4124 - val_acc: 0.9214 Epoch 2711/5000 80/80 - 32s 399ms/step - loss: 0.0967 - acc: 0.9939 - val_loss: 0.4326 - val_acc: 0.9164 Epoch 2712/5000 80/80 - 32s 400ms/step - loss: 0.0969 - acc: 0.9935 - val_loss: 0.4284 - val_acc: 0.9170 Epoch 2713/5000 80/80 - 32s 399ms/step - loss: 0.0991 - acc: 0.9927 - val_loss: 0.4333 - val_acc: 0.9171 Epoch 2714/5000 80/80 - 32s 400ms/step - loss: 0.0984 - acc: 0.9930 - val_loss: 0.4169 - val_acc: 0.9168 Epoch 2715/5000 80/80 - 32s 400ms/step - loss: 0.0974 - acc: 0.9939 - val_loss: 0.4255 - val_acc: 0.9151 Epoch 2716/5000 80/80 - 32s 399ms/step - loss: 0.0989 - acc: 0.9929 - val_loss: 0.4167 - val_acc: 0.9198 Epoch 2717/5000 80/80 - 32s 400ms/step - loss: 0.0980 - acc: 0.9932 - val_loss: 0.4285 - val_acc: 0.9159 Epoch 2718/5000 80/80 - 32s 400ms/step - loss: 0.0972 - acc: 0.9933 - val_loss: 0.4089 - val_acc: 0.9190 Epoch 2719/5000 80/80 - 32s 399ms/step - loss: 0.0976 - acc: 0.9932 - val_loss: 0.4192 - val_acc: 0.9172 Epoch 2720/5000 80/80 - 32s 400ms/step - loss: 0.0990 - acc: 0.9933 - val_loss: 0.4182 - val_acc: 0.9173 Epoch 2721/5000 80/80 - 32s 400ms/step - loss: 0.0990 - acc: 0.9929 - val_loss: 0.4402 - val_acc: 0.9162 Epoch 2722/5000 80/80 - 32s 399ms/step - loss: 0.0999 - acc: 0.9927 - val_loss: 0.4046 - val_acc: 0.9209 Epoch 2723/5000 80/80 - 32s 399ms/step - loss: 0.0987 - acc: 0.9932 - val_loss: 0.3987 - val_acc: 0.9237 Epoch 2724/5000 80/80 - 32s 399ms/step - loss: 0.0954 - acc: 0.9940 - val_loss: 0.4187 - val_acc: 0.9198 Epoch 2725/5000 80/80 - 32s 399ms/step - loss: 0.0971 - acc: 0.9933 - val_loss: 0.4090 - val_acc: 0.9192 Epoch 2726/5000 80/80 - 32s 399ms/step - loss: 0.0964 - acc: 0.9940 - val_loss: 0.4208 - val_acc: 0.9179 Epoch 2727/5000 80/80 - 32s 399ms/step - loss: 0.0974 - acc: 0.9934 - val_loss: 0.4090 - val_acc: 0.9226 Epoch 2728/5000 80/80 - 32s 399ms/step - loss: 0.0970 - acc: 0.9937 - val_loss: 0.4152 - val_acc: 0.9195 Epoch 2729/5000 80/80 - 32s 400ms/step - loss: 0.0968 - acc: 0.9935 - val_loss: 0.4141 - val_acc: 0.9203 Epoch 2730/5000 80/80 - 32s 399ms/step - loss: 0.0976 - acc: 0.9938 - val_loss: 0.4124 - val_acc: 0.9190 Epoch 2731/5000 80/80 - 32s 399ms/step - loss: 0.0964 - acc: 0.9936 - val_loss: 0.4213 - val_acc: 0.9205 Epoch 2732/5000 80/80 - 32s 399ms/step - loss: 0.0963 - acc: 0.9941 - val_loss: 0.4038 - val_acc: 0.9224 Epoch 2733/5000 80/80 - 32s 400ms/step - loss: 0.0971 - acc: 0.9938 - val_loss: 0.4017 - val_acc: 0.9220 Epoch 2734/5000 80/80 - 32s 400ms/step - loss: 0.0976 - acc: 0.9932 - val_loss: 0.4037 - val_acc: 0.9185 Epoch 2735/5000 80/80 - 32s 399ms/step - loss: 0.0946 - acc: 0.9943 - val_loss: 0.4279 - val_acc: 0.9170 Epoch 2736/5000 80/80 - 32s 399ms/step - loss: 0.0978 - acc: 0.9932 - val_loss: 0.4096 - val_acc: 0.9191 Epoch 2737/5000 80/80 - 32s 399ms/step - loss: 0.0977 - acc: 0.9934 - val_loss: 0.4116 - val_acc: 0.9193 Epoch 2738/5000 80/80 - 32s 399ms/step - loss: 0.0988 - acc: 0.9934 - val_loss: 0.4065 - val_acc: 0.9204 Epoch 2739/5000 80/80 - 32s 400ms/step - loss: 0.0959 - acc: 0.9937 - val_loss: 0.4142 - val_acc: 0.9183 Epoch 2740/5000 80/80 - 32s 400ms/step - loss: 0.0973 - acc: 0.9934 - val_loss: 0.4102 - val_acc: 0.9187 Epoch 2741/5000 80/80 - 32s 400ms/step - loss: 0.0969 - acc: 0.9936 - val_loss: 0.3986 - val_acc: 0.9215 Epoch 2742/5000 80/80 - 32s 400ms/step - loss: 0.0977 - acc: 0.9933 - val_loss: 0.3990 - val_acc: 0.9211 Epoch 2743/5000 80/80 - 32s 400ms/step - loss: 0.0960 - acc: 0.9942 - val_loss: 0.4157 - val_acc: 0.9180 Epoch 2744/5000 80/80 - 32s 399ms/step - loss: 0.0970 - acc: 0.9935 - val_loss: 0.4073 - val_acc: 0.9223 Epoch 2745/5000 80/80 - 32s 400ms/step - loss: 0.0964 - acc: 0.9936 - val_loss: 0.4208 - val_acc: 0.9195 Epoch 2746/5000 80/80 - 32s 400ms/step - loss: 0.0954 - acc: 0.9937 - val_loss: 0.4097 - val_acc: 0.9224 Epoch 2747/5000 80/80 - 32s 400ms/step - loss: 0.0974 - acc: 0.9934 - val_loss: 0.4088 - val_acc: 0.9212 Epoch 2748/5000 80/80 - 32s 399ms/step - loss: 0.0985 - acc: 0.9926 - val_loss: 0.3928 - val_acc: 0.9236 Epoch 2749/5000 80/80 - 32s 400ms/step - loss: 0.0986 - acc: 0.9927 - val_loss: 0.3917 - val_acc: 0.9218 Epoch 2750/5000 80/80 - 32s 399ms/step - loss: 0.0971 - acc: 0.9939 - val_loss: 0.4023 - val_acc: 0.9231 Epoch 2751/5000 80/80 - 32s 400ms/step - loss: 0.0981 - acc: 0.9933 - val_loss: 0.3974 - val_acc: 0.9205 Epoch 2752/5000 80/80 - 32s 400ms/step - loss: 0.0965 - acc: 0.9935 - val_loss: 0.4127 - val_acc: 0.9194 Epoch 2753/5000 80/80 - 32s 400ms/step - loss: 0.0972 - acc: 0.9936 - val_loss: 0.4006 - val_acc: 0.9218 Epoch 2754/5000 80/80 - 32s 400ms/step - loss: 0.0993 - acc: 0.9928 - val_loss: 0.4107 - val_acc: 0.9205 Epoch 2755/5000 80/80 - 32s 400ms/step - loss: 0.0964 - acc: 0.9937 - val_loss: 0.3914 - val_acc: 0.9250 Epoch 2756/5000 80/80 - 32s 399ms/step - loss: 0.0964 - acc: 0.9939 - val_loss: 0.3962 - val_acc: 0.9229 Epoch 2757/5000 80/80 - 32s 400ms/step - loss: 0.0969 - acc: 0.9934 - val_loss: 0.4014 - val_acc: 0.9222 Epoch 2758/5000 80/80 - 32s 400ms/step - loss: 0.0988 - acc: 0.9930 - val_loss: 0.4162 - val_acc: 0.9200 Epoch 2759/5000 80/80 - 32s 403ms/step - loss: 0.0972 - acc: 0.9936 - val_loss: 0.4115 - val_acc: 0.9213 Epoch 2760/5000 80/80 - 32s 400ms/step - loss: 0.0964 - acc: 0.9937 - val_loss: 0.4100 - val_acc: 0.9184 Epoch 2761/5000 80/80 - 32s 400ms/step - loss: 0.0988 - acc: 0.9928 - val_loss: 0.4156 - val_acc: 0.9186 Epoch 2762/5000 80/80 - 32s 399ms/step - loss: 0.0946 - acc: 0.9944 - val_loss: 0.4085 - val_acc: 0.9195 Epoch 2763/5000 80/80 - 32s 400ms/step - loss: 0.0952 - acc: 0.9937 - val_loss: 0.4210 - val_acc: 0.9174 Epoch 2764/5000 80/80 - 32s 399ms/step - loss: 0.0973 - acc: 0.9931 - val_loss: 0.4238 - val_acc: 0.9175 Epoch 2765/5000 80/80 - 32s 399ms/step - loss: 0.0973 - acc: 0.9935 - val_loss: 0.4231 - val_acc: 0.9184 Epoch 2766/5000 80/80 - 32s 399ms/step - loss: 0.0990 - acc: 0.9929 - val_loss: 0.4158 - val_acc: 0.9191 Epoch 2767/5000 80/80 - 32s 399ms/step - loss: 0.0984 - acc: 0.9929 - val_loss: 0.4081 - val_acc: 0.9180 Epoch 2768/5000 80/80 - 32s 400ms/step - loss: 0.0978 - acc: 0.9933 - val_loss: 0.4206 - val_acc: 0.9165 Epoch 2769/5000 80/80 - 32s 401ms/step - loss: 0.0958 - acc: 0.9937 - val_loss: 0.4084 - val_acc: 0.9183 Epoch 2770/5000 80/80 - 32s 400ms/step - loss: 0.0989 - acc: 0.9930 - val_loss: 0.4146 - val_acc: 0.9180 Epoch 2771/5000 80/80 - 32s 401ms/step - loss: 0.0995 - acc: 0.9932 - val_loss: 0.4020 - val_acc: 0.9195 Epoch 2772/5000 80/80 - 32s 400ms/step - loss: 0.0968 - acc: 0.9934 - val_loss: 0.3946 - val_acc: 0.9253 Epoch 2773/5000 80/80 - 32s 400ms/step - loss: 0.0959 - acc: 0.9938 - val_loss: 0.4154 - val_acc: 0.9195 Epoch 2774/5000 80/80 - 32s 400ms/step - loss: 0.0978 - acc: 0.9930 - val_loss: 0.4129 - val_acc: 0.9196 Epoch 2775/5000 80/80 - 32s 399ms/step - loss: 0.0974 - acc: 0.9937 - val_loss: 0.4206 - val_acc: 0.9169 Epoch 2776/5000 80/80 - 32s 400ms/step - loss: 0.0963 - acc: 0.9937 - val_loss: 0.4115 - val_acc: 0.9198 Epoch 2777/5000 80/80 - 32s 400ms/step - loss: 0.0999 - acc: 0.9924 - val_loss: 0.4169 - val_acc: 0.9180 Epoch 2778/5000 80/80 - 32s 399ms/step - loss: 0.0993 - acc: 0.9926 - val_loss: 0.4161 - val_acc: 0.9207 Epoch 2779/5000 80/80 - 32s 400ms/step - loss: 0.1007 - acc: 0.9924 - val_loss: 0.4098 - val_acc: 0.9177 Epoch 2780/5000 80/80 - 32s 400ms/step - loss: 0.1017 - acc: 0.9916 - val_loss: 0.4123 - val_acc: 0.9176 Epoch 2781/5000 80/80 - 32s 399ms/step - loss: 0.0977 - acc: 0.9934 - val_loss: 0.4133 - val_acc: 0.9180 Epoch 2782/5000 80/80 - 32s 400ms/step - loss: 0.0976 - acc: 0.9931 - val_loss: 0.4278 - val_acc: 0.9153 Epoch 2783/5000 80/80 - 32s 399ms/step - loss: 0.0992 - acc: 0.9927 - val_loss: 0.4089 - val_acc: 0.9185 Epoch 2784/5000 80/80 - 32s 399ms/step - loss: 0.0987 - acc: 0.9924 - val_loss: 0.4190 - val_acc: 0.9187 Epoch 2785/5000 80/80 - 32s 400ms/step - loss: 0.0989 - acc: 0.9929 - val_loss: 0.4083 - val_acc: 0.9191 Epoch 2786/5000 80/80 - 32s 400ms/step - loss: 0.0971 - acc: 0.9934 - val_loss: 0.4127 - val_acc: 0.9192 Epoch 2787/5000 80/80 - 32s 400ms/step - loss: 0.0981 - acc: 0.9931 - val_loss: 0.4030 - val_acc: 0.9207 Epoch 2788/5000 80/80 - 32s 400ms/step - loss: 0.0973 - acc: 0.9935 - val_loss: 0.3978 - val_acc: 0.9218 Epoch 2789/5000 80/80 - 32s 400ms/step - loss: 0.0970 - acc: 0.9932 - val_loss: 0.4080 - val_acc: 0.9205 Epoch 2790/5000 80/80 - 32s 399ms/step - loss: 0.0967 - acc: 0.9940 - val_loss: 0.4017 - val_acc: 0.9217 Epoch 2791/5000 80/80 - 32s 400ms/step - loss: 0.0970 - acc: 0.9933 - val_loss: 0.4003 - val_acc: 0.9223 Epoch 2792/5000 80/80 - 32s 400ms/step - loss: 0.0944 - acc: 0.9943 - val_loss: 0.4182 - val_acc: 0.9211 Epoch 2793/5000 80/80 - 32s 400ms/step - loss: 0.0974 - acc: 0.9935 - val_loss: 0.4142 - val_acc: 0.9176 Epoch 2794/5000 80/80 - 32s 400ms/step - loss: 0.0976 - acc: 0.9935 - val_loss: 0.3996 - val_acc: 0.9209 Epoch 2795/5000 80/80 - 32s 400ms/step - loss: 0.0980 - acc: 0.9933 - val_loss: 0.4202 - val_acc: 0.9171 Epoch 2796/5000 80/80 - 32s 400ms/step - loss: 0.1000 - acc: 0.9926 - val_loss: 0.4170 - val_acc: 0.9189 Epoch 2797/5000 80/80 - 32s 399ms/step - loss: 0.0982 - acc: 0.9929 - val_loss: 0.4060 - val_acc: 0.9215 Epoch 2798/5000 80/80 - 32s 400ms/step - loss: 0.0972 - acc: 0.9932 - val_loss: 0.4076 - val_acc: 0.9205 Epoch 2799/5000 80/80 - 32s 400ms/step - loss: 0.0952 - acc: 0.9943 - val_loss: 0.4100 - val_acc: 0.9200 Epoch 2800/5000 80/80 - 32s 400ms/step - loss: 0.0975 - acc: 0.9935 - val_loss: 0.4176 - val_acc: 0.9184 Epoch 2801/5000 80/80 - 32s 400ms/step - loss: 0.0971 - acc: 0.9936 - val_loss: 0.4148 - val_acc: 0.9175 Epoch 2802/5000 80/80 - 32s 399ms/step - loss: 0.0949 - acc: 0.9942 - val_loss: 0.4052 - val_acc: 0.9218 Epoch 2803/5000 80/80 - 32s 400ms/step - loss: 0.0964 - acc: 0.9939 - val_loss: 0.3979 - val_acc: 0.9220 Epoch 2804/5000 80/80 - 32s 399ms/step - loss: 0.0976 - acc: 0.9928 - val_loss: 0.3957 - val_acc: 0.9225 Epoch 2805/5000 80/80 - 32s 399ms/step - loss: 0.0980 - acc: 0.9934 - val_loss: 0.3964 - val_acc: 0.9216 Epoch 2806/5000 80/80 - 32s 400ms/step - loss: 0.0968 - acc: 0.9935 - val_loss: 0.4204 - val_acc: 0.9203 Epoch 2807/5000 80/80 - 32s 400ms/step - loss: 0.0983 - acc: 0.9934 - val_loss: 0.4139 - val_acc: 0.9203 Epoch 2808/5000 80/80 - 32s 400ms/step - loss: 0.0987 - acc: 0.9929 - val_loss: 0.4037 - val_acc: 0.9192 Epoch 2809/5000 80/80 - 32s 400ms/step - loss: 0.0986 - acc: 0.9927 - val_loss: 0.4057 - val_acc: 0.9203 Epoch 2810/5000 80/80 - 32s 400ms/step - loss: 0.0987 - acc: 0.9930 - val_loss: 0.4055 - val_acc: 0.9181 Epoch 2811/5000 80/80 - 32s 400ms/step - loss: 0.0975 - acc: 0.9936 - val_loss: 0.4011 - val_acc: 0.9174 Epoch 2812/5000 80/80 - 32s 400ms/step - loss: 0.0948 - acc: 0.9944 - val_loss: 0.4148 - val_acc: 0.9197 Epoch 2813/5000 80/80 - 32s 400ms/step - loss: 0.0956 - acc: 0.9942 - val_loss: 0.4006 - val_acc: 0.9234 Epoch 2814/5000 80/80 - 32s 400ms/step - loss: 0.0975 - acc: 0.9934 - val_loss: 0.3995 - val_acc: 0.9185 Epoch 2815/5000 80/80 - 32s 400ms/step - loss: 0.0964 - acc: 0.9940 - val_loss: 0.4069 - val_acc: 0.9206 Epoch 2816/5000 80/80 - 32s 399ms/step - loss: 0.0991 - acc: 0.9924 - val_loss: 0.4033 - val_acc: 0.9209 Epoch 2817/5000 80/80 - 32s 399ms/step - loss: 0.0977 - acc: 0.9930 - val_loss: 0.3956 - val_acc: 0.9223 Epoch 2818/5000 80/80 - 32s 400ms/step - loss: 0.0945 - acc: 0.9945 - val_loss: 0.3962 - val_acc: 0.9258 Epoch 2819/5000 80/80 - 32s 399ms/step - loss: 0.0947 - acc: 0.9939 - val_loss: 0.3998 - val_acc: 0.9231 Epoch 2820/5000 80/80 - 32s 399ms/step - loss: 0.0966 - acc: 0.9937 - val_loss: 0.4144 - val_acc: 0.9206 Epoch 2821/5000 80/80 - 32s 400ms/step - loss: 0.0970 - acc: 0.9934 - val_loss: 0.4081 - val_acc: 0.9206 Epoch 2822/5000 80/80 - 32s 400ms/step - loss: 0.0953 - acc: 0.9940 - val_loss: 0.4050 - val_acc: 0.9226 Epoch 2823/5000 80/80 - 32s 400ms/step - loss: 0.0958 - acc: 0.9937 - val_loss: 0.4340 - val_acc: 0.9173 Epoch 2824/5000 80/80 - 32s 400ms/step - loss: 0.1004 - acc: 0.9921 - val_loss: 0.3955 - val_acc: 0.9213 Epoch 2825/5000 80/80 - 32s 400ms/step - loss: 0.0972 - acc: 0.9935 - val_loss: 0.4043 - val_acc: 0.9214 Epoch 2826/5000 80/80 - 32s 399ms/step - loss: 0.0964 - acc: 0.9938 - val_loss: 0.4085 - val_acc: 0.9219 Epoch 2827/5000 80/80 - 32s 400ms/step - loss: 0.0988 - acc: 0.9928 - val_loss: 0.3964 - val_acc: 0.9210 Epoch 2828/5000 80/80 - 32s 400ms/step - loss: 0.0934 - acc: 0.9948 - val_loss: 0.4140 - val_acc: 0.9205 Epoch 2829/5000 80/80 - 32s 400ms/step - loss: 0.0945 - acc: 0.9942 - val_loss: 0.4219 - val_acc: 0.9198 Epoch 2830/5000 80/80 - 32s 400ms/step - loss: 0.0995 - acc: 0.9923 - val_loss: 0.4031 - val_acc: 0.9197 Epoch 2831/5000 80/80 - 32s 400ms/step - loss: 0.0964 - acc: 0.9939 - val_loss: 0.3897 - val_acc: 0.9226 Epoch 2832/5000 80/80 - 32s 400ms/step - loss: 0.1004 - acc: 0.9927 - val_loss: 0.3936 - val_acc: 0.9214 Epoch 2833/5000 80/80 - 32s 400ms/step - loss: 0.0978 - acc: 0.9931 - val_loss: 0.4018 - val_acc: 0.9201 Epoch 2834/5000 80/80 - 32s 400ms/step - loss: 0.0998 - acc: 0.9924 - val_loss: 0.3988 - val_acc: 0.9198 Epoch 2835/5000 80/80 - 32s 400ms/step - loss: 0.0975 - acc: 0.9933 - val_loss: 0.3856 - val_acc: 0.9240 Epoch 2836/5000 80/80 - 32s 400ms/step - loss: 0.0970 - acc: 0.9939 - val_loss: 0.3876 - val_acc: 0.9229 Epoch 2837/5000 80/80 - 32s 400ms/step - loss: 0.0941 - acc: 0.9944 - val_loss: 0.3920 - val_acc: 0.9244 Epoch 2838/5000 80/80 - 32s 400ms/step - loss: 0.0948 - acc: 0.9944 - val_loss: 0.4028 - val_acc: 0.9221 Epoch 2839/5000 80/80 - 32s 400ms/step - loss: 0.0937 - acc: 0.9945 - val_loss: 0.4004 - val_acc: 0.9229 Epoch 2840/5000 80/80 - 32s 400ms/step - loss: 0.0972 - acc: 0.9934 - val_loss: 0.3903 - val_acc: 0.9226 Epoch 2841/5000 80/80 - 32s 400ms/step - loss: 0.0973 - acc: 0.9934 - val_loss: 0.3857 - val_acc: 0.9256 Epoch 2842/5000 80/80 - 32s 399ms/step - loss: 0.0964 - acc: 0.9936 - val_loss: 0.4010 - val_acc: 0.9221 Epoch 2843/5000 80/80 - 32s 400ms/step - loss: 0.0967 - acc: 0.9937 - val_loss: 0.4024 - val_acc: 0.9216 Epoch 2844/5000 80/80 - 32s 400ms/step - loss: 0.0997 - acc: 0.9926 - val_loss: 0.3900 - val_acc: 0.9236 Epoch 2845/5000 80/80 - 32s 400ms/step - loss: 0.0969 - acc: 0.9935 - val_loss: 0.3953 - val_acc: 0.9221 Epoch 2846/5000 80/80 - 32s 400ms/step - loss: 0.0951 - acc: 0.9938 - val_loss: 0.4021 - val_acc: 0.9208 Epoch 2847/5000 80/80 - 32s 400ms/step - loss: 0.0979 - acc: 0.9930 - val_loss: 0.4009 - val_acc: 0.9233 Epoch 2848/5000 80/80 - 32s 400ms/step - loss: 0.0977 - acc: 0.9930 - val_loss: 0.3930 - val_acc: 0.9237 Epoch 2849/5000 80/80 - 32s 400ms/step - loss: 0.0956 - acc: 0.9939 - val_loss: 0.4015 - val_acc: 0.9243 Epoch 2850/5000 80/80 - 32s 400ms/step - loss: 0.0927 - acc: 0.9948 - val_loss: 0.4049 - val_acc: 0.9207 Epoch 2851/5000 80/80 - 32s 400ms/step - loss: 0.0946 - acc: 0.9940 - val_loss: 0.4033 - val_acc: 0.9220 Epoch 2852/5000 80/80 - 32s 400ms/step - loss: 0.0978 - acc: 0.9929 - val_loss: 0.4225 - val_acc: 0.9175 Epoch 2853/5000 80/80 - 32s 400ms/step - loss: 0.0997 - acc: 0.9922 - val_loss: 0.4070 - val_acc: 0.9192 Epoch 2854/5000 80/80 - 32s 400ms/step - loss: 0.0983 - acc: 0.9928 - val_loss: 0.4036 - val_acc: 0.9210 Epoch 2855/5000 80/80 - 32s 399ms/step - loss: 0.0987 - acc: 0.9926 - val_loss: 0.4075 - val_acc: 0.9206 Epoch 2856/5000 80/80 - 32s 400ms/step - loss: 0.0987 - acc: 0.9927 - val_loss: 0.4032 - val_acc: 0.9203 Epoch 2857/5000 80/80 - 32s 401ms/step - loss: 0.0969 - acc: 0.9938 - val_loss: 0.4019 - val_acc: 0.9213 Epoch 2858/5000 80/80 - 32s 400ms/step - loss: 0.0964 - acc: 0.9937 - val_loss: 0.3899 - val_acc: 0.9238 Epoch 2859/5000 80/80 - 32s 400ms/step - loss: 0.0975 - acc: 0.9934 - val_loss: 0.3993 - val_acc: 0.9214 Epoch 2860/5000 80/80 - 32s 400ms/step - loss: 0.0949 - acc: 0.9941 - val_loss: 0.3994 - val_acc: 0.9235 Epoch 2861/5000 80/80 - 32s 401ms/step - loss: 0.0970 - acc: 0.9935 - val_loss: 0.4064 - val_acc: 0.9214 Epoch 2862/5000 80/80 - 32s 399ms/step - loss: 0.0955 - acc: 0.9940 - val_loss: 0.4041 - val_acc: 0.9193 Epoch 2863/5000 80/80 - 32s 400ms/step - loss: 0.0962 - acc: 0.9938 - val_loss: 0.4191 - val_acc: 0.9191 Epoch 2864/5000 80/80 - 32s 400ms/step - loss: 0.0973 - acc: 0.9931 - val_loss: 0.4045 - val_acc: 0.9201 Epoch 2865/5000 80/80 - 32s 399ms/step - loss: 0.0954 - acc: 0.9943 - val_loss: 0.3977 - val_acc: 0.9211 Epoch 2866/5000 80/80 - 32s 400ms/step - loss: 0.0961 - acc: 0.9938 - val_loss: 0.3989 - val_acc: 0.9227 Epoch 2867/5000 80/80 - 32s 400ms/step - loss: 0.0953 - acc: 0.9938 - val_loss: 0.3939 - val_acc: 0.9250 Epoch 2868/5000 80/80 - 32s 400ms/step - loss: 0.0979 - acc: 0.9930 - val_loss: 0.4125 - val_acc: 0.9216 Epoch 2869/5000 80/80 - 32s 400ms/step - loss: 0.0980 - acc: 0.9930 - val_loss: 0.4048 - val_acc: 0.9215 Epoch 2870/5000 80/80 - 32s 400ms/step - loss: 0.0993 - acc: 0.9924 - val_loss: 0.4179 - val_acc: 0.9196 Epoch 2871/5000 80/80 - 32s 399ms/step - loss: 0.0972 - acc: 0.9932 - val_loss: 0.4137 - val_acc: 0.9187 Epoch 2872/5000 80/80 - 32s 399ms/step - loss: 0.0984 - acc: 0.9931 - val_loss: 0.4157 - val_acc: 0.9195 Epoch 2873/5000 80/80 - 32s 400ms/step - loss: 0.0962 - acc: 0.9936 - val_loss: 0.4047 - val_acc: 0.9201 Epoch 2874/5000 80/80 - 32s 400ms/step - loss: 0.0961 - acc: 0.9935 - val_loss: 0.4069 - val_acc: 0.9214 Epoch 2875/5000 80/80 - 32s 400ms/step - loss: 0.0955 - acc: 0.9936 - val_loss: 0.4101 - val_acc: 0.9211 Epoch 2876/5000 80/80 - 32s 400ms/step - loss: 0.0973 - acc: 0.9933 - val_loss: 0.4001 - val_acc: 0.9206 Epoch 2877/5000 80/80 - 32s 400ms/step - loss: 0.0964 - acc: 0.9935 - val_loss: 0.4101 - val_acc: 0.9204 Epoch 2878/5000 80/80 - 32s 400ms/step - loss: 0.0967 - acc: 0.9934 - val_loss: 0.4193 - val_acc: 0.9174 Epoch 2879/5000 80/80 - 32s 400ms/step - loss: 0.0972 - acc: 0.9933 - val_loss: 0.4158 - val_acc: 0.9175 Epoch 2880/5000 80/80 - 32s 399ms/step - loss: 0.0972 - acc: 0.9932 - val_loss: 0.4232 - val_acc: 0.9165 Epoch 2881/5000 80/80 - 32s 399ms/step - loss: 0.0967 - acc: 0.9937 - val_loss: 0.4191 - val_acc: 0.9158 Epoch 2882/5000 80/80 - 32s 400ms/step - loss: 0.0976 - acc: 0.9931 - val_loss: 0.4062 - val_acc: 0.9201 Epoch 2883/5000 80/80 - 32s 400ms/step - loss: 0.0976 - acc: 0.9929 - val_loss: 0.4061 - val_acc: 0.9226 Epoch 2884/5000 80/80 - 32s 400ms/step - loss: 0.0970 - acc: 0.9933 - val_loss: 0.4124 - val_acc: 0.9204 Epoch 2885/5000 80/80 - 32s 400ms/step - loss: 0.0980 - acc: 0.9929 - val_loss: 0.4139 - val_acc: 0.9208 Epoch 2886/5000 80/80 - 32s 400ms/step - loss: 0.0999 - acc: 0.9925 - val_loss: 0.3985 - val_acc: 0.9198 Epoch 2887/5000 80/80 - 32s 399ms/step - loss: 0.0984 - acc: 0.9931 - val_loss: 0.4021 - val_acc: 0.9228 Epoch 2888/5000 80/80 - 32s 399ms/step - loss: 0.0941 - acc: 0.9943 - val_loss: 0.3999 - val_acc: 0.9217 Epoch 2889/5000 80/80 - 32s 400ms/step - loss: 0.0963 - acc: 0.9938 - val_loss: 0.4054 - val_acc: 0.9195 Epoch 2890/5000 80/80 - 32s 400ms/step - loss: 0.0997 - acc: 0.9925 - val_loss: 0.4106 - val_acc: 0.9215 Epoch 2891/5000 80/80 - 32s 400ms/step - loss: 0.0988 - acc: 0.9930 - val_loss: 0.4006 - val_acc: 0.9206 Epoch 2892/5000 80/80 - 32s 400ms/step - loss: 0.0969 - acc: 0.9934 - val_loss: 0.4031 - val_acc: 0.9217 Epoch 2893/5000 80/80 - 32s 400ms/step - loss: 0.0981 - acc: 0.9931 - val_loss: 0.4196 - val_acc: 0.9153 Epoch 2894/5000 80/80 - 32s 399ms/step - loss: 0.0960 - acc: 0.9937 - val_loss: 0.4029 - val_acc: 0.9210 Epoch 2895/5000 80/80 - 32s 399ms/step - loss: 0.0943 - acc: 0.9942 - val_loss: 0.4019 - val_acc: 0.9227 Epoch 2896/5000 80/80 - 32s 400ms/step - loss: 0.0972 - acc: 0.9936 - val_loss: 0.4055 - val_acc: 0.9214 Epoch 2897/5000 80/80 - 32s 400ms/step - loss: 0.0954 - acc: 0.9936 - val_loss: 0.4086 - val_acc: 0.9233 Epoch 2898/5000 80/80 - 32s 400ms/step - loss: 0.0970 - acc: 0.9931 - val_loss: 0.4137 - val_acc: 0.9195 Epoch 2899/5000 80/80 - 32s 399ms/step - loss: 0.0993 - acc: 0.9927 - val_loss: 0.3915 - val_acc: 0.9229 Epoch 2900/5000 80/80 - 32s 400ms/step - loss: 0.0993 - acc: 0.9928 - val_loss: 0.3793 - val_acc: 0.9265 Epoch 2901/5000 80/80 - 32s 399ms/step - loss: 0.0956 - acc: 0.9936 - val_loss: 0.3990 - val_acc: 0.9229 Epoch 2902/5000 80/80 - 32s 399ms/step - loss: 0.0976 - acc: 0.9929 - val_loss: 0.4090 - val_acc: 0.9201 Epoch 2903/5000 80/80 - 32s 400ms/step - loss: 0.0959 - acc: 0.9937 - val_loss: 0.4035 - val_acc: 0.9232 Epoch 2904/5000 80/80 - 32s 399ms/step - loss: 0.0982 - acc: 0.9930 - val_loss: 0.4085 - val_acc: 0.9210 Epoch 2905/5000 80/80 - 32s 401ms/step - loss: 0.0955 - acc: 0.9936 - val_loss: 0.4115 - val_acc: 0.9212 Epoch 2906/5000 80/80 - 32s 400ms/step - loss: 0.0993 - acc: 0.9926 - val_loss: 0.4004 - val_acc: 0.9202 Epoch 2907/5000 80/80 - 32s 399ms/step - loss: 0.0966 - acc: 0.9938 - val_loss: 0.3916 - val_acc: 0.9217 Epoch 2908/5000 80/80 - 32s 399ms/step - loss: 0.0946 - acc: 0.9940 - val_loss: 0.4052 - val_acc: 0.9215 Epoch 2909/5000 80/80 - 32s 400ms/step - loss: 0.0953 - acc: 0.9941 - val_loss: 0.4041 - val_acc: 0.9218 Epoch 2910/5000 80/80 - 32s 400ms/step - loss: 0.0957 - acc: 0.9938 - val_loss: 0.4080 - val_acc: 0.9225 Epoch 2911/5000 80/80 - 32s 400ms/step - loss: 0.0984 - acc: 0.9928 - val_loss: 0.4084 - val_acc: 0.9204 Epoch 2912/5000 80/80 - 32s 400ms/step - loss: 0.0957 - acc: 0.9937 - val_loss: 0.4140 - val_acc: 0.9189 Epoch 2913/5000 80/80 - 32s 400ms/step - loss: 0.0974 - acc: 0.9932 - val_loss: 0.3915 - val_acc: 0.9228 Epoch 2914/5000 80/80 - 32s 400ms/step - loss: 0.0968 - acc: 0.9939 - val_loss: 0.3995 - val_acc: 0.9218 Epoch 2915/5000 80/80 - 32s 400ms/step - loss: 0.0965 - acc: 0.9936 - val_loss: 0.4201 - val_acc: 0.9200 Epoch 2916/5000 80/80 - 32s 400ms/step - loss: 0.0967 - acc: 0.9937 - val_loss: 0.3995 - val_acc: 0.9223 Epoch 2917/5000 80/80 - 32s 400ms/step - loss: 0.0959 - acc: 0.9937 - val_loss: 0.4102 - val_acc: 0.9200 Epoch 2918/5000 80/80 - 32s 400ms/step - loss: 0.0955 - acc: 0.9939 - val_loss: 0.4134 - val_acc: 0.9197 Epoch 2919/5000 80/80 - 32s 400ms/step - loss: 0.0966 - acc: 0.9936 - val_loss: 0.4088 - val_acc: 0.9232 Epoch 2920/5000 80/80 - 32s 399ms/step - loss: 0.0969 - acc: 0.9930 - val_loss: 0.4175 - val_acc: 0.9202 Epoch 2921/5000 80/80 - 32s 399ms/step - loss: 0.0966 - acc: 0.9935 - val_loss: 0.4059 - val_acc: 0.9207 Epoch 2922/5000 80/80 - 32s 400ms/step - loss: 0.0983 - acc: 0.9927 - val_loss: 0.4131 - val_acc: 0.9187 Epoch 2923/5000 80/80 - 32s 400ms/step - loss: 0.0975 - acc: 0.9933 - val_loss: 0.4185 - val_acc: 0.9204 Epoch 2924/5000 80/80 - 32s 404ms/step - loss: 0.0952 - acc: 0.9938 - val_loss: 0.4081 - val_acc: 0.9242 Epoch 2925/5000 80/80 - 32s 400ms/step - loss: 0.0971 - acc: 0.9933 - val_loss: 0.4269 - val_acc: 0.9153 Epoch 2926/5000 80/80 - 32s 400ms/step - loss: 0.0981 - acc: 0.9926 - val_loss: 0.4256 - val_acc: 0.9169 Epoch 2927/5000 80/80 - 32s 400ms/step - loss: 0.0960 - acc: 0.9934 - val_loss: 0.4056 - val_acc: 0.9221 Epoch 2928/5000 80/80 - 32s 400ms/step - loss: 0.0971 - acc: 0.9932 - val_loss: 0.4175 - val_acc: 0.9180 Epoch 2929/5000 80/80 - 32s 400ms/step - loss: 0.0962 - acc: 0.9937 - val_loss: 0.4009 - val_acc: 0.9214 Epoch 2930/5000 80/80 - 32s 400ms/step - loss: 0.0960 - acc: 0.9935 - val_loss: 0.3967 - val_acc: 0.9223 Epoch 2931/5000 80/80 - 32s 400ms/step - loss: 0.0962 - acc: 0.9940 - val_loss: 0.4220 - val_acc: 0.9176 Epoch 2932/5000 80/80 - 32s 401ms/step - loss: 0.0975 - acc: 0.9928 - val_loss: 0.4027 - val_acc: 0.9214 Epoch 2933/5000 80/80 - 32s 400ms/step - loss: 0.0983 - acc: 0.9927 - val_loss: 0.4145 - val_acc: 0.9176 Epoch 2934/5000 80/80 - 32s 400ms/step - loss: 0.0943 - acc: 0.9946 - val_loss: 0.4156 - val_acc: 0.9179 Epoch 2935/5000 80/80 - 32s 400ms/step - loss: 0.0959 - acc: 0.9933 - val_loss: 0.4066 - val_acc: 0.9221 Epoch 2936/5000 80/80 - 32s 400ms/step - loss: 0.0967 - acc: 0.9934 - val_loss: 0.4068 - val_acc: 0.9212 Epoch 2937/5000 80/80 - 32s 400ms/step - loss: 0.0978 - acc: 0.9927 - val_loss: 0.4241 - val_acc: 0.9167 Epoch 2938/5000 80/80 - 32s 400ms/step - loss: 0.0980 - acc: 0.9931 - val_loss: 0.4394 - val_acc: 0.9145 Epoch 2939/5000 80/80 - 32s 400ms/step - loss: 0.0990 - acc: 0.9931 - val_loss: 0.4005 - val_acc: 0.9216 Epoch 2940/5000 80/80 - 32s 399ms/step - loss: 0.0986 - acc: 0.9927 - val_loss: 0.4044 - val_acc: 0.9193 Epoch 2941/5000 80/80 - 32s 400ms/step - loss: 0.0954 - acc: 0.9942 - val_loss: 0.4181 - val_acc: 0.9186 Epoch 2942/5000 80/80 - 32s 400ms/step - loss: 0.0958 - acc: 0.9937 - val_loss: 0.4147 - val_acc: 0.9203 Epoch 2943/5000 80/80 - 32s 399ms/step - loss: 0.0951 - acc: 0.9942 - val_loss: 0.4275 - val_acc: 0.9175 Epoch 2944/5000 80/80 - 32s 400ms/step - loss: 0.0939 - acc: 0.9944 - val_loss: 0.4291 - val_acc: 0.9166 Epoch 2945/5000 80/80 - 32s 400ms/step - loss: 0.0982 - acc: 0.9928 - val_loss: 0.4092 - val_acc: 0.9196 Epoch 2946/5000 80/80 - 32s 399ms/step - loss: 0.0978 - acc: 0.9932 - val_loss: 0.4252 - val_acc: 0.9205 Epoch 2947/5000 80/80 - 32s 400ms/step - loss: 0.0966 - acc: 0.9937 - val_loss: 0.4080 - val_acc: 0.9209 Epoch 2948/5000 80/80 - 32s 400ms/step - loss: 0.0977 - acc: 0.9930 - val_loss: 0.4041 - val_acc: 0.9204 Epoch 2949/5000 80/80 - 32s 399ms/step - loss: 0.0955 - acc: 0.9936 - val_loss: 0.4146 - val_acc: 0.9192 Epoch 2950/5000 80/80 - 32s 399ms/step - loss: 0.1007 - acc: 0.9920 - val_loss: 0.4123 - val_acc: 0.9200 Epoch 2951/5000 80/80 - 32s 399ms/step - loss: 0.0988 - acc: 0.9930 - val_loss: 0.4133 - val_acc: 0.9194 Epoch 2952/5000 80/80 - 32s 399ms/step - loss: 0.0972 - acc: 0.9929 - val_loss: 0.4094 - val_acc: 0.9190 Epoch 2953/5000 80/80 - 32s 400ms/step - loss: 0.0969 - acc: 0.9933 - val_loss: 0.3973 - val_acc: 0.9224 Epoch 2954/5000 80/80 - 32s 399ms/step - loss: 0.0951 - acc: 0.9938 - val_loss: 0.4130 - val_acc: 0.9218 Epoch 2955/5000 80/80 - 32s 400ms/step - loss: 0.0978 - acc: 0.9930 - val_loss: 0.4078 - val_acc: 0.9207 Epoch 2956/5000 80/80 - 32s 399ms/step - loss: 0.0967 - acc: 0.9937 - val_loss: 0.4102 - val_acc: 0.9188 Epoch 2957/5000 80/80 - 32s 400ms/step - loss: 0.1000 - acc: 0.9921 - val_loss: 0.4272 - val_acc: 0.9164 Epoch 2958/5000 80/80 - 32s 400ms/step - loss: 0.0979 - acc: 0.9932 - val_loss: 0.4090 - val_acc: 0.9187 Epoch 2959/5000 80/80 - 32s 400ms/step - loss: 0.0963 - acc: 0.9932 - val_loss: 0.4071 - val_acc: 0.9222 Epoch 2960/5000 80/80 - 32s 400ms/step - loss: 0.0958 - acc: 0.9940 - val_loss: 0.4108 - val_acc: 0.9208 Epoch 2961/5000 80/80 - 32s 399ms/step - loss: 0.0949 - acc: 0.9942 - val_loss: 0.4117 - val_acc: 0.9184 Epoch 2962/5000 80/80 - 32s 399ms/step - loss: 0.0939 - acc: 0.9948 - val_loss: 0.4099 - val_acc: 0.9209 Epoch 2963/5000 80/80 - 32s 400ms/step - loss: 0.0957 - acc: 0.9938 - val_loss: 0.4137 - val_acc: 0.9195 Epoch 2964/5000 80/80 - 32s 400ms/step - loss: 0.0970 - acc: 0.9934 - val_loss: 0.3981 - val_acc: 0.9202 Epoch 2965/5000 80/80 - 32s 399ms/step - loss: 0.0961 - acc: 0.9941 - val_loss: 0.4239 - val_acc: 0.9195 Epoch 2966/5000 80/80 - 32s 399ms/step - loss: 0.0958 - acc: 0.9939 - val_loss: 0.4232 - val_acc: 0.9203 Epoch 2967/5000 80/80 - 32s 400ms/step - loss: 0.0972 - acc: 0.9934 - val_loss: 0.4074 - val_acc: 0.9216 Epoch 2968/5000 80/80 - 32s 400ms/step - loss: 0.0953 - acc: 0.9936 - val_loss: 0.4118 - val_acc: 0.9193 Epoch 2969/5000 80/80 - 32s 399ms/step - loss: 0.0973 - acc: 0.9930 - val_loss: 0.4131 - val_acc: 0.9198 Epoch 2970/5000 80/80 - 32s 400ms/step - loss: 0.0958 - acc: 0.9940 - val_loss: 0.4189 - val_acc: 0.9160 Epoch 2971/5000 80/80 - 32s 400ms/step - loss: 0.0980 - acc: 0.9930 - val_loss: 0.4057 - val_acc: 0.9209 Epoch 2972/5000 80/80 - 32s 400ms/step - loss: 0.0961 - acc: 0.9931 - val_loss: 0.4205 - val_acc: 0.9179 Epoch 2973/5000 80/80 - 32s 399ms/step - loss: 0.0967 - acc: 0.9937 - val_loss: 0.4125 - val_acc: 0.9224 Epoch 2974/5000 80/80 - 32s 400ms/step - loss: 0.0972 - acc: 0.9934 - val_loss: 0.3937 - val_acc: 0.9228 Epoch 2975/5000 80/80 - 32s 399ms/step - loss: 0.0983 - acc: 0.9927 - val_loss: 0.4062 - val_acc: 0.9212 Epoch 2976/5000 80/80 - 32s 399ms/step - loss: 0.0957 - acc: 0.9937 - val_loss: 0.4155 - val_acc: 0.9193 Epoch 2977/5000 80/80 - 32s 400ms/step - loss: 0.0947 - acc: 0.9940 - val_loss: 0.4231 - val_acc: 0.9165 Epoch 2978/5000 80/80 - 32s 400ms/step - loss: 0.0957 - acc: 0.9934 - val_loss: 0.4168 - val_acc: 0.9203 Epoch 2979/5000 80/80 - 32s 400ms/step - loss: 0.0962 - acc: 0.9938 - val_loss: 0.3969 - val_acc: 0.9249 Epoch 2980/5000 80/80 - 32s 400ms/step - loss: 0.0966 - acc: 0.9933 - val_loss: 0.4029 - val_acc: 0.9222 Epoch 2981/5000 80/80 - 32s 400ms/step - loss: 0.0958 - acc: 0.9936 - val_loss: 0.4147 - val_acc: 0.9203 Epoch 2982/5000 80/80 - 32s 400ms/step - loss: 0.0953 - acc: 0.9937 - val_loss: 0.4105 - val_acc: 0.9237 Epoch 2983/5000 80/80 - 32s 400ms/step - loss: 0.0978 - acc: 0.9933 - val_loss: 0.4073 - val_acc: 0.9219 Epoch 2984/5000 80/80 - 32s 399ms/step - loss: 0.0992 - acc: 0.9927 - val_loss: 0.4007 - val_acc: 0.9206 Epoch 2985/5000 80/80 - 32s 400ms/step - loss: 0.0979 - acc: 0.9926 - val_loss: 0.3869 - val_acc: 0.9237 Epoch 2986/5000 80/80 - 32s 399ms/step - loss: 0.0965 - acc: 0.9934 - val_loss: 0.4219 - val_acc: 0.9190 Epoch 2987/5000 80/80 - 32s 399ms/step - loss: 0.0957 - acc: 0.9937 - val_loss: 0.4208 - val_acc: 0.9186 Epoch 2988/5000 80/80 - 32s 399ms/step - loss: 0.0973 - acc: 0.9932 - val_loss: 0.4147 - val_acc: 0.9178 Epoch 2989/5000 80/80 - 32s 399ms/step - loss: 0.0952 - acc: 0.9937 - val_loss: 0.4166 - val_acc: 0.9193 Epoch 2990/5000 80/80 - 32s 400ms/step - loss: 0.0975 - acc: 0.9930 - val_loss: 0.4258 - val_acc: 0.9171 Epoch 2991/5000 80/80 - 32s 399ms/step - loss: 0.0943 - acc: 0.9941 - val_loss: 0.4181 - val_acc: 0.9171 Epoch 2992/5000 80/80 - 32s 400ms/step - loss: 0.0953 - acc: 0.9939 - val_loss: 0.4198 - val_acc: 0.9200 Epoch 2993/5000 80/80 - 32s 399ms/step - loss: 0.0972 - acc: 0.9930 - val_loss: 0.4107 - val_acc: 0.9197 Epoch 2994/5000 80/80 - 32s 399ms/step - loss: 0.0968 - acc: 0.9933 - val_loss: 0.4157 - val_acc: 0.9169 Epoch 2995/5000 80/80 - 32s 399ms/step - loss: 0.0942 - acc: 0.9946 - val_loss: 0.4168 - val_acc: 0.9182 Epoch 2996/5000 80/80 - 32s 400ms/step - loss: 0.0985 - acc: 0.9928 - val_loss: 0.3975 - val_acc: 0.9207 Epoch 2997/5000 80/80 - 32s 399ms/step - loss: 0.0959 - acc: 0.9935 - val_loss: 0.3998 - val_acc: 0.9207 Epoch 2998/5000 80/80 - 32s 400ms/step - loss: 0.0964 - acc: 0.9934 - val_loss: 0.4053 - val_acc: 0.9188 Epoch 2999/5000 80/80 - 32s 400ms/step - loss: 0.0964 - acc: 0.9937 - val_loss: 0.4064 - val_acc: 0.9224 Epoch 3000/5000 80/80 - 32s 400ms/step - loss: 0.0980 - acc: 0.9927 - val_loss: 0.3968 - val_acc: 0.9236 Epoch 3001/5000 lr changed to 0.0009999999776482583 80/80 - 32s 400ms/step - loss: 0.0968 - acc: 0.9934 - val_loss: 0.3838 - val_acc: 0.9253 Epoch 3002/5000 80/80 - 32s 400ms/step - loss: 0.0884 - acc: 0.9963 - val_loss: 0.3789 - val_acc: 0.9271 Epoch 3003/5000 80/80 - 32s 400ms/step - loss: 0.0875 - acc: 0.9969 - val_loss: 0.3780 - val_acc: 0.9271 Epoch 3004/5000 80/80 - 32s 400ms/step - loss: 0.0847 - acc: 0.9976 - val_loss: 0.3759 - val_acc: 0.9278 Epoch 3005/5000 80/80 - 32s 400ms/step - loss: 0.0851 - acc: 0.9976 - val_loss: 0.3754 - val_acc: 0.9282 Epoch 3006/5000 80/80 - 32s 400ms/step - loss: 0.0834 - acc: 0.9981 - val_loss: 0.3740 - val_acc: 0.9288 Epoch 3007/5000 80/80 - 32s 400ms/step - loss: 0.0830 - acc: 0.9982 - val_loss: 0.3733 - val_acc: 0.9300 Epoch 3008/5000 80/80 - 32s 399ms/step - loss: 0.0831 - acc: 0.9982 - val_loss: 0.3756 - val_acc: 0.9301 Epoch 3009/5000 80/80 - 32s 400ms/step - loss: 0.0821 - acc: 0.9984 - val_loss: 0.3762 - val_acc: 0.9308 Epoch 3010/5000 80/80 - 32s 399ms/step - loss: 0.0824 - acc: 0.9982 - val_loss: 0.3773 - val_acc: 0.9300 Epoch 3011/5000 80/80 - 32s 400ms/step - loss: 0.0818 - acc: 0.9984 - val_loss: 0.3797 - val_acc: 0.9299 Epoch 3012/5000 80/80 - 32s 400ms/step - loss: 0.0821 - acc: 0.9985 - val_loss: 0.3804 - val_acc: 0.9294 Epoch 3013/5000 80/80 - 32s 400ms/step - loss: 0.0812 - acc: 0.9988 - val_loss: 0.3811 - val_acc: 0.9288 Epoch 3014/5000 80/80 - 32s 400ms/step - loss: 0.0819 - acc: 0.9984 - val_loss: 0.3810 - val_acc: 0.9300 Epoch 3015/5000 80/80 - 32s 400ms/step - loss: 0.0812 - acc: 0.9987 - val_loss: 0.3800 - val_acc: 0.9302 Epoch 3016/5000 80/80 - 32s 400ms/step - loss: 0.0813 - acc: 0.9989 - val_loss: 0.3814 - val_acc: 0.9299 Epoch 3017/5000 80/80 - 32s 400ms/step - loss: 0.0811 - acc: 0.9988 - val_loss: 0.3826 - val_acc: 0.9297 Epoch 3018/5000 80/80 - 32s 400ms/step - loss: 0.0807 - acc: 0.9988 - val_loss: 0.3823 - val_acc: 0.9307 Epoch 3019/5000 80/80 - 32s 400ms/step - loss: 0.0808 - acc: 0.9987 - val_loss: 0.3813 - val_acc: 0.9305 Epoch 3020/5000 80/80 - 32s 400ms/step - loss: 0.0810 - acc: 0.9988 - val_loss: 0.3836 - val_acc: 0.9296 Epoch 3021/5000 80/80 - 32s 400ms/step - loss: 0.0809 - acc: 0.9987 - val_loss: 0.3835 - val_acc: 0.9307 Epoch 3022/5000 80/80 - 32s 400ms/step - loss: 0.0803 - acc: 0.9988 - val_loss: 0.3824 - val_acc: 0.9301 Epoch 3023/5000 80/80 - 32s 399ms/step - loss: 0.0807 - acc: 0.9989 - val_loss: 0.3825 - val_acc: 0.9303 Epoch 3024/5000 80/80 - 32s 404ms/step - loss: 0.0802 - acc: 0.9990 - val_loss: 0.3835 - val_acc: 0.9301 Epoch 3025/5000 80/80 - 32s 400ms/step - loss: 0.0801 - acc: 0.9989 - val_loss: 0.3835 - val_acc: 0.9294 Epoch 3026/5000 80/80 - 32s 400ms/step - loss: 0.0806 - acc: 0.9986 - val_loss: 0.3824 - val_acc: 0.9306 Epoch 3027/5000 80/80 - 32s 400ms/step - loss: 0.0805 - acc: 0.9989 - val_loss: 0.3806 - val_acc: 0.9304 Epoch 3028/5000 80/80 - 32s 400ms/step - loss: 0.0799 - acc: 0.9991 - val_loss: 0.3837 - val_acc: 0.9303 Epoch 3029/5000 80/80 - 32s 400ms/step - loss: 0.0799 - acc: 0.9990 - val_loss: 0.3835 - val_acc: 0.9302 Epoch 3030/5000 80/80 - 32s 400ms/step - loss: 0.0795 - acc: 0.9991 - val_loss: 0.3831 - val_acc: 0.9312 Epoch 3031/5000 80/80 - 32s 400ms/step - loss: 0.0803 - acc: 0.9989 - val_loss: 0.3833 - val_acc: 0.9312 Epoch 3032/5000 80/80 - 32s 401ms/step - loss: 0.0803 - acc: 0.9989 - val_loss: 0.3868 - val_acc: 0.9298 Epoch 3033/5000 80/80 - 32s 400ms/step - loss: 0.0792 - acc: 0.9991 - val_loss: 0.3878 - val_acc: 0.9300 Epoch 3034/5000 80/80 - 32s 400ms/step - loss: 0.0795 - acc: 0.9990 - val_loss: 0.3866 - val_acc: 0.9302 Epoch 3035/5000 80/80 - 32s 400ms/step - loss: 0.0801 - acc: 0.9988 - val_loss: 0.3845 - val_acc: 0.9308 Epoch 3036/5000 80/80 - 32s 400ms/step - loss: 0.0791 - acc: 0.9993 - val_loss: 0.3815 - val_acc: 0.9313 Epoch 3037/5000 80/80 - 32s 400ms/step - loss: 0.0790 - acc: 0.9992 - val_loss: 0.3807 - val_acc: 0.9312 Epoch 3038/5000 80/80 - 32s 400ms/step - loss: 0.0797 - acc: 0.9990 - val_loss: 0.3808 - val_acc: 0.9317 Epoch 3039/5000 80/80 - 32s 400ms/step - loss: 0.0795 - acc: 0.9991 - val_loss: 0.3818 - val_acc: 0.9311 Epoch 3040/5000 80/80 - 32s 400ms/step - loss: 0.0794 - acc: 0.9990 - val_loss: 0.3828 - val_acc: 0.9319 Epoch 3041/5000 80/80 - 32s 400ms/step - loss: 0.0797 - acc: 0.9988 - val_loss: 0.3847 - val_acc: 0.9315 Epoch 3042/5000 80/80 - 32s 399ms/step - loss: 0.0792 - acc: 0.9991 - val_loss: 0.3845 - val_acc: 0.9312 Epoch 3043/5000 80/80 - 32s 400ms/step - loss: 0.0790 - acc: 0.9992 - val_loss: 0.3861 - val_acc: 0.9310 Epoch 3044/5000 80/80 - 32s 400ms/step - loss: 0.0791 - acc: 0.9990 - val_loss: 0.3872 - val_acc: 0.9309 Epoch 3045/5000 80/80 - 32s 399ms/step - loss: 0.0799 - acc: 0.9988 - val_loss: 0.3869 - val_acc: 0.9317 Epoch 3046/5000 80/80 - 32s 398ms/step - loss: 0.0791 - acc: 0.9991 - val_loss: 0.3870 - val_acc: 0.9324 Epoch 3047/5000 80/80 - 32s 399ms/step - loss: 0.0789 - acc: 0.9992 - val_loss: 0.3876 - val_acc: 0.9326 Epoch 3048/5000 80/80 - 32s 400ms/step - loss: 0.0787 - acc: 0.9991 - val_loss: 0.3884 - val_acc: 0.9321 Epoch 3049/5000 80/80 - 32s 400ms/step - loss: 0.0786 - acc: 0.9993 - val_loss: 0.3874 - val_acc: 0.9322 Epoch 3050/5000 80/80 - 32s 400ms/step - loss: 0.0789 - acc: 0.9991 - val_loss: 0.3894 - val_acc: 0.9316 Epoch 3051/5000 80/80 - 32s 400ms/step - loss: 0.0791 - acc: 0.9992 - val_loss: 0.3875 - val_acc: 0.9311 Epoch 3052/5000 80/80 - 32s 399ms/step - loss: 0.0787 - acc: 0.9991 - val_loss: 0.3849 - val_acc: 0.9318 Epoch 3053/5000 80/80 - 32s 399ms/step - loss: 0.0787 - acc: 0.9991 - val_loss: 0.3865 - val_acc: 0.9325 Epoch 3054/5000 80/80 - 32s 400ms/step - loss: 0.0785 - acc: 0.9992 - val_loss: 0.3880 - val_acc: 0.9316 Epoch 3055/5000 80/80 - 32s 399ms/step - loss: 0.0782 - acc: 0.9994 - val_loss: 0.3899 - val_acc: 0.9322 Epoch 3056/5000 80/80 - 32s 400ms/step - loss: 0.0787 - acc: 0.9991 - val_loss: 0.3896 - val_acc: 0.9315 Epoch 3057/5000 80/80 - 32s 399ms/step - loss: 0.0783 - acc: 0.9992 - val_loss: 0.3895 - val_acc: 0.9322 Epoch 3058/5000 80/80 - 32s 400ms/step - loss: 0.0781 - acc: 0.9994 - val_loss: 0.3903 - val_acc: 0.9310 Epoch 3059/5000 80/80 - 32s 399ms/step - loss: 0.0785 - acc: 0.9991 - val_loss: 0.3909 - val_acc: 0.9315 Epoch 3060/5000 80/80 - 32s 399ms/step - loss: 0.0785 - acc: 0.9991 - val_loss: 0.3904 - val_acc: 0.9320 Epoch 3061/5000 80/80 - 32s 400ms/step - loss: 0.0783 - acc: 0.9992 - val_loss: 0.3901 - val_acc: 0.9324 Epoch 3062/5000 80/80 - 32s 399ms/step - loss: 0.0779 - acc: 0.9995 - val_loss: 0.3888 - val_acc: 0.9322 Epoch 3063/5000 80/80 - 32s 400ms/step - loss: 0.0783 - acc: 0.9993 - val_loss: 0.3861 - val_acc: 0.9325 Epoch 3064/5000 80/80 - 32s 400ms/step - loss: 0.0779 - acc: 0.9993 - val_loss: 0.3867 - val_acc: 0.9321 Epoch 3065/5000 80/80 - 32s 399ms/step - loss: 0.0781 - acc: 0.9993 - val_loss: 0.3863 - val_acc: 0.9322 Epoch 3066/5000 80/80 - 32s 400ms/step - loss: 0.0785 - acc: 0.9991 - val_loss: 0.3847 - val_acc: 0.9322 Epoch 3067/5000 80/80 - 32s 399ms/step - loss: 0.0785 - acc: 0.9991 - val_loss: 0.3853 - val_acc: 0.9319 Epoch 3068/5000 80/80 - 32s 400ms/step - loss: 0.0778 - acc: 0.9993 - val_loss: 0.3843 - val_acc: 0.9317 Epoch 3069/5000 80/80 - 32s 399ms/step - loss: 0.0780 - acc: 0.9993 - val_loss: 0.3830 - val_acc: 0.9318 Epoch 3070/5000 80/80 - 32s 400ms/step - loss: 0.0780 - acc: 0.9993 - val_loss: 0.3841 - val_acc: 0.9317 Epoch 3071/5000 80/80 - 32s 400ms/step - loss: 0.0777 - acc: 0.9994 - val_loss: 0.3858 - val_acc: 0.9317 Epoch 3072/5000 80/80 - 32s 399ms/step - loss: 0.0780 - acc: 0.9990 - val_loss: 0.3869 - val_acc: 0.9318 Epoch 3073/5000 80/80 - 32s 399ms/step - loss: 0.0783 - acc: 0.9991 - val_loss: 0.3884 - val_acc: 0.9320 Epoch 3074/5000 80/80 - 32s 400ms/step - loss: 0.0776 - acc: 0.9994 - val_loss: 0.3898 - val_acc: 0.9320 Epoch 3075/5000 80/80 - 32s 399ms/step - loss: 0.0777 - acc: 0.9994 - val_loss: 0.3903 - val_acc: 0.9321 Epoch 3076/5000 80/80 - 32s 399ms/step - loss: 0.0784 - acc: 0.9992 - val_loss: 0.3896 - val_acc: 0.9320 Epoch 3077/5000 80/80 - 32s 400ms/step - loss: 0.0774 - acc: 0.9993 - val_loss: 0.3913 - val_acc: 0.9311 Epoch 3078/5000 80/80 - 32s 403ms/step - loss: 0.0776 - acc: 0.9994 - val_loss: 0.3905 - val_acc: 0.9317 Epoch 3079/5000 80/80 - 32s 400ms/step - loss: 0.0779 - acc: 0.9991 - val_loss: 0.3911 - val_acc: 0.9309 Epoch 3080/5000 80/80 - 32s 399ms/step - loss: 0.0780 - acc: 0.9991 - val_loss: 0.3926 - val_acc: 0.9318 Epoch 3081/5000 80/80 - 32s 400ms/step - loss: 0.0779 - acc: 0.9991 - val_loss: 0.3899 - val_acc: 0.9317 Epoch 3082/5000 80/80 - 32s 400ms/step - loss: 0.0775 - acc: 0.9994 - val_loss: 0.3904 - val_acc: 0.9313 Epoch 3083/5000 80/80 - 32s 400ms/step - loss: 0.0774 - acc: 0.9993 - val_loss: 0.3914 - val_acc: 0.9317 Epoch 3084/5000 80/80 - 32s 400ms/step - loss: 0.0780 - acc: 0.9991 - val_loss: 0.3894 - val_acc: 0.9310 Epoch 3085/5000 80/80 - 32s 400ms/step - loss: 0.0771 - acc: 0.9995 - val_loss: 0.3894 - val_acc: 0.9316 Epoch 3086/5000 80/80 - 32s 400ms/step - loss: 0.0774 - acc: 0.9993 - val_loss: 0.3907 - val_acc: 0.9314 Epoch 3087/5000 80/80 - 32s 400ms/step - loss: 0.0773 - acc: 0.9993 - val_loss: 0.3931 - val_acc: 0.9309 Epoch 3088/5000 80/80 - 32s 400ms/step - loss: 0.0768 - acc: 0.9996 - val_loss: 0.3946 - val_acc: 0.9305 Epoch 3089/5000 80/80 - 32s 399ms/step - loss: 0.0772 - acc: 0.9994 - val_loss: 0.3949 - val_acc: 0.9299 Epoch 3090/5000 80/80 - 32s 400ms/step - loss: 0.0776 - acc: 0.9993 - val_loss: 0.3971 - val_acc: 0.9312 Epoch 3091/5000 80/80 - 32s 400ms/step - loss: 0.0771 - acc: 0.9995 - val_loss: 0.3960 - val_acc: 0.9310 Epoch 3092/5000 80/80 - 32s 400ms/step - loss: 0.0773 - acc: 0.9994 - val_loss: 0.3976 - val_acc: 0.9300 Epoch 3093/5000 80/80 - 32s 400ms/step - loss: 0.0773 - acc: 0.9993 - val_loss: 0.3980 - val_acc: 0.9296 Epoch 3094/5000 80/80 - 32s 400ms/step - loss: 0.0772 - acc: 0.9994 - val_loss: 0.3988 - val_acc: 0.9306 Epoch 3095/5000 80/80 - 32s 400ms/step - loss: 0.0772 - acc: 0.9993 - val_loss: 0.4012 - val_acc: 0.9295 Epoch 3096/5000 80/80 - 32s 400ms/step - loss: 0.0768 - acc: 0.9995 - val_loss: 0.3996 - val_acc: 0.9296 Epoch 3097/5000 80/80 - 32s 400ms/step - loss: 0.0773 - acc: 0.9993 - val_loss: 0.3985 - val_acc: 0.9294 Epoch 3098/5000 80/80 - 32s 401ms/step - loss: 0.0773 - acc: 0.9993 - val_loss: 0.3982 - val_acc: 0.9299 Epoch 3099/5000 80/80 - 32s 400ms/step - loss: 0.0774 - acc: 0.9992 - val_loss: 0.3972 - val_acc: 0.9299 Epoch 3100/5000 80/80 - 32s 400ms/step - loss: 0.0771 - acc: 0.9994 - val_loss: 0.3970 - val_acc: 0.9306 Epoch 3101/5000 80/80 - 32s 400ms/step - loss: 0.0771 - acc: 0.9993 - val_loss: 0.3939 - val_acc: 0.9304 Epoch 3102/5000 80/80 - 32s 400ms/step - loss: 0.0772 - acc: 0.9994 - val_loss: 0.3938 - val_acc: 0.9311 Epoch 3103/5000 80/80 - 32s 400ms/step - loss: 0.0770 - acc: 0.9993 - val_loss: 0.3923 - val_acc: 0.9308 Epoch 3104/5000 80/80 - 32s 400ms/step - loss: 0.0768 - acc: 0.9993 - val_loss: 0.3923 - val_acc: 0.9313 Epoch 3105/5000 80/80 - 32s 400ms/step - loss: 0.0771 - acc: 0.9993 - val_loss: 0.3946 - val_acc: 0.9304 Epoch 3106/5000 80/80 - 32s 399ms/step - loss: 0.0766 - acc: 0.9995 - val_loss: 0.3959 - val_acc: 0.9296 Epoch 3107/5000 80/80 - 32s 399ms/step - loss: 0.0774 - acc: 0.9990 - val_loss: 0.3940 - val_acc: 0.9304 Epoch 3108/5000 80/80 - 32s 399ms/step - loss: 0.0767 - acc: 0.9994 - val_loss: 0.3944 - val_acc: 0.9307 Epoch 3109/5000 80/80 - 32s 399ms/step - loss: 0.0771 - acc: 0.9992 - val_loss: 0.3942 - val_acc: 0.9296 Epoch 3110/5000 80/80 - 32s 400ms/step - loss: 0.0760 - acc: 0.9996 - val_loss: 0.3949 - val_acc: 0.9303 Epoch 3111/5000 80/80 - 32s 399ms/step - loss: 0.0767 - acc: 0.9994 - val_loss: 0.3933 - val_acc: 0.9306 Epoch 3112/5000 80/80 - 32s 399ms/step - loss: 0.0768 - acc: 0.9993 - val_loss: 0.3945 - val_acc: 0.9310 Epoch 3113/5000 80/80 - 32s 399ms/step - loss: 0.0768 - acc: 0.9993 - val_loss: 0.3940 - val_acc: 0.9314 Epoch 3114/5000 80/80 - 32s 399ms/step - loss: 0.0773 - acc: 0.9993 - val_loss: 0.3902 - val_acc: 0.9315 Epoch 3115/5000 80/80 - 32s 399ms/step - loss: 0.0763 - acc: 0.9995 - val_loss: 0.3896 - val_acc: 0.9325 Epoch 3116/5000 80/80 - 32s 400ms/step - loss: 0.0763 - acc: 0.9995 - val_loss: 0.3923 - val_acc: 0.9328 Epoch 3117/5000 80/80 - 32s 400ms/step - loss: 0.0764 - acc: 0.9994 - val_loss: 0.3917 - val_acc: 0.9330 Epoch 3118/5000 80/80 - 32s 400ms/step - loss: 0.0768 - acc: 0.9994 - val_loss: 0.3927 - val_acc: 0.9325 Epoch 3119/5000 80/80 - 32s 400ms/step - loss: 0.0763 - acc: 0.9994 - val_loss: 0.3945 - val_acc: 0.9310 Epoch 3120/5000 80/80 - 32s 399ms/step - loss: 0.0771 - acc: 0.9993 - val_loss: 0.3959 - val_acc: 0.9309 Epoch 3121/5000 80/80 - 32s 399ms/step - loss: 0.0767 - acc: 0.9994 - val_loss: 0.3965 - val_acc: 0.9311 Epoch 3122/5000 80/80 - 32s 399ms/step - loss: 0.0766 - acc: 0.9994 - val_loss: 0.3950 - val_acc: 0.9312 Epoch 3123/5000 80/80 - 32s 400ms/step - loss: 0.0764 - acc: 0.9994 - val_loss: 0.3932 - val_acc: 0.9316 Epoch 3124/5000 80/80 - 32s 400ms/step - loss: 0.0764 - acc: 0.9994 - val_loss: 0.3934 - val_acc: 0.9309 Epoch 3125/5000 80/80 - 32s 400ms/step - loss: 0.0767 - acc: 0.9994 - val_loss: 0.3906 - val_acc: 0.9316 Epoch 3126/5000 80/80 - 32s 400ms/step - loss: 0.0762 - acc: 0.9995 - val_loss: 0.3904 - val_acc: 0.9318 Epoch 3127/5000 80/80 - 32s 399ms/step - loss: 0.0762 - acc: 0.9994 - val_loss: 0.3919 - val_acc: 0.9312 Epoch 3128/5000 80/80 - 32s 399ms/step - loss: 0.0764 - acc: 0.9993 - val_loss: 0.3937 - val_acc: 0.9309 Epoch 3129/5000 80/80 - 32s 400ms/step - loss: 0.0762 - acc: 0.9995 - val_loss: 0.3957 - val_acc: 0.9301 Epoch 3130/5000 80/80 - 32s 400ms/step - loss: 0.0765 - acc: 0.9992 - val_loss: 0.3955 - val_acc: 0.9303 Epoch 3131/5000 80/80 - 32s 399ms/step - loss: 0.0764 - acc: 0.9993 - val_loss: 0.3974 - val_acc: 0.9298 Epoch 3132/5000 80/80 - 32s 400ms/step - loss: 0.0764 - acc: 0.9993 - val_loss: 0.3986 - val_acc: 0.9291 Epoch 3133/5000 80/80 - 32s 400ms/step - loss: 0.0759 - acc: 0.9995 - val_loss: 0.3973 - val_acc: 0.9287 Epoch 3134/5000 80/80 - 32s 399ms/step - loss: 0.0761 - acc: 0.9994 - val_loss: 0.3968 - val_acc: 0.9302 Epoch 3135/5000 80/80 - 32s 399ms/step - loss: 0.0761 - acc: 0.9994 - val_loss: 0.3973 - val_acc: 0.9292 Epoch 3136/5000 80/80 - 32s 399ms/step - loss: 0.0761 - acc: 0.9994 - val_loss: 0.3970 - val_acc: 0.9290 Epoch 3137/5000 80/80 - 32s 399ms/step - loss: 0.0763 - acc: 0.9994 - val_loss: 0.3973 - val_acc: 0.9297 Epoch 3138/5000 80/80 - 32s 399ms/step - loss: 0.0763 - acc: 0.9994 - val_loss: 0.3962 - val_acc: 0.9303 Epoch 3139/5000 80/80 - 32s 400ms/step - loss: 0.0763 - acc: 0.9992 - val_loss: 0.3953 - val_acc: 0.9309 Epoch 3140/5000 80/80 - 32s 399ms/step - loss: 0.0758 - acc: 0.9995 - val_loss: 0.3926 - val_acc: 0.9303 Epoch 3141/5000 80/80 - 32s 400ms/step - loss: 0.0759 - acc: 0.9995 - val_loss: 0.3940 - val_acc: 0.9301 Epoch 3142/5000 80/80 - 32s 399ms/step - loss: 0.0758 - acc: 0.9995 - val_loss: 0.3931 - val_acc: 0.9302 Epoch 3143/5000 80/80 - 32s 400ms/step - loss: 0.0756 - acc: 0.9996 - val_loss: 0.3921 - val_acc: 0.9316 Epoch 3144/5000 80/80 - 32s 399ms/step - loss: 0.0759 - acc: 0.9994 - val_loss: 0.3920 - val_acc: 0.9309 Epoch 3145/5000 80/80 - 32s 400ms/step - loss: 0.0759 - acc: 0.9994 - val_loss: 0.3914 - val_acc: 0.9314 Epoch 3146/5000 80/80 - 32s 400ms/step - loss: 0.0763 - acc: 0.9994 - val_loss: 0.3898 - val_acc: 0.9307 Epoch 3147/5000 80/80 - 32s 400ms/step - loss: 0.0759 - acc: 0.9994 - val_loss: 0.3891 - val_acc: 0.9314 Epoch 3148/5000 80/80 - 32s 400ms/step - loss: 0.0757 - acc: 0.9996 - val_loss: 0.3904 - val_acc: 0.9313 Epoch 3149/5000 80/80 - 32s 400ms/step - loss: 0.0763 - acc: 0.9992 - val_loss: 0.3872 - val_acc: 0.9326 Epoch 3150/5000 80/80 - 32s 400ms/step - loss: 0.0755 - acc: 0.9995 - val_loss: 0.3876 - val_acc: 0.9323 Epoch 3151/5000 80/80 - 32s 400ms/step - loss: 0.0759 - acc: 0.9994 - val_loss: 0.3885 - val_acc: 0.9327 Epoch 3152/5000 80/80 - 32s 400ms/step - loss: 0.0757 - acc: 0.9994 - val_loss: 0.3878 - val_acc: 0.9334 Epoch 3153/5000 80/80 - 32s 399ms/step - loss: 0.0758 - acc: 0.9993 - val_loss: 0.3888 - val_acc: 0.9327 Epoch 3154/5000 80/80 - 32s 399ms/step - loss: 0.0761 - acc: 0.9993 - val_loss: 0.3887 - val_acc: 0.9323 Epoch 3155/5000 80/80 - 32s 400ms/step - loss: 0.0755 - acc: 0.9995 - val_loss: 0.3883 - val_acc: 0.9321 Epoch 3156/5000 80/80 - 32s 400ms/step - loss: 0.0758 - acc: 0.9993 - val_loss: 0.3893 - val_acc: 0.9317 Epoch 3157/5000 80/80 - 32s 399ms/step - loss: 0.0756 - acc: 0.9994 - val_loss: 0.3908 - val_acc: 0.9322 Epoch 3158/5000 80/80 - 32s 399ms/step - loss: 0.0755 - acc: 0.9995 - val_loss: 0.3883 - val_acc: 0.9318 Epoch 3159/5000 80/80 - 32s 399ms/step - loss: 0.0758 - acc: 0.9994 - val_loss: 0.3882 - val_acc: 0.9328 Epoch 3160/5000 80/80 - 32s 399ms/step - loss: 0.0753 - acc: 0.9995 - val_loss: 0.3875 - val_acc: 0.9339 Epoch 3161/5000 80/80 - 32s 399ms/step - loss: 0.0754 - acc: 0.9994 - val_loss: 0.3880 - val_acc: 0.9326 Epoch 3162/5000 80/80 - 32s 400ms/step - loss: 0.0756 - acc: 0.9994 - val_loss: 0.3889 - val_acc: 0.9332 Epoch 3163/5000 80/80 - 32s 400ms/step - loss: 0.0755 - acc: 0.9993 - val_loss: 0.3869 - val_acc: 0.9335 Epoch 3164/5000 80/80 - 32s 399ms/step - loss: 0.0752 - acc: 0.9996 - val_loss: 0.3874 - val_acc: 0.9337 Epoch 3165/5000 80/80 - 32s 399ms/step - loss: 0.0752 - acc: 0.9995 - val_loss: 0.3903 - val_acc: 0.9327 Epoch 3166/5000 80/80 - 32s 399ms/step - loss: 0.0757 - acc: 0.9995 - val_loss: 0.3930 - val_acc: 0.9327 Epoch 3167/5000 80/80 - 32s 399ms/step - loss: 0.0755 - acc: 0.9994 - val_loss: 0.3949 - val_acc: 0.9322 Epoch 3168/5000 80/80 - 32s 400ms/step - loss: 0.0755 - acc: 0.9995 - val_loss: 0.3950 - val_acc: 0.9314 Epoch 3169/5000 80/80 - 32s 400ms/step - loss: 0.0752 - acc: 0.9994 - val_loss: 0.3953 - val_acc: 0.9314 Epoch 3170/5000 80/80 - 32s 399ms/step - loss: 0.0754 - acc: 0.9994 - val_loss: 0.3951 - val_acc: 0.9320 Epoch 3171/5000 80/80 - 32s 399ms/step - loss: 0.0747 - acc: 0.9996 - val_loss: 0.3974 - val_acc: 0.9306 Epoch 3172/5000 80/80 - 32s 399ms/step - loss: 0.0756 - acc: 0.9994 - val_loss: 0.3972 - val_acc: 0.9312 Epoch 3173/5000 80/80 - 32s 399ms/step - loss: 0.0751 - acc: 0.9995 - val_loss: 0.3980 - val_acc: 0.9311 Epoch 3174/5000 80/80 - 32s 400ms/step - loss: 0.0753 - acc: 0.9994 - val_loss: 0.3987 - val_acc: 0.9311 Epoch 3175/5000 80/80 - 32s 400ms/step - loss: 0.0755 - acc: 0.9993 - val_loss: 0.3958 - val_acc: 0.9311 Epoch 3176/5000 80/80 - 32s 400ms/step - loss: 0.0757 - acc: 0.9992 - val_loss: 0.3932 - val_acc: 0.9318 Epoch 3177/5000 80/80 - 32s 399ms/step - loss: 0.0752 - acc: 0.9994 - val_loss: 0.3926 - val_acc: 0.9310 Epoch 3178/5000 80/80 - 32s 400ms/step - loss: 0.0748 - acc: 0.9996 - val_loss: 0.3929 - val_acc: 0.9307 Epoch 3179/5000 80/80 - 32s 400ms/step - loss: 0.0748 - acc: 0.9996 - val_loss: 0.3938 - val_acc: 0.9316 Epoch 3180/5000 80/80 - 32s 399ms/step - loss: 0.0750 - acc: 0.9995 - val_loss: 0.3940 - val_acc: 0.9324 Epoch 3181/5000 80/80 - 32s 400ms/step - loss: 0.0753 - acc: 0.9994 - val_loss: 0.3950 - val_acc: 0.9321 Epoch 3182/5000 80/80 - 32s 399ms/step - loss: 0.0749 - acc: 0.9995 - val_loss: 0.3945 - val_acc: 0.9310 Epoch 3183/5000 80/80 - 32s 399ms/step - loss: 0.0749 - acc: 0.9995 - val_loss: 0.3920 - val_acc: 0.9314 Epoch 3184/5000 80/80 - 32s 399ms/step - loss: 0.0754 - acc: 0.9993 - val_loss: 0.3938 - val_acc: 0.9310 Epoch 3185/5000 80/80 - 32s 400ms/step - loss: 0.0746 - acc: 0.9996 - val_loss: 0.3940 - val_acc: 0.9306 Epoch 3186/5000 80/80 - 32s 400ms/step - loss: 0.0747 - acc: 0.9996 - val_loss: 0.3908 - val_acc: 0.9308 Epoch 3187/5000 80/80 - 32s 399ms/step - loss: 0.0750 - acc: 0.9994 - val_loss: 0.3889 - val_acc: 0.9306 Epoch 3188/5000 80/80 - 32s 400ms/step - loss: 0.0748 - acc: 0.9994 - val_loss: 0.3892 - val_acc: 0.9308 Epoch 3189/5000 80/80 - 32s 400ms/step - loss: 0.0748 - acc: 0.9996 - val_loss: 0.3894 - val_acc: 0.9302 Epoch 3190/5000 80/80 - 32s 400ms/step - loss: 0.0746 - acc: 0.9996 - val_loss: 0.3884 - val_acc: 0.9317 Epoch 3191/5000 80/80 - 32s 400ms/step - loss: 0.0750 - acc: 0.9994 - val_loss: 0.3910 - val_acc: 0.9308 Epoch 3192/5000 80/80 - 32s 400ms/step - loss: 0.0749 - acc: 0.9995 - val_loss: 0.3904 - val_acc: 0.9311 Epoch 3193/5000 80/80 - 32s 400ms/step - loss: 0.0752 - acc: 0.9994 - val_loss: 0.3901 - val_acc: 0.9306 Epoch 3194/5000 80/80 - 32s 399ms/step - loss: 0.0742 - acc: 0.9997 - val_loss: 0.3895 - val_acc: 0.9302 Epoch 3195/5000 80/80 - 32s 400ms/step - loss: 0.0749 - acc: 0.9994 - val_loss: 0.3904 - val_acc: 0.9302 Epoch 3196/5000 80/80 - 32s 400ms/step - loss: 0.0750 - acc: 0.9993 - val_loss: 0.3897 - val_acc: 0.9305 Epoch 3197/5000 80/80 - 32s 399ms/step - loss: 0.0743 - acc: 0.9995 - val_loss: 0.3925 - val_acc: 0.9307 Epoch 3198/5000 80/80 - 32s 400ms/step - loss: 0.0748 - acc: 0.9995 - val_loss: 0.3952 - val_acc: 0.9301 Epoch 3199/5000 80/80 - 32s 400ms/step - loss: 0.0748 - acc: 0.9995 - val_loss: 0.3948 - val_acc: 0.9302 Epoch 3200/5000 80/80 - 32s 400ms/step - loss: 0.0743 - acc: 0.9996 - val_loss: 0.3956 - val_acc: 0.9300 Epoch 3201/5000 80/80 - 32s 399ms/step - loss: 0.0751 - acc: 0.9992 - val_loss: 0.3927 - val_acc: 0.9313 Epoch 3202/5000 80/80 - 32s 400ms/step - loss: 0.0746 - acc: 0.9995 - val_loss: 0.3923 - val_acc: 0.9313 Epoch 3203/5000 80/80 - 32s 400ms/step - loss: 0.0747 - acc: 0.9994 - val_loss: 0.3922 - val_acc: 0.9318 Epoch 3204/5000 80/80 - 32s 400ms/step - loss: 0.0746 - acc: 0.9995 - val_loss: 0.3910 - val_acc: 0.9317 Epoch 3205/5000 80/80 - 32s 400ms/step - loss: 0.0746 - acc: 0.9994 - val_loss: 0.3901 - val_acc: 0.9312 Epoch 3206/5000 80/80 - 32s 399ms/step - loss: 0.0749 - acc: 0.9994 - val_loss: 0.3909 - val_acc: 0.9312 Epoch 3207/5000 80/80 - 32s 400ms/step - loss: 0.0743 - acc: 0.9996 - val_loss: 0.3912 - val_acc: 0.9315 Epoch 3208/5000 80/80 - 32s 399ms/step - loss: 0.0745 - acc: 0.9994 - val_loss: 0.3922 - val_acc: 0.9304 Epoch 3209/5000 80/80 - 32s 400ms/step - loss: 0.0748 - acc: 0.9993 - val_loss: 0.3928 - val_acc: 0.9302 Epoch 3210/5000 80/80 - 32s 399ms/step - loss: 0.0745 - acc: 0.9995 - val_loss: 0.3934 - val_acc: 0.9294 Epoch 3211/5000 80/80 - 32s 400ms/step - loss: 0.0741 - acc: 0.9996 - val_loss: 0.3945 - val_acc: 0.9305 Epoch 3212/5000 80/80 - 32s 399ms/step - loss: 0.0746 - acc: 0.9994 - val_loss: 0.3951 - val_acc: 0.9298 Epoch 3213/5000 80/80 - 32s 400ms/step - loss: 0.0743 - acc: 0.9995 - val_loss: 0.3967 - val_acc: 0.9291 Epoch 3214/5000 80/80 - 32s 399ms/step - loss: 0.0740 - acc: 0.9996 - val_loss: 0.3970 - val_acc: 0.9302 Epoch 3215/5000 80/80 - 32s 400ms/step - loss: 0.0741 - acc: 0.9995 - val_loss: 0.3991 - val_acc: 0.9301 Epoch 3216/5000 80/80 - 32s 400ms/step - loss: 0.0739 - acc: 0.9996 - val_loss: 0.3986 - val_acc: 0.9298 Epoch 3217/5000 80/80 - 32s 400ms/step - loss: 0.0739 - acc: 0.9996 - val_loss: 0.3987 - val_acc: 0.9301 Epoch 3218/5000 80/80 - 32s 400ms/step - loss: 0.0740 - acc: 0.9996 - val_loss: 0.3980 - val_acc: 0.9304 Epoch 3219/5000 80/80 - 32s 399ms/step - loss: 0.0739 - acc: 0.9996 - val_loss: 0.3976 - val_acc: 0.9313 Epoch 3220/5000 80/80 - 32s 399ms/step - loss: 0.0743 - acc: 0.9994 - val_loss: 0.4000 - val_acc: 0.9307 Epoch 3221/5000 80/80 - 32s 399ms/step - loss: 0.0739 - acc: 0.9995 - val_loss: 0.3957 - val_acc: 0.9316 Epoch 3222/5000 80/80 - 32s 400ms/step - loss: 0.0739 - acc: 0.9994 - val_loss: 0.3948 - val_acc: 0.9309 Epoch 3223/5000 80/80 - 32s 400ms/step - loss: 0.0738 - acc: 0.9995 - val_loss: 0.3947 - val_acc: 0.9313 Epoch 3224/5000 80/80 - 32s 400ms/step - loss: 0.0741 - acc: 0.9994 - val_loss: 0.3954 - val_acc: 0.9322 Epoch 3225/5000 80/80 - 32s 399ms/step - loss: 0.0742 - acc: 0.9994 - val_loss: 0.3951 - val_acc: 0.9314 Epoch 3226/5000 80/80 - 32s 400ms/step - loss: 0.0736 - acc: 0.9997 - val_loss: 0.3945 - val_acc: 0.9311 Epoch 3227/5000 80/80 - 32s 399ms/step - loss: 0.0740 - acc: 0.9994 - val_loss: 0.3941 - val_acc: 0.9312 Epoch 3228/5000 80/80 - 32s 399ms/step - loss: 0.0738 - acc: 0.9996 - val_loss: 0.3946 - val_acc: 0.9300 Epoch 3229/5000 80/80 - 32s 399ms/step - loss: 0.0736 - acc: 0.9997 - val_loss: 0.3950 - val_acc: 0.9301 Epoch 3230/5000 80/80 - 32s 400ms/step - loss: 0.0740 - acc: 0.9996 - val_loss: 0.3943 - val_acc: 0.9305 Epoch 3231/5000 80/80 - 32s 400ms/step - loss: 0.0737 - acc: 0.9996 - val_loss: 0.3974 - val_acc: 0.9304 Epoch 3232/5000 80/80 - 32s 400ms/step - loss: 0.0739 - acc: 0.9995 - val_loss: 0.3989 - val_acc: 0.9297 Epoch 3233/5000 80/80 - 32s 399ms/step - loss: 0.0737 - acc: 0.9996 - val_loss: 0.3974 - val_acc: 0.9308 Epoch 3234/5000 80/80 - 32s 400ms/step - loss: 0.0737 - acc: 0.9995 - val_loss: 0.3957 - val_acc: 0.9312 Epoch 3235/5000 80/80 - 32s 400ms/step - loss: 0.0739 - acc: 0.9994 - val_loss: 0.3945 - val_acc: 0.9314 Epoch 3236/5000 80/80 - 32s 399ms/step - loss: 0.0733 - acc: 0.9998 - val_loss: 0.3926 - val_acc: 0.9323 Epoch 3237/5000 80/80 - 32s 400ms/step - loss: 0.0740 - acc: 0.9995 - val_loss: 0.3936 - val_acc: 0.9328 Epoch 3238/5000 80/80 - 32s 400ms/step - loss: 0.0740 - acc: 0.9994 - val_loss: 0.3956 - val_acc: 0.9314 Epoch 3239/5000 80/80 - 32s 400ms/step - loss: 0.0740 - acc: 0.9993 - val_loss: 0.3962 - val_acc: 0.9318 Epoch 3240/5000 80/80 - 32s 399ms/step - loss: 0.0739 - acc: 0.9994 - val_loss: 0.3941 - val_acc: 0.9309 Epoch 3241/5000 80/80 - 32s 400ms/step - loss: 0.0740 - acc: 0.9994 - val_loss: 0.3926 - val_acc: 0.9326 Epoch 3242/5000 80/80 - 32s 400ms/step - loss: 0.0736 - acc: 0.9996 - val_loss: 0.3944 - val_acc: 0.9310 Epoch 3243/5000 80/80 - 32s 399ms/step - loss: 0.0738 - acc: 0.9995 - val_loss: 0.3934 - val_acc: 0.9315 Epoch 3244/5000 80/80 - 32s 400ms/step - loss: 0.0738 - acc: 0.9994 - val_loss: 0.3946 - val_acc: 0.9308 Epoch 3245/5000 80/80 - 32s 399ms/step - loss: 0.0734 - acc: 0.9996 - val_loss: 0.3942 - val_acc: 0.9321 Epoch 3246/5000 80/80 - 32s 400ms/step - loss: 0.0736 - acc: 0.9995 - val_loss: 0.3945 - val_acc: 0.9322 Epoch 3247/5000 80/80 - 32s 400ms/step - loss: 0.0733 - acc: 0.9996 - val_loss: 0.3948 - val_acc: 0.9319 Epoch 3248/5000 80/80 - 32s 400ms/step - loss: 0.0734 - acc: 0.9995 - val_loss: 0.3931 - val_acc: 0.9321 Epoch 3249/5000 80/80 - 32s 400ms/step - loss: 0.0731 - acc: 0.9997 - val_loss: 0.3953 - val_acc: 0.9330 Epoch 3250/5000 80/80 - 32s 399ms/step - loss: 0.0736 - acc: 0.9995 - val_loss: 0.3981 - val_acc: 0.9326 Epoch 3251/5000 80/80 - 32s 400ms/step - loss: 0.0732 - acc: 0.9996 - val_loss: 0.3976 - val_acc: 0.9319 Epoch 3252/5000 80/80 - 32s 399ms/step - loss: 0.0734 - acc: 0.9995 - val_loss: 0.3990 - val_acc: 0.9320 Epoch 3253/5000 80/80 - 32s 400ms/step - loss: 0.0734 - acc: 0.9996 - val_loss: 0.3986 - val_acc: 0.9319 Epoch 3254/5000 80/80 - 32s 399ms/step - loss: 0.0734 - acc: 0.9995 - val_loss: 0.3966 - val_acc: 0.9316 Epoch 3255/5000 80/80 - 32s 400ms/step - loss: 0.0737 - acc: 0.9994 - val_loss: 0.3945 - val_acc: 0.9323 Epoch 3256/5000 80/80 - 32s 400ms/step - loss: 0.0734 - acc: 0.9995 - val_loss: 0.3936 - val_acc: 0.9327 Epoch 3257/5000 80/80 - 32s 400ms/step - loss: 0.0739 - acc: 0.9993 - val_loss: 0.3952 - val_acc: 0.9332 Epoch 3258/5000 80/80 - 32s 399ms/step - loss: 0.0733 - acc: 0.9994 - val_loss: 0.3961 - val_acc: 0.9319 Epoch 3259/5000 80/80 - 32s 399ms/step - loss: 0.0734 - acc: 0.9994 - val_loss: 0.3954 - val_acc: 0.9322 Epoch 3260/5000 80/80 - 32s 400ms/step - loss: 0.0730 - acc: 0.9997 - val_loss: 0.3944 - val_acc: 0.9325 Epoch 3261/5000 80/80 - 32s 399ms/step - loss: 0.0734 - acc: 0.9995 - val_loss: 0.3933 - val_acc: 0.9332 Epoch 3262/5000 80/80 - 32s 400ms/step - loss: 0.0733 - acc: 0.9995 - val_loss: 0.3928 - val_acc: 0.9331 Epoch 3263/5000 80/80 - 32s 400ms/step - loss: 0.0732 - acc: 0.9995 - val_loss: 0.3937 - val_acc: 0.9336 Epoch 3264/5000 80/80 - 32s 400ms/step - loss: 0.0732 - acc: 0.9995 - val_loss: 0.3953 - val_acc: 0.9330 Epoch 3265/5000 80/80 - 32s 400ms/step - loss: 0.0733 - acc: 0.9995 - val_loss: 0.3958 - val_acc: 0.9329 Epoch 3266/5000 80/80 - 32s 400ms/step - loss: 0.0735 - acc: 0.9994 - val_loss: 0.3947 - val_acc: 0.9335 Epoch 3267/5000 80/80 - 32s 399ms/step - loss: 0.0729 - acc: 0.9995 - val_loss: 0.3950 - val_acc: 0.9326 Epoch 3268/5000 80/80 - 32s 400ms/step - loss: 0.0732 - acc: 0.9995 - val_loss: 0.3956 - val_acc: 0.9322 Epoch 3269/5000 80/80 - 32s 399ms/step - loss: 0.0731 - acc: 0.9995 - val_loss: 0.3941 - val_acc: 0.9329 Epoch 3270/5000 80/80 - 32s 399ms/step - loss: 0.0733 - acc: 0.9995 - val_loss: 0.3946 - val_acc: 0.9335 Epoch 3271/5000 80/80 - 32s 399ms/step - loss: 0.0733 - acc: 0.9995 - val_loss: 0.3947 - val_acc: 0.9335 Epoch 3272/5000 80/80 - 32s 399ms/step - loss: 0.0730 - acc: 0.9995 - val_loss: 0.3971 - val_acc: 0.9322 Epoch 3273/5000 80/80 - 32s 400ms/step - loss: 0.0730 - acc: 0.9996 - val_loss: 0.3974 - val_acc: 0.9316 Epoch 3274/5000 80/80 - 32s 400ms/step - loss: 0.0728 - acc: 0.9996 - val_loss: 0.3976 - val_acc: 0.9308 Epoch 3275/5000 80/80 - 32s 399ms/step - loss: 0.0728 - acc: 0.9996 - val_loss: 0.3996 - val_acc: 0.9309 Epoch 3276/5000 80/80 - 32s 400ms/step - loss: 0.0730 - acc: 0.9995 - val_loss: 0.4002 - val_acc: 0.9312 Epoch 3277/5000 80/80 - 32s 403ms/step - loss: 0.0731 - acc: 0.9996 - val_loss: 0.3989 - val_acc: 0.9315 Epoch 3278/5000 80/80 - 32s 400ms/step - loss: 0.0724 - acc: 0.9997 - val_loss: 0.3974 - val_acc: 0.9312 Epoch 3279/5000 80/80 - 32s 399ms/step - loss: 0.0730 - acc: 0.9994 - val_loss: 0.3980 - val_acc: 0.9311 Epoch 3280/5000 80/80 - 32s 400ms/step - loss: 0.0728 - acc: 0.9994 - val_loss: 0.4013 - val_acc: 0.9298 Epoch 3281/5000 80/80 - 32s 400ms/step - loss: 0.0729 - acc: 0.9995 - val_loss: 0.3991 - val_acc: 0.9306 Epoch 3282/5000 80/80 - 32s 399ms/step - loss: 0.0725 - acc: 0.9996 - val_loss: 0.3975 - val_acc: 0.9310 Epoch 3283/5000 80/80 - 32s 399ms/step - loss: 0.0729 - acc: 0.9996 - val_loss: 0.3965 - val_acc: 0.9305 Epoch 3284/5000 80/80 - 32s 399ms/step - loss: 0.0724 - acc: 0.9997 - val_loss: 0.3968 - val_acc: 0.9305 Epoch 3285/5000 80/80 - 32s 400ms/step - loss: 0.0725 - acc: 0.9995 - val_loss: 0.3976 - val_acc: 0.9304 Epoch 3286/5000 80/80 - 32s 400ms/step - loss: 0.0726 - acc: 0.9996 - val_loss: 0.3992 - val_acc: 0.9308 Epoch 3287/5000 80/80 - 32s 401ms/step - loss: 0.0726 - acc: 0.9996 - val_loss: 0.3989 - val_acc: 0.9309 Epoch 3288/5000 80/80 - 32s 400ms/step - loss: 0.0727 - acc: 0.9995 - val_loss: 0.3995 - val_acc: 0.9304 Epoch 3289/5000 80/80 - 32s 400ms/step - loss: 0.0726 - acc: 0.9995 - val_loss: 0.3998 - val_acc: 0.9315 Epoch 3290/5000 80/80 - 32s 400ms/step - loss: 0.0723 - acc: 0.9996 - val_loss: 0.3989 - val_acc: 0.9313 Epoch 3291/5000 80/80 - 32s 400ms/step - loss: 0.0726 - acc: 0.9995 - val_loss: 0.3993 - val_acc: 0.9312 Epoch 3292/5000 80/80 - 32s 400ms/step - loss: 0.0725 - acc: 0.9995 - val_loss: 0.4003 - val_acc: 0.9317 Epoch 3293/5000 80/80 - 32s 400ms/step - loss: 0.0727 - acc: 0.9994 - val_loss: 0.4021 - val_acc: 0.9321 Epoch 3294/5000 80/80 - 32s 400ms/step - loss: 0.0724 - acc: 0.9997 - val_loss: 0.4023 - val_acc: 0.9321 Epoch 3295/5000 80/80 - 32s 400ms/step - loss: 0.0728 - acc: 0.9995 - val_loss: 0.4053 - val_acc: 0.9316 Epoch 3296/5000 80/80 - 32s 400ms/step - loss: 0.0728 - acc: 0.9994 - val_loss: 0.4020 - val_acc: 0.9317 Epoch 3297/5000 80/80 - 32s 400ms/step - loss: 0.0724 - acc: 0.9995 - val_loss: 0.3995 - val_acc: 0.9315 Epoch 3298/5000 80/80 - 32s 400ms/step - loss: 0.0723 - acc: 0.9995 - val_loss: 0.3999 - val_acc: 0.9312 Epoch 3299/5000 80/80 - 32s 399ms/step - loss: 0.0727 - acc: 0.9994 - val_loss: 0.3995 - val_acc: 0.9317 Epoch 3300/5000 80/80 - 32s 400ms/step - loss: 0.0722 - acc: 0.9997 - val_loss: 0.3985 - val_acc: 0.9320 Epoch 3301/5000 80/80 - 32s 399ms/step - loss: 0.0723 - acc: 0.9996 - val_loss: 0.4007 - val_acc: 0.9305 Epoch 3302/5000 80/80 - 32s 400ms/step - loss: 0.0725 - acc: 0.9995 - val_loss: 0.4001 - val_acc: 0.9300 Epoch 3303/5000 80/80 - 32s 399ms/step - loss: 0.0722 - acc: 0.9995 - val_loss: 0.3995 - val_acc: 0.9304 Epoch 3304/5000 80/80 - 32s 400ms/step - loss: 0.0726 - acc: 0.9994 - val_loss: 0.3968 - val_acc: 0.9316 Epoch 3305/5000 80/80 - 32s 399ms/step - loss: 0.0725 - acc: 0.9994 - val_loss: 0.3956 - val_acc: 0.9328 Epoch 3306/5000 80/80 - 32s 399ms/step - loss: 0.0725 - acc: 0.9996 - val_loss: 0.3955 - val_acc: 0.9328 Epoch 3307/5000 80/80 - 32s 399ms/step - loss: 0.0723 - acc: 0.9995 - val_loss: 0.3947 - val_acc: 0.9320 Epoch 3308/5000 80/80 - 32s 399ms/step - loss: 0.0722 - acc: 0.9997 - val_loss: 0.3956 - val_acc: 0.9317 Epoch 3309/5000 80/80 - 32s 399ms/step - loss: 0.0722 - acc: 0.9995 - val_loss: 0.3982 - val_acc: 0.9307 Epoch 3310/5000 80/80 - 32s 399ms/step - loss: 0.0720 - acc: 0.9996 - val_loss: 0.3976 - val_acc: 0.9314 Epoch 3311/5000 80/80 - 32s 399ms/step - loss: 0.0722 - acc: 0.9996 - val_loss: 0.3977 - val_acc: 0.9316 Epoch 3312/5000 80/80 - 32s 399ms/step - loss: 0.0722 - acc: 0.9996 - val_loss: 0.3980 - val_acc: 0.9310 Epoch 3313/5000 80/80 - 32s 399ms/step - loss: 0.0720 - acc: 0.9996 - val_loss: 0.3992 - val_acc: 0.9316 Epoch 3314/5000 80/80 - 32s 400ms/step - loss: 0.0722 - acc: 0.9996 - val_loss: 0.3976 - val_acc: 0.9314 Epoch 3315/5000 80/80 - 32s 400ms/step - loss: 0.0725 - acc: 0.9994 - val_loss: 0.3961 - val_acc: 0.9321 Epoch 3316/5000 80/80 - 32s 400ms/step - loss: 0.0718 - acc: 0.9996 - val_loss: 0.3942 - val_acc: 0.9331 Epoch 3317/5000 80/80 - 32s 400ms/step - loss: 0.0719 - acc: 0.9995 - val_loss: 0.3944 - val_acc: 0.9327 Epoch 3318/5000 80/80 - 32s 399ms/step - loss: 0.0718 - acc: 0.9997 - val_loss: 0.3941 - val_acc: 0.9325 Epoch 3319/5000 80/80 - 32s 399ms/step - loss: 0.0722 - acc: 0.9994 - val_loss: 0.3966 - val_acc: 0.9323 Epoch 3320/5000 80/80 - 32s 399ms/step - loss: 0.0723 - acc: 0.9994 - val_loss: 0.3972 - val_acc: 0.9311 Epoch 3321/5000 80/80 - 32s 399ms/step - loss: 0.0717 - acc: 0.9997 - val_loss: 0.3950 - val_acc: 0.9312 Epoch 3322/5000 80/80 - 32s 404ms/step - loss: 0.0721 - acc: 0.9995 - val_loss: 0.3933 - val_acc: 0.9324 Epoch 3323/5000 80/80 - 32s 400ms/step - loss: 0.0718 - acc: 0.9995 - val_loss: 0.3935 - val_acc: 0.9310 Epoch 3324/5000 80/80 - 32s 400ms/step - loss: 0.0720 - acc: 0.9996 - val_loss: 0.3960 - val_acc: 0.9309 Epoch 3325/5000 80/80 - 32s 400ms/step - loss: 0.0724 - acc: 0.9995 - val_loss: 0.3973 - val_acc: 0.9311 Epoch 3326/5000 80/80 - 32s 400ms/step - loss: 0.0717 - acc: 0.9997 - val_loss: 0.3973 - val_acc: 0.9317 Epoch 3327/5000 80/80 - 32s 400ms/step - loss: 0.0716 - acc: 0.9997 - val_loss: 0.3984 - val_acc: 0.9319 Epoch 3328/5000 80/80 - 32s 400ms/step - loss: 0.0721 - acc: 0.9995 - val_loss: 0.3979 - val_acc: 0.9314 Epoch 3329/5000 80/80 - 32s 400ms/step - loss: 0.0720 - acc: 0.9994 - val_loss: 0.3998 - val_acc: 0.9309 Epoch 3330/5000 80/80 - 32s 400ms/step - loss: 0.0718 - acc: 0.9996 - val_loss: 0.4017 - val_acc: 0.9300 Epoch 3331/5000 80/80 - 32s 400ms/step - loss: 0.0716 - acc: 0.9997 - val_loss: 0.4031 - val_acc: 0.9299 Epoch 3332/5000 80/80 - 32s 401ms/step - loss: 0.0718 - acc: 0.9995 - val_loss: 0.4006 - val_acc: 0.9295 Epoch 3333/5000 80/80 - 32s 400ms/step - loss: 0.0720 - acc: 0.9995 - val_loss: 0.4019 - val_acc: 0.9303 Epoch 3334/5000 80/80 - 32s 400ms/step - loss: 0.0716 - acc: 0.9996 - val_loss: 0.4017 - val_acc: 0.9308 Epoch 3335/5000 80/80 - 32s 400ms/step - loss: 0.0715 - acc: 0.9997 - val_loss: 0.3991 - val_acc: 0.9310 Epoch 3336/5000 80/80 - 32s 399ms/step - loss: 0.0721 - acc: 0.9995 - val_loss: 0.4007 - val_acc: 0.9307 Epoch 3337/5000 80/80 - 32s 399ms/step - loss: 0.0716 - acc: 0.9996 - val_loss: 0.4004 - val_acc: 0.9311 Epoch 3338/5000 80/80 - 32s 399ms/step - loss: 0.0717 - acc: 0.9995 - val_loss: 0.3993 - val_acc: 0.9310 Epoch 3339/5000 80/80 - 32s 399ms/step - loss: 0.0715 - acc: 0.9996 - val_loss: 0.3989 - val_acc: 0.9305 Epoch 3340/5000 80/80 - 32s 399ms/step - loss: 0.0715 - acc: 0.9996 - val_loss: 0.3979 - val_acc: 0.9307 Epoch 3341/5000 80/80 - 32s 400ms/step - loss: 0.0714 - acc: 0.9997 - val_loss: 0.3973 - val_acc: 0.9313 Epoch 3342/5000 80/80 - 32s 400ms/step - loss: 0.0715 - acc: 0.9996 - val_loss: 0.3977 - val_acc: 0.9315 Epoch 3343/5000 80/80 - 32s 400ms/step - loss: 0.0714 - acc: 0.9996 - val_loss: 0.3977 - val_acc: 0.9317 Epoch 3344/5000 80/80 - 32s 399ms/step - loss: 0.0715 - acc: 0.9995 - val_loss: 0.3964 - val_acc: 0.9330 Epoch 3345/5000 80/80 - 32s 400ms/step - loss: 0.0717 - acc: 0.9994 - val_loss: 0.3961 - val_acc: 0.9336 Epoch 3346/5000 80/80 - 32s 399ms/step - loss: 0.0717 - acc: 0.9995 - val_loss: 0.3935 - val_acc: 0.9329 Epoch 3347/5000 80/80 - 32s 399ms/step - loss: 0.0717 - acc: 0.9994 - val_loss: 0.3935 - val_acc: 0.9338 Epoch 3348/5000 80/80 - 32s 400ms/step - loss: 0.0714 - acc: 0.9997 - val_loss: 0.3965 - val_acc: 0.9318 Epoch 3349/5000 80/80 - 32s 399ms/step - loss: 0.0714 - acc: 0.9995 - val_loss: 0.3977 - val_acc: 0.9326 Epoch 3350/5000 80/80 - 32s 399ms/step - loss: 0.0711 - acc: 0.9997 - val_loss: 0.3976 - val_acc: 0.9320 Epoch 3351/5000 80/80 - 32s 399ms/step - loss: 0.0714 - acc: 0.9994 - val_loss: 0.3966 - val_acc: 0.9317 Epoch 3352/5000 80/80 - 32s 399ms/step - loss: 0.0713 - acc: 0.9997 - val_loss: 0.3937 - val_acc: 0.9322 Epoch 3353/5000 80/80 - 32s 399ms/step - loss: 0.0712 - acc: 0.9996 - val_loss: 0.3957 - val_acc: 0.9322 Epoch 3354/5000 80/80 - 32s 399ms/step - loss: 0.0714 - acc: 0.9995 - val_loss: 0.3993 - val_acc: 0.9319 Epoch 3355/5000 80/80 - 32s 399ms/step - loss: 0.0713 - acc: 0.9996 - val_loss: 0.4001 - val_acc: 0.9321 Epoch 3356/5000 80/80 - 32s 399ms/step - loss: 0.0714 - acc: 0.9995 - val_loss: 0.3990 - val_acc: 0.9324 Epoch 3357/5000 80/80 - 32s 399ms/step - loss: 0.0716 - acc: 0.9994 - val_loss: 0.3999 - val_acc: 0.9316 Epoch 3358/5000 80/80 - 32s 400ms/step - loss: 0.0712 - acc: 0.9995 - val_loss: 0.3994 - val_acc: 0.9319 Epoch 3359/5000 80/80 - 32s 399ms/step - loss: 0.0713 - acc: 0.9996 - val_loss: 0.3970 - val_acc: 0.9313 Epoch 3360/5000 80/80 - 32s 399ms/step - loss: 0.0711 - acc: 0.9996 - val_loss: 0.3946 - val_acc: 0.9326 Epoch 3361/5000 80/80 - 32s 399ms/step - loss: 0.0713 - acc: 0.9996 - val_loss: 0.3972 - val_acc: 0.9316 Epoch 3362/5000 80/80 - 32s 400ms/step - loss: 0.0712 - acc: 0.9996 - val_loss: 0.3973 - val_acc: 0.9317 Epoch 3363/5000 80/80 - 32s 400ms/step - loss: 0.0713 - acc: 0.9995 - val_loss: 0.3974 - val_acc: 0.9316 Epoch 3364/5000 80/80 - 32s 399ms/step - loss: 0.0710 - acc: 0.9996 - val_loss: 0.3992 - val_acc: 0.9312 Epoch 3365/5000 80/80 - 32s 400ms/step - loss: 0.0710 - acc: 0.9997 - val_loss: 0.3969 - val_acc: 0.9318 Epoch 3366/5000 80/80 - 32s 399ms/step - loss: 0.0713 - acc: 0.9994 - val_loss: 0.3955 - val_acc: 0.9334 Epoch 3367/5000 80/80 - 32s 399ms/step - loss: 0.0714 - acc: 0.9994 - val_loss: 0.3944 - val_acc: 0.9318 Epoch 3368/5000 80/80 - 32s 400ms/step - loss: 0.0713 - acc: 0.9995 - val_loss: 0.3958 - val_acc: 0.9317 Epoch 3369/5000 80/80 - 32s 399ms/step - loss: 0.0711 - acc: 0.9995 - val_loss: 0.3950 - val_acc: 0.9314 Epoch 3370/5000 80/80 - 32s 399ms/step - loss: 0.0712 - acc: 0.9995 - val_loss: 0.3958 - val_acc: 0.9312 Epoch 3371/5000 80/80 - 32s 400ms/step - loss: 0.0712 - acc: 0.9996 - val_loss: 0.3949 - val_acc: 0.9326 Epoch 3372/5000 80/80 - 32s 399ms/step - loss: 0.0711 - acc: 0.9996 - val_loss: 0.3947 - val_acc: 0.9325 Epoch 3373/5000 80/80 - 32s 399ms/step - loss: 0.0709 - acc: 0.9995 - val_loss: 0.3943 - val_acc: 0.9330 Epoch 3374/5000 80/80 - 32s 399ms/step - loss: 0.0711 - acc: 0.9995 - val_loss: 0.3951 - val_acc: 0.9322 Epoch 3375/5000 80/80 - 32s 400ms/step - loss: 0.0705 - acc: 0.9997 - val_loss: 0.3962 - val_acc: 0.9320 Epoch 3376/5000 80/80 - 32s 399ms/step - loss: 0.0707 - acc: 0.9997 - val_loss: 0.3958 - val_acc: 0.9322 Epoch 3377/5000 80/80 - 32s 400ms/step - loss: 0.0707 - acc: 0.9997 - val_loss: 0.3977 - val_acc: 0.9318 Epoch 3378/5000 80/80 - 32s 400ms/step - loss: 0.0708 - acc: 0.9996 - val_loss: 0.3971 - val_acc: 0.9327 Epoch 3379/5000 80/80 - 32s 399ms/step - loss: 0.0712 - acc: 0.9995 - val_loss: 0.3959 - val_acc: 0.9330 Epoch 3380/5000 80/80 - 32s 399ms/step - loss: 0.0709 - acc: 0.9995 - val_loss: 0.3970 - val_acc: 0.9322 Epoch 3381/5000 80/80 - 32s 400ms/step - loss: 0.0708 - acc: 0.9995 - val_loss: 0.3948 - val_acc: 0.9316 Epoch 3382/5000 80/80 - 32s 400ms/step - loss: 0.0707 - acc: 0.9996 - val_loss: 0.3929 - val_acc: 0.9317 Epoch 3383/5000 80/80 - 32s 400ms/step - loss: 0.0709 - acc: 0.9995 - val_loss: 0.3954 - val_acc: 0.9327 Epoch 3384/5000 80/80 - 32s 400ms/step - loss: 0.0705 - acc: 0.9996 - val_loss: 0.3946 - val_acc: 0.9327 Epoch 3385/5000 80/80 - 32s 399ms/step - loss: 0.0707 - acc: 0.9996 - val_loss: 0.3942 - val_acc: 0.9329 Epoch 3386/5000 80/80 - 32s 400ms/step - loss: 0.0707 - acc: 0.9996 - val_loss: 0.3927 - val_acc: 0.9335 Epoch 3387/5000 80/80 - 32s 400ms/step - loss: 0.0707 - acc: 0.9996 - val_loss: 0.3931 - val_acc: 0.9332 Epoch 3388/5000 80/80 - 32s 399ms/step - loss: 0.0707 - acc: 0.9996 - val_loss: 0.3936 - val_acc: 0.9323 Epoch 3389/5000 80/80 - 32s 399ms/step - loss: 0.0708 - acc: 0.9995 - val_loss: 0.3955 - val_acc: 0.9327 Epoch 3390/5000 80/80 - 32s 399ms/step - loss: 0.0707 - acc: 0.9996 - val_loss: 0.3969 - val_acc: 0.9318 Epoch 3391/5000 80/80 - 32s 400ms/step - loss: 0.0703 - acc: 0.9997 - val_loss: 0.3975 - val_acc: 0.9320 Epoch 3392/5000 80/80 - 32s 399ms/step - loss: 0.0705 - acc: 0.9996 - val_loss: 0.3981 - val_acc: 0.9313 Epoch 3393/5000 80/80 - 32s 400ms/step - loss: 0.0704 - acc: 0.9997 - val_loss: 0.3988 - val_acc: 0.9322 Epoch 3394/5000 80/80 - 32s 399ms/step - loss: 0.0705 - acc: 0.9996 - val_loss: 0.3967 - val_acc: 0.9332 Epoch 3395/5000 80/80 - 32s 399ms/step - loss: 0.0703 - acc: 0.9997 - val_loss: 0.3957 - val_acc: 0.9318 Epoch 3396/5000 80/80 - 32s 400ms/step - loss: 0.0710 - acc: 0.9994 - val_loss: 0.3979 - val_acc: 0.9313 Epoch 3397/5000 80/80 - 32s 399ms/step - loss: 0.0703 - acc: 0.9996 - val_loss: 0.3991 - val_acc: 0.9310 Epoch 3398/5000 80/80 - 32s 399ms/step - loss: 0.0703 - acc: 0.9997 - val_loss: 0.3992 - val_acc: 0.9310 Epoch 3399/5000 80/80 - 32s 399ms/step - loss: 0.0704 - acc: 0.9995 - val_loss: 0.3959 - val_acc: 0.9312 Epoch 3400/5000 80/80 - 32s 400ms/step - loss: 0.0706 - acc: 0.9995 - val_loss: 0.3943 - val_acc: 0.9325 Epoch 3401/5000 80/80 - 32s 400ms/step - loss: 0.0709 - acc: 0.9995 - val_loss: 0.3966 - val_acc: 0.9338 Epoch 3402/5000 80/80 - 32s 400ms/step - loss: 0.0703 - acc: 0.9996 - val_loss: 0.3976 - val_acc: 0.9328 Epoch 3403/5000 80/80 - 32s 400ms/step - loss: 0.0702 - acc: 0.9996 - val_loss: 0.3981 - val_acc: 0.9328 Epoch 3404/5000 80/80 - 32s 400ms/step - loss: 0.0706 - acc: 0.9995 - val_loss: 0.3988 - val_acc: 0.9332 Epoch 3405/5000 80/80 - 32s 399ms/step - loss: 0.0701 - acc: 0.9997 - val_loss: 0.3998 - val_acc: 0.9319 Epoch 3406/5000 80/80 - 32s 399ms/step - loss: 0.0701 - acc: 0.9997 - val_loss: 0.4000 - val_acc: 0.9323 Epoch 3407/5000 80/80 - 32s 400ms/step - loss: 0.0704 - acc: 0.9996 - val_loss: 0.3969 - val_acc: 0.9326 Epoch 3408/5000 80/80 - 32s 400ms/step - loss: 0.0703 - acc: 0.9996 - val_loss: 0.3961 - val_acc: 0.9323 Epoch 3409/5000 80/80 - 32s 400ms/step - loss: 0.0704 - acc: 0.9995 - val_loss: 0.3964 - val_acc: 0.9321 Epoch 3410/5000 80/80 - 32s 399ms/step - loss: 0.0703 - acc: 0.9995 - val_loss: 0.3988 - val_acc: 0.9320 Epoch 3411/5000 80/80 - 32s 400ms/step - loss: 0.0701 - acc: 0.9997 - val_loss: 0.3980 - val_acc: 0.9319 Epoch 3412/5000 80/80 - 32s 399ms/step - loss: 0.0703 - acc: 0.9997 - val_loss: 0.3987 - val_acc: 0.9322 Epoch 3413/5000 80/80 - 32s 399ms/step - loss: 0.0700 - acc: 0.9996 - val_loss: 0.4009 - val_acc: 0.9313 Epoch 3414/5000 80/80 - 32s 399ms/step - loss: 0.0700 - acc: 0.9996 - val_loss: 0.3986 - val_acc: 0.9319 Epoch 3415/5000 80/80 - 32s 400ms/step - loss: 0.0700 - acc: 0.9996 - val_loss: 0.3973 - val_acc: 0.9322 Epoch 3416/5000 80/80 - 32s 400ms/step - loss: 0.0706 - acc: 0.9993 - val_loss: 0.4007 - val_acc: 0.9311 Epoch 3417/5000 80/80 - 32s 399ms/step - loss: 0.0706 - acc: 0.9994 - val_loss: 0.3994 - val_acc: 0.9317 Epoch 3418/5000 80/80 - 32s 399ms/step - loss: 0.0701 - acc: 0.9996 - val_loss: 0.4001 - val_acc: 0.9314 Epoch 3419/5000 80/80 - 32s 399ms/step - loss: 0.0708 - acc: 0.9993 - val_loss: 0.3999 - val_acc: 0.9317 Epoch 3420/5000 80/80 - 32s 400ms/step - loss: 0.0699 - acc: 0.9997 - val_loss: 0.4001 - val_acc: 0.9316 Epoch 3421/5000 80/80 - 32s 400ms/step - loss: 0.0702 - acc: 0.9995 - val_loss: 0.3982 - val_acc: 0.9325 Epoch 3422/5000 80/80 - 32s 400ms/step - loss: 0.0701 - acc: 0.9995 - val_loss: 0.4003 - val_acc: 0.9318 Epoch 3423/5000 80/80 - 32s 400ms/step - loss: 0.0696 - acc: 0.9998 - val_loss: 0.4021 - val_acc: 0.9305 Epoch 3424/5000 80/80 - 32s 403ms/step - loss: 0.0703 - acc: 0.9994 - val_loss: 0.4006 - val_acc: 0.9317 Epoch 3425/5000 80/80 - 32s 400ms/step - loss: 0.0698 - acc: 0.9997 - val_loss: 0.4007 - val_acc: 0.9308 Epoch 3426/5000 80/80 - 32s 400ms/step - loss: 0.0703 - acc: 0.9995 - val_loss: 0.4008 - val_acc: 0.9299 Epoch 3427/5000 80/80 - 32s 401ms/step - loss: 0.0702 - acc: 0.9995 - val_loss: 0.4019 - val_acc: 0.9294 Epoch 3428/5000 80/80 - 32s 401ms/step - loss: 0.0698 - acc: 0.9996 - val_loss: 0.4024 - val_acc: 0.9302 Epoch 3429/5000 80/80 - 32s 400ms/step - loss: 0.0698 - acc: 0.9997 - val_loss: 0.4017 - val_acc: 0.9299 Epoch 3430/5000 80/80 - 32s 401ms/step - loss: 0.0700 - acc: 0.9994 - val_loss: 0.4009 - val_acc: 0.9306 Epoch 3431/5000 80/80 - 32s 400ms/step - loss: 0.0702 - acc: 0.9995 - val_loss: 0.4020 - val_acc: 0.9302 Epoch 3432/5000 80/80 - 32s 400ms/step - loss: 0.0703 - acc: 0.9994 - val_loss: 0.4034 - val_acc: 0.9303 Epoch 3433/5000 80/80 - 32s 401ms/step - loss: 0.0702 - acc: 0.9994 - val_loss: 0.4021 - val_acc: 0.9306 Epoch 3434/5000 80/80 - 32s 401ms/step - loss: 0.0697 - acc: 0.9997 - val_loss: 0.4023 - val_acc: 0.9302 Epoch 3435/5000 80/80 - 32s 400ms/step - loss: 0.0697 - acc: 0.9997 - val_loss: 0.4026 - val_acc: 0.9296 Epoch 3436/5000 80/80 - 32s 400ms/step - loss: 0.0698 - acc: 0.9996 - val_loss: 0.4043 - val_acc: 0.9298 Epoch 3437/5000 80/80 - 32s 399ms/step - loss: 0.0701 - acc: 0.9995 - val_loss: 0.4036 - val_acc: 0.9303 Epoch 3438/5000 80/80 - 32s 400ms/step - loss: 0.0698 - acc: 0.9996 - val_loss: 0.3998 - val_acc: 0.9309 Epoch 3439/5000 80/80 - 32s 400ms/step - loss: 0.0696 - acc: 0.9997 - val_loss: 0.3988 - val_acc: 0.9309 Epoch 3440/5000 80/80 - 32s 400ms/step - loss: 0.0696 - acc: 0.9996 - val_loss: 0.3968 - val_acc: 0.9311 Epoch 3441/5000 80/80 - 32s 399ms/step - loss: 0.0697 - acc: 0.9996 - val_loss: 0.3941 - val_acc: 0.9320 Epoch 3442/5000 80/80 - 32s 400ms/step - loss: 0.0697 - acc: 0.9995 - val_loss: 0.3948 - val_acc: 0.9320 Epoch 3443/5000 80/80 - 32s 400ms/step - loss: 0.0692 - acc: 0.9998 - val_loss: 0.3951 - val_acc: 0.9316 Epoch 3444/5000 80/80 - 32s 400ms/step - loss: 0.0696 - acc: 0.9996 - val_loss: 0.3981 - val_acc: 0.9318 Epoch 3445/5000 80/80 - 32s 400ms/step - loss: 0.0694 - acc: 0.9997 - val_loss: 0.3987 - val_acc: 0.9318 Epoch 3446/5000 80/80 - 32s 403ms/step - loss: 0.0696 - acc: 0.9995 - val_loss: 0.3972 - val_acc: 0.9326 Epoch 3447/5000 80/80 - 32s 400ms/step - loss: 0.0701 - acc: 0.9995 - val_loss: 0.3980 - val_acc: 0.9312 Epoch 3448/5000 80/80 - 32s 399ms/step - loss: 0.0694 - acc: 0.9996 - val_loss: 0.3962 - val_acc: 0.9320 Epoch 3449/5000 80/80 - 32s 399ms/step - loss: 0.0695 - acc: 0.9996 - val_loss: 0.3975 - val_acc: 0.9312 Epoch 3450/5000 80/80 - 32s 399ms/step - loss: 0.0694 - acc: 0.9996 - val_loss: 0.3970 - val_acc: 0.9312 Epoch 3451/5000 80/80 - 32s 399ms/step - loss: 0.0691 - acc: 0.9997 - val_loss: 0.3978 - val_acc: 0.9321 Epoch 3452/5000 80/80 - 32s 399ms/step - loss: 0.0696 - acc: 0.9995 - val_loss: 0.3989 - val_acc: 0.9312 Epoch 3453/5000 80/80 - 32s 399ms/step - loss: 0.0694 - acc: 0.9996 - val_loss: 0.3965 - val_acc: 0.9318 Epoch 3454/5000 80/80 - 32s 399ms/step - loss: 0.0695 - acc: 0.9996 - val_loss: 0.3975 - val_acc: 0.9325 Epoch 3455/5000 80/80 - 32s 399ms/step - loss: 0.0695 - acc: 0.9996 - val_loss: 0.3956 - val_acc: 0.9324 Epoch 3456/5000 80/80 - 32s 399ms/step - loss: 0.0694 - acc: 0.9995 - val_loss: 0.3971 - val_acc: 0.9317 Epoch 3457/5000 80/80 - 32s 399ms/step - loss: 0.0691 - acc: 0.9997 - val_loss: 0.4000 - val_acc: 0.9310 Epoch 3458/5000 80/80 - 32s 399ms/step - loss: 0.0692 - acc: 0.9997 - val_loss: 0.4000 - val_acc: 0.9306 Epoch 3459/5000 80/80 - 32s 400ms/step - loss: 0.0692 - acc: 0.9996 - val_loss: 0.3998 - val_acc: 0.9308 Epoch 3460/5000 80/80 - 32s 399ms/step - loss: 0.0697 - acc: 0.9995 - val_loss: 0.4010 - val_acc: 0.9305 Epoch 3461/5000 80/80 - 32s 399ms/step - loss: 0.0695 - acc: 0.9996 - val_loss: 0.4010 - val_acc: 0.9315 Epoch 3462/5000 80/80 - 32s 399ms/step - loss: 0.0690 - acc: 0.9997 - val_loss: 0.4004 - val_acc: 0.9311 Epoch 3463/5000 80/80 - 32s 400ms/step - loss: 0.0698 - acc: 0.9995 - val_loss: 0.4018 - val_acc: 0.9298 Epoch 3464/5000 80/80 - 32s 399ms/step - loss: 0.0692 - acc: 0.9997 - val_loss: 0.4016 - val_acc: 0.9311 Epoch 3465/5000 80/80 - 32s 400ms/step - loss: 0.0689 - acc: 0.9996 - val_loss: 0.4037 - val_acc: 0.9309 Epoch 3466/5000 80/80 - 32s 400ms/step - loss: 0.0694 - acc: 0.9995 - val_loss: 0.4020 - val_acc: 0.9313 Epoch 3467/5000 80/80 - 32s 400ms/step - loss: 0.0691 - acc: 0.9996 - val_loss: 0.4016 - val_acc: 0.9314 Epoch 3468/5000 80/80 - 32s 400ms/step - loss: 0.0692 - acc: 0.9996 - val_loss: 0.4034 - val_acc: 0.9307 Epoch 3469/5000 80/80 - 32s 400ms/step - loss: 0.0693 - acc: 0.9996 - val_loss: 0.4013 - val_acc: 0.9309 Epoch 3470/5000 80/80 - 32s 399ms/step - loss: 0.0695 - acc: 0.9994 - val_loss: 0.3997 - val_acc: 0.9326 Epoch 3471/5000 80/80 - 32s 399ms/step - loss: 0.0693 - acc: 0.9996 - val_loss: 0.3991 - val_acc: 0.9320 Epoch 3472/5000 80/80 - 32s 399ms/step - loss: 0.0690 - acc: 0.9997 - val_loss: 0.3995 - val_acc: 0.9321 Epoch 3473/5000 80/80 - 32s 400ms/step - loss: 0.0694 - acc: 0.9995 - val_loss: 0.3990 - val_acc: 0.9310 Epoch 3474/5000 80/80 - 32s 399ms/step - loss: 0.0695 - acc: 0.9995 - val_loss: 0.3964 - val_acc: 0.9320 Epoch 3475/5000 80/80 - 32s 399ms/step - loss: 0.0692 - acc: 0.9996 - val_loss: 0.3959 - val_acc: 0.9320 Epoch 3476/5000 80/80 - 32s 400ms/step - loss: 0.0692 - acc: 0.9995 - val_loss: 0.3968 - val_acc: 0.9316 Epoch 3477/5000 80/80 - 32s 399ms/step - loss: 0.0690 - acc: 0.9996 - val_loss: 0.3976 - val_acc: 0.9307 Epoch 3478/5000 80/80 - 32s 399ms/step - loss: 0.0689 - acc: 0.9996 - val_loss: 0.3990 - val_acc: 0.9314 Epoch 3479/5000 80/80 - 32s 401ms/step - loss: 0.0692 - acc: 0.9995 - val_loss: 0.3991 - val_acc: 0.9303 Epoch 3480/5000 80/80 - 32s 401ms/step - loss: 0.0690 - acc: 0.9994 - val_loss: 0.4010 - val_acc: 0.9303 Epoch 3481/5000 80/80 - 32s 403ms/step - loss: 0.0689 - acc: 0.9995 - val_loss: 0.4028 - val_acc: 0.9305 Epoch 3482/5000 80/80 - 32s 401ms/step - loss: 0.0689 - acc: 0.9996 - val_loss: 0.4030 - val_acc: 0.9295 Epoch 3483/5000 80/80 - 32s 400ms/step - loss: 0.0694 - acc: 0.9995 - val_loss: 0.4027 - val_acc: 0.9311 Epoch 3484/5000 80/80 - 32s 399ms/step - loss: 0.0690 - acc: 0.9996 - val_loss: 0.4002 - val_acc: 0.9316 Epoch 3485/5000 80/80 - 32s 402ms/step - loss: 0.0684 - acc: 0.9999 - val_loss: 0.3992 - val_acc: 0.9321 Epoch 3486/5000 80/80 - 32s 406ms/step - loss: 0.0690 - acc: 0.9997 - val_loss: 0.3999 - val_acc: 0.9318 Epoch 3487/5000 80/80 - 32s 399ms/step - loss: 0.0686 - acc: 0.9997 - val_loss: 0.4016 - val_acc: 0.9309 Epoch 3488/5000 80/80 - 32s 399ms/step - loss: 0.0690 - acc: 0.9996 - val_loss: 0.4020 - val_acc: 0.9308 Epoch 3489/5000 80/80 - 32s 399ms/step - loss: 0.0688 - acc: 0.9996 - val_loss: 0.4028 - val_acc: 0.9317 Epoch 3490/5000 80/80 - 32s 399ms/step - loss: 0.0688 - acc: 0.9996 - val_loss: 0.4028 - val_acc: 0.9315 Epoch 3491/5000 80/80 - 32s 399ms/step - loss: 0.0691 - acc: 0.9995 - val_loss: 0.4039 - val_acc: 0.9304 Epoch 3492/5000 80/80 - 32s 400ms/step - loss: 0.0691 - acc: 0.9995 - val_loss: 0.4039 - val_acc: 0.9293 Epoch 3493/5000 80/80 - 32s 399ms/step - loss: 0.0690 - acc: 0.9996 - val_loss: 0.4023 - val_acc: 0.9307 Epoch 3494/5000 80/80 - 32s 400ms/step - loss: 0.0685 - acc: 0.9997 - val_loss: 0.4025 - val_acc: 0.9304 Epoch 3495/5000 80/80 - 32s 401ms/step - loss: 0.0689 - acc: 0.9995 - val_loss: 0.4058 - val_acc: 0.9295 Epoch 3496/5000 80/80 - 32s 402ms/step - loss: 0.0684 - acc: 0.9997 - val_loss: 0.4029 - val_acc: 0.9308 Epoch 3497/5000 80/80 - 32s 400ms/step - loss: 0.0684 - acc: 0.9997 - val_loss: 0.4028 - val_acc: 0.9298 Epoch 3498/5000 80/80 - 32s 401ms/step - loss: 0.0687 - acc: 0.9996 - val_loss: 0.3992 - val_acc: 0.9319 Epoch 3499/5000 80/80 - 32s 401ms/step - loss: 0.0685 - acc: 0.9997 - val_loss: 0.3977 - val_acc: 0.9312 Epoch 3500/5000 80/80 - 32s 400ms/step - loss: 0.0685 - acc: 0.9995 - val_loss: 0.3981 - val_acc: 0.9313 Epoch 3501/5000 80/80 - 32s 400ms/step - loss: 0.0688 - acc: 0.9995 - val_loss: 0.4005 - val_acc: 0.9320 Epoch 3502/5000 80/80 - 32s 400ms/step - loss: 0.0682 - acc: 0.9998 - val_loss: 0.3992 - val_acc: 0.9312 Epoch 3503/5000 80/80 - 32s 400ms/step - loss: 0.0684 - acc: 0.9996 - val_loss: 0.3993 - val_acc: 0.9306 Epoch 3504/5000 80/80 - 32s 400ms/step - loss: 0.0687 - acc: 0.9995 - val_loss: 0.4003 - val_acc: 0.9306 Epoch 3505/5000 80/80 - 32s 401ms/step - loss: 0.0685 - acc: 0.9997 - val_loss: 0.4017 - val_acc: 0.9301 Epoch 3506/5000 80/80 - 32s 401ms/step - loss: 0.0682 - acc: 0.9997 - val_loss: 0.4053 - val_acc: 0.9299 Epoch 3507/5000 80/80 - 32s 401ms/step - loss: 0.0682 - acc: 0.9997 - val_loss: 0.4047 - val_acc: 0.9301 Epoch 3508/5000 80/80 - 32s 400ms/step - loss: 0.0689 - acc: 0.9994 - val_loss: 0.4059 - val_acc: 0.9289 Epoch 3509/5000 80/80 - 32s 402ms/step - loss: 0.0687 - acc: 0.9995 - val_loss: 0.4074 - val_acc: 0.9289 Epoch 3510/5000 80/80 - 32s 402ms/step - loss: 0.0686 - acc: 0.9995 - val_loss: 0.4042 - val_acc: 0.9301 Epoch 3511/5000 80/80 - 32s 400ms/step - loss: 0.0685 - acc: 0.9995 - val_loss: 0.4029 - val_acc: 0.9308 Epoch 3512/5000 80/80 - 32s 401ms/step - loss: 0.0687 - acc: 0.9996 - val_loss: 0.4020 - val_acc: 0.9301 Epoch 3513/5000 80/80 - 32s 398ms/step - loss: 0.0682 - acc: 0.9997 - val_loss: 0.3987 - val_acc: 0.9305 Epoch 3514/5000 80/80 - 32s 400ms/step - loss: 0.0683 - acc: 0.9996 - val_loss: 0.3991 - val_acc: 0.9302 Epoch 3515/5000 80/80 - 32s 399ms/step - loss: 0.0688 - acc: 0.9996 - val_loss: 0.3989 - val_acc: 0.9307 Epoch 3516/5000 80/80 - 32s 398ms/step - loss: 0.0687 - acc: 0.9995 - val_loss: 0.4004 - val_acc: 0.9313 Epoch 3517/5000 80/80 - 32s 400ms/step - loss: 0.0681 - acc: 0.9996 - val_loss: 0.3996 - val_acc: 0.9313 Epoch 3518/5000 80/80 - 32s 399ms/step - loss: 0.0683 - acc: 0.9997 - val_loss: 0.4004 - val_acc: 0.9308 Epoch 3519/5000 80/80 - 32s 399ms/step - loss: 0.0686 - acc: 0.9995 - val_loss: 0.4002 - val_acc: 0.9306 Epoch 3520/5000 80/80 - 32s 400ms/step - loss: 0.0687 - acc: 0.9995 - val_loss: 0.4007 - val_acc: 0.9310 Epoch 3521/5000 80/80 - 32s 400ms/step - loss: 0.0684 - acc: 0.9996 - val_loss: 0.4021 - val_acc: 0.9318 Epoch 3522/5000 80/80 - 32s 399ms/step - loss: 0.0683 - acc: 0.9996 - val_loss: 0.4033 - val_acc: 0.9320 Epoch 3523/5000 80/80 - 32s 400ms/step - loss: 0.0681 - acc: 0.9997 - val_loss: 0.4064 - val_acc: 0.9316 Epoch 3524/5000 80/80 - 34s 424ms/step - loss: 0.0681 - acc: 0.9996 - val_loss: 0.4061 - val_acc: 0.9309 Epoch 3525/5000 80/80 - 32s 398ms/step - loss: 0.0680 - acc: 0.9997 - val_loss: 0.4032 - val_acc: 0.9310 Epoch 3526/5000 80/80 - 32s 397ms/step - loss: 0.0681 - acc: 0.9995 - val_loss: 0.4033 - val_acc: 0.9317 Epoch 3527/5000 80/80 - 32s 398ms/step - loss: 0.0681 - acc: 0.9995 - val_loss: 0.4034 - val_acc: 0.9317 Epoch 3528/5000 80/80 - 32s 398ms/step - loss: 0.0681 - acc: 0.9996 - val_loss: 0.4021 - val_acc: 0.9317 Epoch 3529/5000 80/80 - 32s 398ms/step - loss: 0.0682 - acc: 0.9996 - val_loss: 0.4032 - val_acc: 0.9317 Epoch 3530/5000 80/80 - 32s 398ms/step - loss: 0.0678 - acc: 0.9997 - val_loss: 0.4026 - val_acc: 0.9316 Epoch 3531/5000 80/80 - 32s 398ms/step - loss: 0.0679 - acc: 0.9996 - val_loss: 0.4000 - val_acc: 0.9312 Epoch 3532/5000 80/80 - 32s 398ms/step - loss: 0.0682 - acc: 0.9995 - val_loss: 0.4004 - val_acc: 0.9325 Epoch 3533/5000 80/80 - 32s 398ms/step - loss: 0.0683 - acc: 0.9996 - val_loss: 0.4012 - val_acc: 0.9320 Epoch 3534/5000 80/80 - 32s 398ms/step - loss: 0.0681 - acc: 0.9996 - val_loss: 0.4006 - val_acc: 0.9320 Epoch 3535/5000 80/80 - 32s 398ms/step - loss: 0.0678 - acc: 0.9996 - val_loss: 0.4026 - val_acc: 0.9308 Epoch 3536/5000 80/80 - 32s 398ms/step - loss: 0.0675 - acc: 0.9997 - val_loss: 0.4037 - val_acc: 0.9306 Epoch 3537/5000 80/80 - 32s 398ms/step - loss: 0.0683 - acc: 0.9995 - val_loss: 0.4056 - val_acc: 0.9296 Epoch 3538/5000 80/80 - 32s 398ms/step - loss: 0.0684 - acc: 0.9995 - val_loss: 0.4053 - val_acc: 0.9313 Epoch 3539/5000 80/80 - 32s 400ms/step - loss: 0.0682 - acc: 0.9995 - val_loss: 0.4037 - val_acc: 0.9305 Epoch 3540/5000 15/80 [====>.........................] - ETA: 24s - loss: 0.0678 - acc: 0.9997Traceback (most recent call last):
沒跑完就把程式給中斷了。訓練準確率已經接近100%，測試準確率一直在93%波動，似乎已經進入過擬合階段了，再繼續訓練也沒什麼用處。
怎麼抑制過擬合呢？資料增強部分已經用了很多種方式了，下一步減小網路規模？
Minghang Zhao, Shisheng Zhong, Xuyun Fu, Baoping Tang, Shaojiang Dong, Michael Pecht, Deep Residual Networks with Adaptively Parametric Rectifier Linear Units for Fault Diagnosis, IEEE Transactions on Industrial Electronics, 2020, DOI: 10.1109/TIE.2020.2972458
https://ieeexplore.ieee.org/document/8998530
————————————————
版權宣告：本文為CSDN博主「dangqing1988」的原創文章，遵循CC 4.0 BY-SA版權協議，轉載請附上原文出處連結及本宣告。
原文連結：https://blog.csdn.net/dangqing1988/article/details/105823443
來自 “ ITPUB部落格 ” ，連結：http://blog.itpub.net/69972329/viewspace-2689904/，如需轉載，請註明出處，否則將追究法律責任。
相關文章
- 深度殘差網路+自適應引數化ReLU啟用函式（調參記錄10）函式
- 深度殘差網路+自適應引數化ReLU啟用函式（調參記錄11）函式
- 深度殘差網路+自適應引數化ReLU啟用函式（調參記錄13）函式
- 深度殘差網路+自適應引數化ReLU啟用函式（調參記錄14）函式
- 深度殘差網路+自適應引數化ReLU啟用函式（調參記錄15）函式
- 深度殘差網路+自適應引數化ReLU啟用函式（調參記錄16）函式
- 深度殘差網路+自適應引數化ReLU啟用函式（調參記錄17）函式
- 深度殘差網路+自適應引數化ReLU啟用函式（調參記錄1）函式
- 深度殘差網路+自適應引數化ReLU啟用函式（調參記錄2）函式
- 深度殘差網路+自適應引數化ReLU啟用函式（調參記錄3）函式
- 深度殘差網路+自適應引數化ReLU啟用函式（調參記錄4）函式
- 深度殘差網路+自適應引數化ReLU啟用函式（調參記錄5）函式
- 深度殘差網路+自適應引數化ReLU啟用函式（調參記錄6）函式
- 深度殘差網路+自適應引數化ReLU啟用函式（調參記錄7）函式
- 深度殘差網路+自適應引數化ReLU啟用函式（調參記錄8）函式
- 深度殘差網路+自適應引數化ReLU啟用函式（調參記錄9）函式
- 深度殘差網路+自適應引數化ReLU啟用函式（調參記錄18）Cifar10~94.28%函式
- 深度殘差網路+自適應引數化ReLU啟用函式（調參記錄19）Cifar10~93.96%函式
- 深度殘差網路+自適應引數化ReLU啟用函式（調參記錄26）Cifar10~95.92%函式
- 深度殘差網路+自適應引數化ReLU啟用函式（調參記錄20）Cifar10~94.17%函式
- 深度殘差網路+自適應引數化ReLU啟用函式（調參記錄21）Cifar10~95.12%函式
- 深度殘差網路+自適應引數化ReLU啟用函式（調參記錄22）Cifar10~95.25%函式
- 深度殘差網路+自適應引數化ReLU啟用函式（調參記錄23）Cifar10~95.47%函式
- 深度殘差網路+自適應引數化ReLU啟用函式（調參記錄24）Cifar10~95.80%函式
- 注意力機制下的啟用函式：自適應引數化ReLU函式
- 深度殘差網路(ResNet)
- 深度學習之殘差網路深度學習
- 殘差網路再升級之深度殘差收縮網路（附Keras程式碼）Keras
- 深度殘差收縮網路：（三）網路結構
- 深度學習故障診斷——深度殘差收縮網路深度學習
- 深度殘差收縮網路：（一）背景知識
- 深度殘差收縮網路：（二）整體思路
- 學習筆記16：殘差網路筆記
- 從ReLU到GELU，一文概覽神經網路的啟用函式神經網路函式
- 十分鐘弄懂深度殘差收縮網路
- 深度殘差收縮網路：（五）實驗驗證
- 深度殘差收縮網路：（六）程式碼實現
- 殘差網路（Residual Networks, ResNets）