2018-11-27 12:04:59,118 : WARN : Thread-21 : PythonKernel : : : Using TensorFlow backend. 2018-11-27 12:05:01,661 : WARN : Thread-21 : PythonKernel : : : 2018-11-27 12:05:01.660414: I tensorflow/core/platform/cpu_feature_guard.cc:140] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX AVX2 2018-11-27 12:05:01,806 : DEBUG : KNIME-Worker-4 : Buffer : Keras Network Learner : 4:73 : Opening input stream on file "C:\Users\spg_kibe\AppData\Local\Temp\knime_KerasTest33577\knime_container_20181127_3512333019950853239.tmp", 0 open streams 2018-11-27 12:05:01,809 : WARN : KNIME-Worker-4 : DLKnimeNetworkTrainingInputPreparer : Keras Network Learner : 4:73 : The number of rows of the input training data table (5452) is not a multiple of the selected training batch size (10). Thus, the last batch of each epoch will continue at the beginning of the training data table after reaching its end. You can avoid that by adjusting the number of rows of the table or the batch size if desired. 2018-11-27 12:05:01,811 : DEBUG : KNIME-Worker-4 : PythonKernel : Keras Network Learner : 4:73 : Using serialization library: Flatbuffers Column Serialization. 2018-11-27 12:05:01,813 : DEBUG : Thread-20 : PythonKernel : : : Traceback (most recent call last): 2018-11-27 12:05:01,814 : DEBUG : Thread-20 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\PythonKernelLauncher.py", line 120, in 2018-11-27 12:05:01,814 : DEBUG : Thread-20 : PythonKernel : : : kernel.start() 2018-11-27 12:05:01,814 : DEBUG : Thread-20 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\python3\PythonKernel.py", line 93, in start 2018-11-27 12:05:01,814 : DEBUG : Thread-20 : PythonKernel : : : self._monitor.wait_for_close() 2018-11-27 12:05:01,814 : DEBUG : Thread-20 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\python3\PythonKernel.py", line 172, in wait_for_close 2018-11-27 12:05:01,814 : DEBUG : Thread-20 : PythonKernel : : : self.check_exception() 2018-11-27 12:05:01,814 : DEBUG : Thread-20 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\python3\PythonKernel.py", line 168, in check_exception 2018-11-27 12:05:01,814 : DEBUG : Thread-20 : PythonKernel : : : raise self._exception 2018-11-27 12:05:01,814 : DEBUG : Thread-20 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\concurrent\futures\thread.py", line 56, in run 2018-11-27 12:05:01,814 : DEBUG : Thread-20 : PythonKernel : : : result = self.fn(*self.args, **self.kwargs) 2018-11-27 12:05:01,814 : DEBUG : Thread-20 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\python3\messaging\AbstractMessageLoop.py", line 126, in _do_loop 2018-11-27 12:05:01,814 : DEBUG : Thread-20 : PythonKernel : : : raise ex 2018-11-27 12:05:01,814 : DEBUG : Thread-20 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\python3\messaging\AbstractMessageLoop.py", line 123, in _do_loop 2018-11-27 12:05:01,814 : DEBUG : Thread-20 : PythonKernel : : : self._loop() 2018-11-27 12:05:01,814 : DEBUG : Thread-20 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\python3\messaging\MessageReceiverLoop.py", line 70, in _loop 2018-11-27 12:05:01,814 : DEBUG : Thread-20 : PythonKernel : : : message = self._receiver.receive() 2018-11-27 12:05:01,814 : DEBUG : Thread-20 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\messaging\MessageReceiver.py", line 62, in receive 2018-11-27 12:05:01,814 : DEBUG : Thread-20 : PythonKernel : : : header_size = self._read_size() 2018-11-27 12:05:01,814 : DEBUG : Thread-20 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\messaging\MessageReceiver.py", line 77, in _read_size 2018-11-27 12:05:01,814 : DEBUG : Thread-20 : PythonKernel : : : data.extend(self._connection.recv(4 - len(data))) 2018-11-27 12:05:01,814 : DEBUG : Thread-20 : PythonKernel : : : OSError: [WinError 10038] An operation was attempted on something that is not a socket 2018-11-27 12:05:01,814 : DEBUG : Thread-21 : PythonKernel : : : Traceback (most recent call last): 2018-11-27 12:05:01,814 : DEBUG : Thread-21 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\PythonKernelLauncher.py", line 124, in 2018-11-27 12:05:01,814 : DEBUG : Thread-21 : PythonKernel : : : raise ex 2018-11-27 12:05:01,814 : DEBUG : Thread-21 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\PythonKernelLauncher.py", line 120, in 2018-11-27 12:05:01,815 : DEBUG : Thread-21 : PythonKernel : : : kernel.start() 2018-11-27 12:05:01,815 : DEBUG : Thread-21 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\python3\PythonKernel.py", line 93, in start 2018-11-27 12:05:01,815 : DEBUG : Thread-21 : PythonKernel : : : self._monitor.wait_for_close() 2018-11-27 12:05:01,815 : DEBUG : Thread-21 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\python3\PythonKernel.py", line 172, in wait_for_close 2018-11-27 12:05:01,815 : DEBUG : Thread-21 : PythonKernel : : : self.check_exception() 2018-11-27 12:05:01,815 : DEBUG : Thread-21 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\python3\PythonKernel.py", line 168, in check_exception 2018-11-27 12:05:01,816 : DEBUG : Thread-21 : PythonKernel : : : raise self._exception 2018-11-27 12:05:01,816 : DEBUG : Thread-21 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\concurrent\futures\thread.py", line 56, in run 2018-11-27 12:05:01,816 : DEBUG : Thread-21 : PythonKernel : : : result = self.fn(*self.args, **self.kwargs) 2018-11-27 12:05:01,816 : DEBUG : Thread-21 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\python3\messaging\AbstractMessageLoop.py", line 126, in _do_loop 2018-11-27 12:05:01,816 : DEBUG : Thread-21 : PythonKernel : : : raise ex 2018-11-27 12:05:01,817 : DEBUG : Thread-21 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\python3\messaging\AbstractMessageLoop.py", line 123, in _do_loop 2018-11-27 12:05:01,817 : DEBUG : Thread-21 : PythonKernel : : : self._loop() 2018-11-27 12:05:01,817 : DEBUG : Thread-21 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\python3\messaging\MessageReceiverLoop.py", line 70, in _loop 2018-11-27 12:05:01,817 : DEBUG : Thread-21 : PythonKernel : : : message = self._receiver.receive() 2018-11-27 12:05:01,817 : DEBUG : Thread-21 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\messaging\MessageReceiver.py", line 62, in receive 2018-11-27 12:05:01,818 : DEBUG : Thread-21 : PythonKernel : : : header_size = self._read_size() 2018-11-27 12:05:01,818 : DEBUG : Thread-21 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\messaging\MessageReceiver.py", line 77, in _read_size 2018-11-27 12:05:01,818 : DEBUG : Thread-21 : PythonKernel : : : data.extend(self._connection.recv(4 - len(data))) 2018-11-27 12:05:01,818 : DEBUG : Thread-21 : PythonKernel : : : OSError: [WinError 10038] An operation was attempted on something that is not a socket 2018-11-27 12:05:03,396 : DEBUG : KNIME-Worker-4 : PythonKernel : Keras Network Learner : 4:73 : Python PID: 1396 2018-11-27 12:05:03,543 : WARN : Thread-24 : PythonKernel : : : Using TensorFlow backend. 2018-11-27 12:05:03,807 : DEBUG : Thread-22 : PythonMessaging : : : Python messaging system could not be shut down gracefully. Process will be killed. 2018-11-27 12:05:06,026 : WARN : Thread-24 : PythonKernel : : : 2018-11-27 12:05:06.025850: I tensorflow/core/platform/cpu_feature_guard.cc:140] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX AVX2 2018-11-27 12:05:06,085 : WARN : Thread-24 : PythonKernel : : : C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\keras\models.py:282: UserWarning: No training configuration found in save file: the model was *not* compiled. Compile it manually. 2018-11-27 12:05:06,085 : WARN : Thread-24 : PythonKernel : : : warnings.warn('No training configuration found in save file: ' 2018-11-27 12:05:07,509 : DEBUG : Thread-23 : PythonKernel : : : Epoch 1/1 2018-11-27 12:05:07,523 : DEBUG : python-message-distribute-loop-0 : ThreadUtils : : : Unnecessary call to runnableWithContext, because no context is available org.knime.core.util.ThreadUtils$UnnecessaryCallException at org.knime.core.util.ThreadUtils.runnableWithContext(ThreadUtils.java:381) at org.knime.core.util.ThreadUtils.runnableWithContext(ThreadUtils.java:357) at org.knime.core.util.ThreadUtils$ExecutorServiceWithContext.submit(ThreadUtils.java:94) at org.knime.python2.kernel.messaging.DefaultTaskFactory$DefaultTask.run(DefaultTaskFactory.java:184) at org.knime.python2.kernel.messaging.DefaultTaskFactory$DefaultTask.handle(DefaultTaskFactory.java:218) at org.knime.python2.kernel.messaging.DefaultTaskFactory.handle(DefaultTaskFactory.java:103) at org.knime.python2.kernel.messaging.MessageDistributorLoop.loop(MessageDistributorLoop.java:86) at org.knime.python2.kernel.messaging.AbstractMessageLoop.doLoop(AbstractMessageLoop.java:175) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-11-27 12:05:07,539 : DEBUG : python-message-distribute-loop-0 : ThreadUtils : : : Unnecessary call to runnableWithContext, because no context is available org.knime.core.util.ThreadUtils$UnnecessaryCallException at org.knime.core.util.ThreadUtils.runnableWithContext(ThreadUtils.java:381) at org.knime.core.util.ThreadUtils.runnableWithContext(ThreadUtils.java:357) at org.knime.core.util.ThreadUtils$ExecutorServiceWithContext.submit(ThreadUtils.java:94) at org.knime.python2.kernel.messaging.DefaultTaskFactory$DefaultTask.run(DefaultTaskFactory.java:184) at org.knime.python2.kernel.messaging.DefaultTaskFactory$DefaultTask.handle(DefaultTaskFactory.java:218) at org.knime.python2.kernel.messaging.DefaultTaskFactory.handle(DefaultTaskFactory.java:103) at org.knime.python2.kernel.messaging.MessageDistributorLoop.loop(MessageDistributorLoop.java:86) at org.knime.python2.kernel.messaging.AbstractMessageLoop.doLoop(AbstractMessageLoop.java:175) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-11-27 12:05:08,083 : DEBUG : Thread-23 : PythonKernel : : : Source code that caused failure: 2018-11-27 12:05:08,083 : DEBUG : Thread-23 : PythonKernel : : : import DLPythonNetwork 2018-11-27 12:05:08,083 : DEBUG : Thread-23 : PythonKernel : : : network = DLPythonNetwork.get_network("network_0") 2018-11-27 12:05:08,083 : DEBUG : Thread-23 : PythonKernel : : : from DLKerasNetworkTrainingInputGenerator import DLKerasNetworkTrainingInputGenerator 2018-11-27 12:05:08,083 : DEBUG : Thread-23 : PythonKernel : : : training_data_supplier = DLKerasNetworkTrainingInputGenerator(network, 546, network.spec.training_config.batch_size, "request_training_data") 2018-11-27 12:05:08,083 : DEBUG : Thread-23 : PythonKernel : : : validation_data_supplier = None 2018-11-27 12:05:08,083 : DEBUG : Thread-23 : PythonKernel : : : from DLKerasTrainTask import DLKerasTrainTask 2018-11-27 12:05:08,083 : DEBUG : Thread-23 : PythonKernel : : : reply_to = locals()['python_messaging_initiating_message_id'] 2018-11-27 12:05:08,083 : DEBUG : Thread-23 : PythonKernel : : : train_task = DLKerasTrainTask(reply_to, network, training_data_supplier, validation_data_supplier=validation_data_supplier) 2018-11-27 12:05:08,083 : DEBUG : Thread-23 : PythonKernel : : : train_task.get() 2018-11-27 12:05:08,090 : DEBUG : Thread-23 : PythonKernel : : : Traceback (most recent call last): 2018-11-27 12:05:08,090 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\tensorflow\python\client\session.py", line 1322, in _do_call 2018-11-27 12:05:08,090 : DEBUG : Thread-23 : PythonKernel : : : return fn(*args) 2018-11-27 12:05:08,090 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\tensorflow\python\client\session.py", line 1307, in _run_fn 2018-11-27 12:05:08,090 : DEBUG : Thread-23 : PythonKernel : : : options, feed_dict, fetch_list, target_list, run_metadata) 2018-11-27 12:05:08,090 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\tensorflow\python\client\session.py", line 1409, in _call_tf_sessionrun 2018-11-27 12:05:08,090 : DEBUG : Thread-23 : PythonKernel : : : run_metadata) 2018-11-27 12:05:08,090 : DEBUG : Thread-23 : PythonKernel : : : tensorflow.python.framework.errors_impl.InvalidArgumentError: indices[0,2] = 66 is not in [0, 34) 2018-11-27 12:05:08,090 : DEBUG : Thread-23 : PythonKernel : : : [[Node: embedding_1/GatherV2 = GatherV2[Taxis=DT_INT32, Tindices=DT_INT32, Tparams=DT_FLOAT, _class=["loc:@training/Adadelta/gradients/embedding_1/GatherV2_grad/Reshape"], _device="/job:localhost/replica:0/task:0/device:CPU:0"](embedding_1/embeddings/read, _arg_input_1_0_2, embedding_1/GatherV2/axis)]] 2018-11-27 12:05:08,090 : DEBUG : Thread-23 : PythonKernel : : : 2018-11-27 12:05:08,090 : DEBUG : Thread-23 : PythonKernel : : : During handling of the above exception, another exception occurred: 2018-11-27 12:05:08,090 : DEBUG : Thread-23 : PythonKernel : : : 2018-11-27 12:05:08,091 : DEBUG : Thread-23 : PythonKernel : : : Traceback (most recent call last): 2018-11-27 12:05:08,091 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\PythonKernelLauncher.py", line 120, in 2018-11-27 12:05:08,091 : DEBUG : Thread-23 : PythonKernel : : : kernel.start() 2018-11-27 12:05:08,091 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\python3\PythonKernel.py", line 93, in start 2018-11-27 12:05:08,091 : DEBUG : Thread-23 : PythonKernel : : : self._monitor.wait_for_close() 2018-11-27 12:05:08,091 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\python3\PythonKernel.py", line 172, in wait_for_close 2018-11-27 12:05:08,091 : DEBUG : Thread-23 : PythonKernel : : : self.check_exception() 2018-11-27 12:05:08,091 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\python3\PythonKernel.py", line 168, in check_exception 2018-11-27 12:05:08,091 : DEBUG : Thread-23 : PythonKernel : : : raise self._exception 2018-11-27 12:05:08,091 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\PythonKernelBase.py", line 278, in execute 2018-11-27 12:05:08,091 : DEBUG : Thread-23 : PythonKernel : : : exec(source_code, self._exec_env, self._exec_env) 2018-11-27 12:05:08,091 : DEBUG : Thread-23 : PythonKernel : : : File "", line 9, in 2018-11-27 12:05:08,091 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\messaging\Task.py", line 108, in get 2018-11-27 12:05:08,091 : DEBUG : Thread-23 : PythonKernel : : : self.run() # Start task if not already running. 2018-11-27 12:05:08,091 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\messaging\Task.py", line 105, in run 2018-11-27 12:05:08,091 : DEBUG : Thread-23 : PythonKernel : : : self._executor.submit(self._delegate_task.run) 2018-11-27 12:05:08,091 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\MainThreadExecutor.py", line 76, in submit 2018-11-27 12:05:08,091 : DEBUG : Thread-23 : PythonKernel : : : raise future.exception() 2018-11-27 12:05:08,091 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\MainThreadExecutor.py", line 93, in __init__ 2018-11-27 12:05:08,091 : DEBUG : Thread-23 : PythonKernel : : : result = fn(*args, **kwargs) 2018-11-27 12:05:08,092 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\messaging\Task.py", line 185, in run 2018-11-27 12:05:08,092 : DEBUG : Thread-23 : PythonKernel : : : raise ex 2018-11-27 12:05:08,092 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\messaging\Task.py", line 180, in run 2018-11-27 12:05:08,092 : DEBUG : Thread-23 : PythonKernel : : : self._runnable() 2018-11-27 12:05:08,092 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.dl.keras_3.6.2.v201811051556\py\DLKerasTrainTask.py", line 92, in _run_internal 2018-11-27 12:05:08,092 : DEBUG : Thread-23 : PythonKernel : : : send_to_java=self.send_to_java) 2018-11-27 12:05:08,092 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.dl.keras_3.6.2.v201811051556\py\DLKerasNetwork.py", line 199, in train 2018-11-27 12:05:08,092 : DEBUG : Thread-23 : PythonKernel : : : **{kw_max_queue: 1}) 2018-11-27 12:05:08,092 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\keras\legacy\interfaces.py", line 91, in wrapper 2018-11-27 12:05:08,092 : DEBUG : Thread-23 : PythonKernel : : : return func(*args, **kwargs) 2018-11-27 12:05:08,092 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\keras\engine\training.py", line 2230, in fit_generator 2018-11-27 12:05:08,092 : DEBUG : Thread-23 : PythonKernel : : : class_weight=class_weight) 2018-11-27 12:05:08,092 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\keras\engine\training.py", line 1883, in train_on_batch 2018-11-27 12:05:08,092 : DEBUG : Thread-23 : PythonKernel : : : outputs = self.train_function(ins) 2018-11-27 12:05:08,092 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\keras\backend\tensorflow_backend.py", line 2482, in __call__ 2018-11-27 12:05:08,092 : DEBUG : Thread-23 : PythonKernel : : : **self.session_kwargs) 2018-11-27 12:05:08,092 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\tensorflow\python\client\session.py", line 900, in run 2018-11-27 12:05:08,092 : DEBUG : Thread-23 : PythonKernel : : : run_metadata_ptr) 2018-11-27 12:05:08,092 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\tensorflow\python\client\session.py", line 1135, in _run 2018-11-27 12:05:08,092 : DEBUG : Thread-23 : PythonKernel : : : feed_dict_tensor, options, run_metadata) 2018-11-27 12:05:08,092 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\tensorflow\python\client\session.py", line 1316, in _do_run 2018-11-27 12:05:08,092 : DEBUG : Thread-23 : PythonKernel : : : run_metadata) 2018-11-27 12:05:08,092 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\tensorflow\python\client\session.py", line 1335, in _do_call 2018-11-27 12:05:08,092 : DEBUG : Thread-23 : PythonKernel : : : raise type(e)(node_def, op, message) 2018-11-27 12:05:08,092 : DEBUG : Thread-23 : PythonKernel : : : tensorflow.python.framework.errors_impl.InvalidArgumentError: indices[0,2] = 66 is not in [0, 34) 2018-11-27 12:05:08,092 : DEBUG : Thread-23 : PythonKernel : : : [[Node: embedding_1/GatherV2 = GatherV2[Taxis=DT_INT32, Tindices=DT_INT32, Tparams=DT_FLOAT, _class=["loc:@training/Adadelta/gradients/embedding_1/GatherV2_grad/Reshape"], _device="/job:localhost/replica:0/task:0/device:CPU:0"](embedding_1/embeddings/read, _arg_input_1_0_2, embedding_1/GatherV2/axis)]] 2018-11-27 12:05:08,092 : DEBUG : Thread-23 : PythonKernel : : : 2018-11-27 12:05:08,092 : DEBUG : Thread-23 : PythonKernel : : : Caused by op 'embedding_1/GatherV2', defined at: 2018-11-27 12:05:08,092 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\threading.py", line 884, in _bootstrap 2018-11-27 12:05:08,092 : DEBUG : Thread-23 : PythonKernel : : : self._bootstrap_inner() 2018-11-27 12:05:08,092 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\threading.py", line 916, in _bootstrap_inner 2018-11-27 12:05:08,092 : DEBUG : Thread-23 : PythonKernel : : : self.run() 2018-11-27 12:05:08,092 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\threading.py", line 864, in run 2018-11-27 12:05:08,092 : DEBUG : Thread-23 : PythonKernel : : : self._target(*self._args, **self._kwargs) 2018-11-27 12:05:08,092 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\concurrent\futures\thread.py", line 69, in _worker 2018-11-27 12:05:08,092 : DEBUG : Thread-23 : PythonKernel : : : work_item.run() 2018-11-27 12:05:08,092 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\concurrent\futures\thread.py", line 56, in run 2018-11-27 12:05:08,093 : DEBUG : Thread-23 : PythonKernel : : : result = self.fn(*self.args, **self.kwargs) 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\python3\PythonKernel.py", line 232, in _monitored_fn 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : return fn(*args, **kwargs) 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\messaging\Task.py", line 180, in run 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : self._runnable() 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\messaging\Task.py", line 145, in _run_internal 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : received, self._message_handlers, self._message_id_supplier, self._set_result, self._workspace) 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\messaging\AbstractTaskHandler.py", line 76, in handle 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : if self._handle_custom_message(message, message_id_supplier, message_to_send, result_consumer, workspace): 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\messaging\RequestHandlers.py", line 91, in _handle_custom_message 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : response = self._respond(message, response_message_id_supplier(), workspace) 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\messaging\RequestHandlers.py", line 346, in _respond 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : output, error = workspace.execute(source_code, request.id) 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\PythonKernelBase.py", line 278, in execute 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : exec(source_code, self._exec_env, self._exec_env) 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : File "", line 3, in 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.dl.keras_3.6.2.v201811051556\py\DLKerasTensorFlowNetwork.py", line 60, in read 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : model = self._read_internal(path, compile) 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.dl.keras_3.6.2.v201811051556\py\DLKerasNetwork.py", line 93, in _read_internal 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : return load_model(path, compile=compile) 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\keras\models.py", line 270, in load_model 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : model = model_from_config(model_config, custom_objects=custom_objects) 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\keras\models.py", line 347, in model_from_config 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : return layer_module.deserialize(config, custom_objects=custom_objects) 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\keras\layers\__init__.py", line 55, in deserialize 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : printable_module_name='layer') 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\keras\utils\generic_utils.py", line 144, in deserialize_keras_object 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : list(custom_objects.items()))) 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\keras\engine\topology.py", line 2535, in from_config 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : process_node(layer, node_data) 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\keras\engine\topology.py", line 2492, in process_node 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : layer(input_tensors[0], **kwargs) 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\keras\engine\topology.py", line 619, in __call__ 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : output = self.call(inputs, **kwargs) 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\keras\layers\embeddings.py", line 138, in call 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : out = K.gather(self.embeddings, inputs) 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\keras\backend\tensorflow_backend.py", line 1215, in gather 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : return tf.gather(reference, indices) 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\tensorflow\python\ops\array_ops.py", line 2736, in gather 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : return gen_array_ops.gather_v2(params, indices, axis, name=name) 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\tensorflow\python\ops\gen_array_ops.py", line 3064, in gather_v2 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : "GatherV2", params=params, indices=indices, axis=axis, name=name) 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\tensorflow\python\framework\op_def_library.py", line 787, in _apply_op_helper 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : op_def=op_def) 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\tensorflow\python\framework\ops.py", line 3392, in create_op 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : op_def=op_def) 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\tensorflow\python\framework\ops.py", line 1718, in __init__ 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : self._traceback = self._graph._extract_stack() # pylint: disable=protected-access 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : InvalidArgumentError (see above for traceback): indices[0,2] = 66 is not in [0, 34) 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : [[Node: embedding_1/GatherV2 = GatherV2[Taxis=DT_INT32, Tindices=DT_INT32, Tparams=DT_FLOAT, _class=["loc:@training/Adadelta/gradients/embedding_1/GatherV2_grad/Reshape"], _device="/job:localhost/replica:0/task:0/device:CPU:0"](embedding_1/embeddings/read, _arg_input_1_0_2, embedding_1/GatherV2/axis)]] 2018-11-27 12:05:08,094 : DEBUG : Thread-23 : PythonKernel : : : 2018-11-27 12:05:08,095 : WARN : Thread-24 : PythonKernel : : : Traceback (most recent call last): 2018-11-27 12:05:08,096 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\tensorflow\python\client\session.py", line 1322, in _do_call 2018-11-27 12:05:08,097 : WARN : Thread-24 : PythonKernel : : : return fn(*args) 2018-11-27 12:05:08,097 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\tensorflow\python\client\session.py", line 1307, in _run_fn 2018-11-27 12:05:08,098 : WARN : Thread-24 : PythonKernel : : : options, feed_dict, fetch_list, target_list, run_metadata) 2018-11-27 12:05:08,098 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\tensorflow\python\client\session.py", line 1409, in _call_tf_sessionrun 2018-11-27 12:05:08,099 : WARN : Thread-24 : PythonKernel : : : run_metadata) 2018-11-27 12:05:08,099 : WARN : Thread-24 : PythonKernel : : : tensorflow.python.framework.errors_impl.InvalidArgumentError: indices[0,2] = 66 is not in [0, 34) 2018-11-27 12:05:08,100 : WARN : Thread-24 : PythonKernel : : : [[Node: embedding_1/GatherV2 = GatherV2[Taxis=DT_INT32, Tindices=DT_INT32, Tparams=DT_FLOAT, _class=["loc:@training/Adadelta/gradients/embedding_1/GatherV2_grad/Reshape"], _device="/job:localhost/replica:0/task:0/device:CPU:0"](embedding_1/embeddings/read, _arg_input_1_0_2, embedding_1/GatherV2/axis)]] 2018-11-27 12:05:08,100 : WARN : Thread-24 : PythonKernel : : : 2018-11-27 12:05:08,100 : WARN : Thread-24 : PythonKernel : : : During handling of the above exception, another exception occurred: 2018-11-27 12:05:08,100 : WARN : Thread-24 : PythonKernel : : : 2018-11-27 12:05:08,100 : WARN : Thread-24 : PythonKernel : : : Traceback (most recent call last): 2018-11-27 12:05:08,100 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\PythonKernelLauncher.py", line 124, in 2018-11-27 12:05:08,101 : WARN : Thread-24 : PythonKernel : : : raise ex 2018-11-27 12:05:08,101 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\concurrent\futures\thread.py", line 56, in run 2018-11-27 12:05:08,101 : WARN : Thread-24 : PythonKernel : : : result = self.fn(*self.args, **self.kwargs) 2018-11-27 12:05:08,101 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\python3\PythonKernel.py", line 235, in _monitored_fn 2018-11-27 12:05:08,102 : WARN : Thread-24 : PythonKernel : : : raise ex 2018-11-27 12:05:08,102 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\python3\PythonKernel.py", line 232, in _monitored_fn 2018-11-27 12:05:08,103 : WARN : Thread-24 : PythonKernel : : : return fn(*args, **kwargs) 2018-11-27 12:05:08,103 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\messaging\Task.py", line 185, in run 2018-11-27 12:05:08,103 : WARN : Thread-24 : PythonKernel : : : raise ex 2018-11-27 12:05:08,104 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\messaging\Task.py", line 180, in run 2018-11-27 12:05:08,104 : WARN : Thread-24 : PythonKernel : : : self._runnable() 2018-11-27 12:05:08,104 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\messaging\Task.py", line 149, in _run_internal 2018-11-27 12:05:08,105 : WARN : Thread-24 : PythonKernel : : : self._message_sender.send(to_send) 2018-11-27 12:05:08,105 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\python3\messaging\PythonMessaging.py", line 111, in send 2018-11-27 12:05:08,105 : WARN : Thread-24 : PythonKernel : : : self._send_loop.send(message) 2018-11-27 12:05:08,105 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\python3\messaging\MessageSenderLoop.py", line 60, in send 2018-11-27 12:05:08,106 : WARN : Thread-24 : PythonKernel : : : self._send_queue.put(message) 2018-11-27 12:05:08,106 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\python3\PythonKernel.py", line 189, in put 2018-11-27 12:05:08,106 : WARN : Thread-24 : PythonKernel : : : self._monitor.check_exception() 2018-11-27 12:05:08,107 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\python3\PythonKernel.py", line 168, in check_exception 2018-11-27 12:05:08,107 : WARN : Thread-24 : PythonKernel : : : raise self._exception 2018-11-27 12:05:08,107 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\PythonKernelLauncher.py", line 120, in 2018-11-27 12:05:08,108 : WARN : Thread-24 : PythonKernel : : : kernel.start() 2018-11-27 12:05:08,108 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\python3\PythonKernel.py", line 93, in start 2018-11-27 12:05:08,108 : WARN : Thread-24 : PythonKernel : : : self._monitor.wait_for_close() 2018-11-27 12:05:08,108 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\python3\PythonKernel.py", line 172, in wait_for_close 2018-11-27 12:05:08,109 : WARN : Thread-24 : PythonKernel : : : self.check_exception() 2018-11-27 12:05:08,109 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\python3\PythonKernel.py", line 168, in check_exception 2018-11-27 12:05:08,109 : WARN : Thread-24 : PythonKernel : : : raise self._exception 2018-11-27 12:05:08,109 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\PythonKernelBase.py", line 278, in execute 2018-11-27 12:05:08,110 : WARN : Thread-24 : PythonKernel : : : exec(source_code, self._exec_env, self._exec_env) 2018-11-27 12:05:08,110 : WARN : Thread-24 : PythonKernel : : : File "", line 9, in 2018-11-27 12:05:08,111 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\messaging\Task.py", line 108, in get 2018-11-27 12:05:08,111 : WARN : Thread-24 : PythonKernel : : : self.run() # Start task if not already running. 2018-11-27 12:05:08,111 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\messaging\Task.py", line 105, in run 2018-11-27 12:05:08,111 : WARN : Thread-24 : PythonKernel : : : self._executor.submit(self._delegate_task.run) 2018-11-27 12:05:08,112 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\MainThreadExecutor.py", line 76, in submit 2018-11-27 12:05:08,112 : WARN : Thread-24 : PythonKernel : : : raise future.exception() 2018-11-27 12:05:08,112 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\MainThreadExecutor.py", line 93, in __init__ 2018-11-27 12:05:08,113 : WARN : Thread-24 : PythonKernel : : : result = fn(*args, **kwargs) 2018-11-27 12:05:08,113 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\messaging\Task.py", line 185, in run 2018-11-27 12:05:08,113 : WARN : Thread-24 : PythonKernel : : : raise ex 2018-11-27 12:05:08,113 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\messaging\Task.py", line 180, in run 2018-11-27 12:05:08,114 : WARN : Thread-24 : PythonKernel : : : self._runnable() 2018-11-27 12:05:08,114 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.dl.keras_3.6.2.v201811051556\py\DLKerasTrainTask.py", line 92, in _run_internal 2018-11-27 12:05:08,114 : WARN : Thread-24 : PythonKernel : : : send_to_java=self.send_to_java) 2018-11-27 12:05:08,114 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.dl.keras_3.6.2.v201811051556\py\DLKerasNetwork.py", line 199, in train 2018-11-27 12:05:08,115 : WARN : Thread-24 : PythonKernel : : : **{kw_max_queue: 1}) 2018-11-27 12:05:08,115 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\keras\legacy\interfaces.py", line 91, in wrapper 2018-11-27 12:05:08,115 : WARN : Thread-24 : PythonKernel : : : return func(*args, **kwargs) 2018-11-27 12:05:08,115 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\keras\engine\training.py", line 2230, in fit_generator 2018-11-27 12:05:08,116 : WARN : Thread-24 : PythonKernel : : : class_weight=class_weight) 2018-11-27 12:05:08,116 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\keras\engine\training.py", line 1883, in train_on_batch 2018-11-27 12:05:08,119 : WARN : Thread-24 : PythonKernel : : : outputs = self.train_function(ins) 2018-11-27 12:05:08,120 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\keras\backend\tensorflow_backend.py", line 2482, in __call__ 2018-11-27 12:05:08,122 : WARN : Thread-24 : PythonKernel : : : **self.session_kwargs) 2018-11-27 12:05:08,122 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\tensorflow\python\client\session.py", line 900, in run 2018-11-27 12:05:08,124 : WARN : Thread-24 : PythonKernel : : : run_metadata_ptr) 2018-11-27 12:05:08,124 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\tensorflow\python\client\session.py", line 1135, in _run 2018-11-27 12:05:08,125 : WARN : Thread-24 : PythonKernel : : : feed_dict_tensor, options, run_metadata) 2018-11-27 12:05:08,125 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\tensorflow\python\client\session.py", line 1316, in _do_run 2018-11-27 12:05:08,127 : WARN : Thread-24 : PythonKernel : : : run_metadata) 2018-11-27 12:05:08,128 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\tensorflow\python\client\session.py", line 1335, in _do_call 2018-11-27 12:05:08,128 : WARN : Thread-24 : PythonKernel : : : raise type(e)(node_def, op, message) 2018-11-27 12:05:08,132 : WARN : Thread-24 : PythonKernel : : : tensorflow.python.framework.errors_impl.InvalidArgumentError: indices[0,2] = 66 is not in [0, 34) 2018-11-27 12:05:08,132 : WARN : Thread-24 : PythonKernel : : : [[Node: embedding_1/GatherV2 = GatherV2[Taxis=DT_INT32, Tindices=DT_INT32, Tparams=DT_FLOAT, _class=["loc:@training/Adadelta/gradients/embedding_1/GatherV2_grad/Reshape"], _device="/job:localhost/replica:0/task:0/device:CPU:0"](embedding_1/embeddings/read, _arg_input_1_0_2, embedding_1/GatherV2/axis)]] 2018-11-27 12:05:08,132 : WARN : Thread-24 : PythonKernel : : : 2018-11-27 12:05:08,132 : WARN : Thread-24 : PythonKernel : : : Caused by op 'embedding_1/GatherV2', defined at: 2018-11-27 12:05:08,132 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\threading.py", line 884, in _bootstrap 2018-11-27 12:05:08,132 : WARN : Thread-24 : PythonKernel : : : self._bootstrap_inner() 2018-11-27 12:05:08,133 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\threading.py", line 916, in _bootstrap_inner 2018-11-27 12:05:08,133 : WARN : Thread-24 : PythonKernel : : : self.run() 2018-11-27 12:05:08,133 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\threading.py", line 864, in run 2018-11-27 12:05:08,133 : WARN : Thread-24 : PythonKernel : : : self._target(*self._args, **self._kwargs) 2018-11-27 12:05:08,133 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\concurrent\futures\thread.py", line 69, in _worker 2018-11-27 12:05:08,133 : WARN : Thread-24 : PythonKernel : : : work_item.run() 2018-11-27 12:05:08,133 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\concurrent\futures\thread.py", line 56, in run 2018-11-27 12:05:08,133 : WARN : Thread-24 : PythonKernel : : : result = self.fn(*self.args, **self.kwargs) 2018-11-27 12:05:08,134 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\python3\PythonKernel.py", line 232, in _monitored_fn 2018-11-27 12:05:08,134 : WARN : Thread-24 : PythonKernel : : : return fn(*args, **kwargs) 2018-11-27 12:05:08,134 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\messaging\Task.py", line 180, in run 2018-11-27 12:05:08,134 : WARN : Thread-24 : PythonKernel : : : self._runnable() 2018-11-27 12:05:08,134 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\messaging\Task.py", line 145, in _run_internal 2018-11-27 12:05:08,134 : WARN : Thread-24 : PythonKernel : : : received, self._message_handlers, self._message_id_supplier, self._set_result, self._workspace) 2018-11-27 12:05:08,134 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\messaging\AbstractTaskHandler.py", line 76, in handle 2018-11-27 12:05:08,134 : WARN : Thread-24 : PythonKernel : : : if self._handle_custom_message(message, message_id_supplier, message_to_send, result_consumer, workspace): 2018-11-27 12:05:08,135 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\messaging\RequestHandlers.py", line 91, in _handle_custom_message 2018-11-27 12:05:08,135 : WARN : Thread-24 : PythonKernel : : : response = self._respond(message, response_message_id_supplier(), workspace) 2018-11-27 12:05:08,135 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\messaging\RequestHandlers.py", line 346, in _respond 2018-11-27 12:05:08,135 : WARN : Thread-24 : PythonKernel : : : output, error = workspace.execute(source_code, request.id) 2018-11-27 12:05:08,135 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.python2_3.6.2.v201811051558\py\PythonKernelBase.py", line 278, in execute 2018-11-27 12:05:08,135 : WARN : Thread-24 : PythonKernel : : : exec(source_code, self._exec_env, self._exec_env) 2018-11-27 12:05:08,135 : WARN : Thread-24 : PythonKernel : : : File "", line 3, in 2018-11-27 12:05:08,135 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.dl.keras_3.6.2.v201811051556\py\DLKerasTensorFlowNetwork.py", line 60, in read 2018-11-27 12:05:08,136 : WARN : Thread-24 : PythonKernel : : : model = self._read_internal(path, compile) 2018-11-27 12:05:08,136 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\Documents\knime\knime_3.6.1\plugins\org.knime.dl.keras_3.6.2.v201811051556\py\DLKerasNetwork.py", line 93, in _read_internal 2018-11-27 12:05:08,136 : WARN : Thread-24 : PythonKernel : : : return load_model(path, compile=compile) 2018-11-27 12:05:08,136 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\keras\models.py", line 270, in load_model 2018-11-27 12:05:08,136 : WARN : Thread-24 : PythonKernel : : : model = model_from_config(model_config, custom_objects=custom_objects) 2018-11-27 12:05:08,136 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\keras\models.py", line 347, in model_from_config 2018-11-27 12:05:08,136 : WARN : Thread-24 : PythonKernel : : : return layer_module.deserialize(config, custom_objects=custom_objects) 2018-11-27 12:05:08,136 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\keras\layers\__init__.py", line 55, in deserialize 2018-11-27 12:05:08,136 : WARN : Thread-24 : PythonKernel : : : printable_module_name='layer') 2018-11-27 12:05:08,137 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\keras\utils\generic_utils.py", line 144, in deserialize_keras_object 2018-11-27 12:05:08,137 : WARN : Thread-24 : PythonKernel : : : list(custom_objects.items()))) 2018-11-27 12:05:08,137 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\keras\engine\topology.py", line 2535, in from_config 2018-11-27 12:05:08,137 : WARN : Thread-24 : PythonKernel : : : process_node(layer, node_data) 2018-11-27 12:05:08,137 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\keras\engine\topology.py", line 2492, in process_node 2018-11-27 12:05:08,137 : WARN : Thread-24 : PythonKernel : : : layer(input_tensors[0], **kwargs) 2018-11-27 12:05:08,137 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\keras\engine\topology.py", line 619, in __call__ 2018-11-27 12:05:08,137 : WARN : Thread-24 : PythonKernel : : : output = self.call(inputs, **kwargs) 2018-11-27 12:05:08,137 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\keras\layers\embeddings.py", line 138, in call 2018-11-27 12:05:08,138 : WARN : Thread-24 : PythonKernel : : : out = K.gather(self.embeddings, inputs) 2018-11-27 12:05:08,138 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\keras\backend\tensorflow_backend.py", line 1215, in gather 2018-11-27 12:05:08,138 : WARN : Thread-24 : PythonKernel : : : return tf.gather(reference, indices) 2018-11-27 12:05:08,139 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\tensorflow\python\ops\array_ops.py", line 2736, in gather 2018-11-27 12:05:08,139 : WARN : Thread-24 : PythonKernel : : : return gen_array_ops.gather_v2(params, indices, axis, name=name) 2018-11-27 12:05:08,139 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\tensorflow\python\ops\gen_array_ops.py", line 3064, in gather_v2 2018-11-27 12:05:08,139 : WARN : Thread-24 : PythonKernel : : : "GatherV2", params=params, indices=indices, axis=axis, name=name) 2018-11-27 12:05:08,139 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\tensorflow\python\framework\op_def_library.py", line 787, in _apply_op_helper 2018-11-27 12:05:08,139 : WARN : Thread-24 : PythonKernel : : : op_def=op_def) 2018-11-27 12:05:08,139 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\tensorflow\python\framework\ops.py", line 3392, in create_op 2018-11-27 12:05:08,139 : WARN : Thread-24 : PythonKernel : : : op_def=op_def) 2018-11-27 12:05:08,140 : WARN : Thread-24 : PythonKernel : : : File "C:\Users\spg_kibe\AppData\Local\Continuum\anaconda3\envs\kk\lib\site-packages\tensorflow\python\framework\ops.py", line 1718, in __init__ 2018-11-27 12:05:08,140 : WARN : Thread-24 : PythonKernel : : : self._traceback = self._graph._extract_stack() # pylint: disable=protected-access 2018-11-27 12:05:08,140 : WARN : Thread-24 : PythonKernel : : : 2018-11-27 12:05:08,140 : WARN : Thread-24 : PythonKernel : : : InvalidArgumentError (see above for traceback): indices[0,2] = 66 is not in [0, 34) 2018-11-27 12:05:08,140 : WARN : Thread-24 : PythonKernel : : : [[Node: embedding_1/GatherV2 = GatherV2[Taxis=DT_INT32, Tindices=DT_INT32, Tparams=DT_FLOAT, _class=["loc:@training/Adadelta/gradients/embedding_1/GatherV2_grad/Reshape"], _device="/job:localhost/replica:0/task:0/device:CPU:0"](embedding_1/embeddings/read, _arg_input_1_0_2, embedding_1/GatherV2/axis)]] 2018-11-27 12:05:08,140 : WARN : Thread-24 : PythonKernel : : : 2018-11-27 12:05:10,095 : DEBUG : KNIME-Worker-4 : PythonKernel : Keras Network Learner : 4:73 : An exception occurred while safely invoking a method. Exception: java.util.concurrent.ExecutionException: java.lang.Exception: Failed to receive message from Python or forward received message. com.google.common.util.concurrent.UncheckedExecutionException: java.util.concurrent.ExecutionException: java.lang.Exception: Failed to receive message from Python or forward received message. at org.knime.python2.kernel.PythonKernel.lambda$7(PythonKernel.java:1378) at org.knime.python2.util.PythonUtils$Misc.invokeSafely(PythonUtils.java:202) at org.knime.python2.kernel.PythonKernel.close(PythonKernel.java:1372) at org.knime.dl.python.core.DLPythonDefaultContext.close(DLPythonDefaultContext.java:211) at org.knime.dl.python.core.DLPythonAbstractCommands.close(DLPythonAbstractCommands.java:558) at org.knime.dl.python.core.training.DLPythonAbstractNetworkTrainingSession.close(DLPythonAbstractNetworkTrainingSession.java:148) at org.knime.dl.keras.base.nodes.learner.DLKerasLearnerNodeModel.executeInternal(DLKerasLearnerNodeModel.java:677) at org.knime.dl.keras.base.nodes.learner.DLKerasLearnerNodeModel.execute(DLKerasLearnerNodeModel.java:294) at org.knime.core.node.NodeModel.executeModel(NodeModel.java:567) at org.knime.core.node.Node.invokeFullyNodeModelExecute(Node.java:1177) at org.knime.core.node.Node.execute(Node.java:964) at org.knime.core.node.workflow.NativeNodeContainer.performExecuteNode(NativeNodeContainer.java:561) at org.knime.core.node.exec.LocalNodeExecutionJob.mainExecute(LocalNodeExecutionJob.java:95) at org.knime.core.node.workflow.NodeExecutionJob.internalRun(NodeExecutionJob.java:179) at org.knime.core.node.workflow.NodeExecutionJob.run(NodeExecutionJob.java:110) at org.knime.core.util.ThreadUtils$RunnableWithContextImpl.runWithContext(ThreadUtils.java:328) at org.knime.core.util.ThreadUtils$RunnableWithContext.run(ThreadUtils.java:204) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.knime.core.util.ThreadPool$MyFuture.run(ThreadPool.java:123) at org.knime.core.util.ThreadPool$Worker.run(ThreadPool.java:246) Caused by: java.util.concurrent.ExecutionException: java.lang.Exception: Failed to receive message from Python or forward received message. at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:206) at org.knime.python2.kernel.messaging.DefaultTaskFactory$DefaultTask.get(DefaultTaskFactory.java:203) at org.knime.python2.kernel.PythonKernel.lambda$7(PythonKernel.java:1374) ... 20 more Caused by: java.lang.Exception: Failed to receive message from Python or forward received message. at org.knime.python2.kernel.messaging.AbstractMessageLoop.throwExceptionInLoop(AbstractMessageLoop.java:76) at org.knime.python2.kernel.messaging.DefaultMessageReceiverLoop.loop(DefaultMessageReceiverLoop.java:98) at org.knime.python2.kernel.messaging.AbstractMessageLoop.doLoop(AbstractMessageLoop.java:175) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Suppressed: java.lang.Exception: Failed to distribute message from Python. Cause: Message receiver loop terminated. at org.knime.python2.kernel.messaging.AbstractMessageLoop.throwExceptionInLoop(AbstractMessageLoop.java:76) at org.knime.python2.kernel.messaging.MessageDistributorLoop.loop(MessageDistributorLoop.java:93) ... 4 more Caused by: java.io.IOException: Message receiver loop terminated. at org.knime.python2.kernel.messaging.DefaultMessageReceiverLoop.receive(DefaultMessageReceiverLoop.java:82) at org.knime.python2.kernel.messaging.MessageDistributorLoop.loop(MessageDistributorLoop.java:82) ... 4 more [CIRCULAR REFERENCE:java.lang.Exception: Failed to distribute message from Python. Cause: Message receiver loop terminated.] Caused by: java.io.EOFException at java.io.DataInputStream.readFully(DataInputStream.java:197) at java.io.DataInputStream.readFully(DataInputStream.java:169) at org.knime.python2.kernel.messaging.PythonMessagingUtils.readInt(PythonMessagingUtils.java:91) at org.knime.python2.kernel.messaging.DefaultMessageReceiver.receive(DefaultMessageReceiver.java:80) at org.knime.python2.kernel.messaging.DefaultMessageReceiverLoop.loop(DefaultMessageReceiverLoop.java:92) ... 4 more 2018-11-27 12:05:10,097 : DEBUG : KNIME-Worker-4 : Buffer : Keras Network Learner : 4:73 : Closing input stream on "C:\Users\spg_kibe\AppData\Local\Temp\knime_KerasTest33577\knime_container_20181127_3512333019950853239.tmp", 0 remaining 2018-11-27 12:05:10,097 : ERROR : KNIME-Worker-4 : DLKerasLearnerNodeModel : Keras Network Learner : 4:73 : java.util.concurrent.ExecutionException: java.lang.Exception: Failed to receive message from Python or forward received message. 2018-11-27 12:05:10,098 : DEBUG : KNIME-Worker-4 : Node : Keras Network Learner : 4:73 : reset 2018-11-27 12:05:10,098 : ERROR : KNIME-Worker-4 : Node : Keras Network Learner : 4:73 : Execute failed: An error occured during training of the Keras deep learning network. See log for details. 2018-11-27 12:05:10,098 : DEBUG : KNIME-Worker-4 : Node : Keras Network Learner : 4:73 : Execute failed: An error occured during training of the Keras deep learning network. See log for details. java.lang.RuntimeException: An error occured during training of the Keras deep learning network. See log for details. at org.knime.dl.keras.base.nodes.learner.DLKerasLearnerNodeModel.handleGeneralException(DLKerasLearnerNodeModel.java:705) at org.knime.dl.keras.base.nodes.learner.DLKerasLearnerNodeModel.executeInternal(DLKerasLearnerNodeModel.java:681) at org.knime.dl.keras.base.nodes.learner.DLKerasLearnerNodeModel.execute(DLKerasLearnerNodeModel.java:294) at org.knime.core.node.NodeModel.executeModel(NodeModel.java:567) at org.knime.core.node.Node.invokeFullyNodeModelExecute(Node.java:1177) at org.knime.core.node.Node.execute(Node.java:964) at org.knime.core.node.workflow.NativeNodeContainer.performExecuteNode(NativeNodeContainer.java:561) at org.knime.core.node.exec.LocalNodeExecutionJob.mainExecute(LocalNodeExecutionJob.java:95) at org.knime.core.node.workflow.NodeExecutionJob.internalRun(NodeExecutionJob.java:179) at org.knime.core.node.workflow.NodeExecutionJob.run(NodeExecutionJob.java:110) at org.knime.core.util.ThreadUtils$RunnableWithContextImpl.runWithContext(ThreadUtils.java:328) at org.knime.core.util.ThreadUtils$RunnableWithContext.run(ThreadUtils.java:204) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.knime.core.util.ThreadPool$MyFuture.run(ThreadPool.java:123) at org.knime.core.util.ThreadPool$Worker.run(ThreadPool.java:246) Caused by: java.io.IOException: java.util.concurrent.ExecutionException: java.lang.Exception: Failed to receive message from Python or forward received message. at org.knime.dl.python.core.DLPythonAbstractCommands.trainNetwork(DLPythonAbstractCommands.java:544) at org.knime.dl.python.core.training.DLPythonAbstractNetworkTrainingSession.trainInternal(DLPythonAbstractNetworkTrainingSession.java:163) at org.knime.dl.core.training.DLAbstractNetworkTrainingSession.run(DLAbstractNetworkTrainingSession.java:273) at org.knime.dl.keras.base.nodes.learner.DLKerasLearnerNodeModel.executeInternal(DLKerasLearnerNodeModel.java:674) ... 14 more Caused by: java.util.concurrent.ExecutionException: java.lang.Exception: Failed to receive message from Python or forward received message. at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:192) at org.knime.python2.kernel.messaging.DefaultTaskFactory$DefaultTask.get(DefaultTaskFactory.java:196) at org.knime.dl.python.core.DLPythonAbstractCommands.trainNetwork(DLPythonAbstractCommands.java:542) ... 17 more Caused by: java.lang.Exception: Failed to receive message from Python or forward received message. at org.knime.python2.kernel.messaging.AbstractMessageLoop.throwExceptionInLoop(AbstractMessageLoop.java:76) at org.knime.python2.kernel.messaging.DefaultMessageReceiverLoop.loop(DefaultMessageReceiverLoop.java:98) at org.knime.python2.kernel.messaging.AbstractMessageLoop.doLoop(AbstractMessageLoop.java:175) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Suppressed: java.lang.Exception: Failed to distribute message from Python. Cause: Message receiver loop terminated. at org.knime.python2.kernel.messaging.AbstractMessageLoop.throwExceptionInLoop(AbstractMessageLoop.java:76) at org.knime.python2.kernel.messaging.MessageDistributorLoop.loop(MessageDistributorLoop.java:93) ... 4 more Caused by: java.io.IOException: Message receiver loop terminated. at org.knime.python2.kernel.messaging.DefaultMessageReceiverLoop.receive(DefaultMessageReceiverLoop.java:82) at org.knime.python2.kernel.messaging.MessageDistributorLoop.loop(MessageDistributorLoop.java:82) ... 4 more [CIRCULAR REFERENCE:java.lang.Exception: Failed to distribute message from Python. Cause: Message receiver loop terminated.] Caused by: java.io.EOFException at java.io.DataInputStream.readFully(DataInputStream.java:197) at java.io.DataInputStream.readFully(DataInputStream.java:169) at org.knime.python2.kernel.messaging.PythonMessagingUtils.readInt(PythonMessagingUtils.java:91) at org.knime.python2.kernel.messaging.DefaultMessageReceiver.receive(DefaultMessageReceiver.java:80) at org.knime.python2.kernel.messaging.DefaultMessageReceiverLoop.loop(DefaultMessageReceiverLoop.java:92) ... 4 more 2018-11-27 12:05:10,110 : DEBUG : KNIME-Worker-4 : WorkflowManager : Keras Network Learner : 4:73 : Keras Network Learner 4:73 doBeforePostExecution 2018-11-27 12:05:10,119 : DEBUG : KNIME-Worker-4 : NodeContainer : Keras Network Learner : 4:73 : Keras Network Learner 4:73 has new state: POSTEXECUTE 2018-11-27 12:05:10,121 : DEBUG : KNIME-Worker-4 : WorkflowManager : Keras Network Learner : 4:73 : Keras Network Learner 4:73 doAfterExecute - failure 2018-11-27 12:05:10,121 : DEBUG : KNIME-Worker-4 : Node : Keras Network Learner : 4:73 : reset 2018-11-27 12:05:10,121 : DEBUG : KNIME-Worker-4 : Node : Keras Network Learner : 4:73 : clean output ports. 2018-11-27 12:05:10,121 : DEBUG : KNIME-Worker-4 : WorkflowFileStoreHandlerRepository : Keras Network Learner : 4:73 : Removing handler 40493990-414b-489b-b8ef-496a0b53bad6 (Keras Network Learner 4:73: ) - 8 remaining 2018-11-27 12:05:10,121 : DEBUG : KNIME-Worker-4 : NodeContainer : Keras Network Learner : 4:73 : Keras Network Learner 4:73 has new state: IDLE 2018-11-27 12:05:10,122 : DEBUG : KNIME-Worker-4 : Node : Keras Network Learner : 4:73 : Configure succeeded. (Keras Network Learner) 2018-11-27 12:05:10,122 : DEBUG : KNIME-Worker-4 : NodeContainer : Keras Network Learner : 4:73 : Keras Network Learner 4:73 has new state: CONFIGURED 2018-11-27 12:05:10,122 : DEBUG : KNIME-Worker-4 : NodeContainer : Keras Network Learner : 4:73 : KerasTest 4 has new state: IDLE 2018-11-27 12:05:10,122 : DEBUG : KNIME-WFM-Parent-Notifier : NodeContainer : : : ROOT has new state: IDLE 2018-11-27 12:05:10,162 : DEBUG : KNIME-Node-Usage-Writer : NodeTimer$GlobalNodeStats : : : Successfully wrote node usage stats to file: C:\Users\spg_kibe\knime-workspace\.metadata\knime\nodeusage_3.0.json