2019-04-11 13:20:55,410 : DEBUG : main : WorkflowEditor : : : Saving workflow KNIME_project 0 2019-04-11 13:20:55,634 : DEBUG : ModalContext : WorkflowManager : : : Deleted obsolete node directory "C:\Users\tk173537\Knime-Workspace\KNIME_project\SSH Connection (#146)" 2019-04-11 13:20:55,680 : DEBUG : ModalContext : WorkflowManager : : : Deleted obsolete node directory "C:\Users\tk173537\Knime-Workspace\KNIME_project\Create Local Big Data Environment (#151)" 2019-04-11 13:20:55,697 : DEBUG : ModalContext : WorkflowManager : : : Deleted obsolete node directory "C:\Users\tk173537\Knime-Workspace\KNIME_project\HDFS Connection (#145)" 2019-04-11 13:20:55,715 : DEBUG : ModalContext : WorkflowManager : : : Deleted obsolete node directory "C:\Users\tk173537\Knime-Workspace\KNIME_project\WebHDFS Connection (#148)" 2019-04-11 13:20:55,743 : DEBUG : ModalContext : WorkflowManager : : : Deleted obsolete node directory "C:\Users\tk173537\Knime-Workspace\KNIME_project\HttpFS Connection (#150)" 2019-04-11 13:20:55,760 : DEBUG : ModalContext : WorkflowManager : : : Deleted obsolete node directory "C:\Users\tk173537\Knime-Workspace\KNIME_project\HttpFS Connection (#167)" 2019-04-11 13:20:55,766 : DEBUG : ModalContext : WorkflowManager : : : Deleted obsolete node directory "C:\Users\tk173537\Knime-Workspace\KNIME_project\HttpFS Connection (#147)" 2019-04-11 13:20:55,812 : DEBUG : ModalContext : FileSingleNodeContainerPersistor : Hive Loader : 0:76 : Created node directory "C:\Users\tk173537\Knime-Workspace\KNIME_project\Hive Loader (#76)" 2019-04-11 13:20:55,855 : DEBUG : ModalContext : FileSingleNodeContainerPersistor : Hive Connector : 0:127 : Replaced node directory "C:\Users\tk173537\Knime-Workspace\KNIME_project\Hive Connector (#127)" 2019-04-11 13:20:55,900 : DEBUG : ModalContext : FileSingleNodeContainerPersistor : Hive Loader : 0:128 : Replaced node directory "C:\Users\tk173537\Knime-Workspace\KNIME_project\Hive Loader (#128)" 2019-04-11 13:20:55,938 : DEBUG : ModalContext : FileSingleNodeContainerPersistor : HDFS Connection : 0:152 : Replaced node directory "C:\Users\tk173537\Knime-Workspace\KNIME_project\HDFS Connection (#152)" 2019-04-11 13:20:55,981 : DEBUG : ModalContext : FileSingleNodeContainerPersistor : Create Local Big Data Environment : 0:167 : Created node directory "C:\Users\tk173537\Knime-Workspace\KNIME_project\Create Local Big Data Environment (#167)" 2019-04-11 13:20:56,073 : DEBUG : ModalContext : FileSingleNodeContainerPersistor : Database SQL Executor : 0:168 : Created node directory "C:\Users\tk173537\Knime-Workspace\KNIME_project\Database SQL Executor (#168)" 2019-04-11 13:20:56,103 : DEBUG : ModalContext : FileSingleNodeContainerPersistor : Hive Connector : 0:169 : Created node directory "C:\Users\tk173537\Knime-Workspace\KNIME_project\Hive Connector (#169)" 2019-04-11 13:20:56,135 : DEBUG : ModalContext : FileSingleNodeContainerPersistor : Data Generator : 0:170 : Created node directory "C:\Users\tk173537\Knime-Workspace\KNIME_project\Data Generator (#170)" 2019-04-11 13:20:56,142 : DEBUG : ModalContext : Buffer : Data Generator : 0:170 : Using table format org.knime.core.data.container.DefaultTableStoreFormat 2019-04-11 13:20:56,201 : DEBUG : ModalContext : Buffer : Data Generator : 0:170 : Using table format org.knime.core.data.container.DefaultTableStoreFormat 2019-04-11 13:20:56,225 : DEBUG : ModalContext : FileSingleNodeContainerPersistor : Impala Loader : 0:171 : Created node directory "C:\Users\tk173537\Knime-Workspace\KNIME_project\Impala Loader (#171)" 2019-04-11 13:20:56,230 : DEBUG : ModalContext : FileSingleNodeContainerPersistor : Impala Connector : 0:172 : Created node directory "C:\Users\tk173537\Knime-Workspace\KNIME_project\Impala Connector (#172)" 2019-04-11 13:20:56,329 : DEBUG : ModalContext : OpenAPIDefinitionGenerator : : : Writing OpenAPI definition for input parameters of KNIME_project 2019-04-11 13:20:56,636 : DEBUG : ModalContext : LocalWorkspaceContentProvider : : : Refreshing "/KNIME_project" 2019-04-11 13:21:01,070 : DEBUG : main : WorkflowEditor : : : Saving workflow m_001_import_hive_csv 7 2019-04-11 13:21:01,183 : DEBUG : ModalContext : FileSingleNodeContainerPersistor : Create Local Big Data Environment : 7:3 : Replaced node directory "C:\Users\tk173537\Knime-Workspace\kn_example_bigdata_hive_csv_loader\m_001_import_hive_csv\Create Local Big Data Environment (#3)" 2019-04-11 13:21:01,259 : DEBUG : ModalContext : LocalWorkspaceContentProvider : : : Refreshing "/kn_example_bigdata_hive_csv_loader/m_001_import_hive_csv" 2019-04-11 13:21:01,585 : DEBUG : main : WorkflowEditor : : : Saving workflow JCP vs FS 4 2019-04-11 13:21:01,655 : DEBUG : ModalContext : FileSingleNodeContainerPersistor : HDFS Connection : 4:145 : Created node directory "C:\Users\tk173537\Knime-Workspace\JCP vs FS\HDFS Connection (#145)" 2019-04-11 13:21:01,658 : DEBUG : ModalContext : FileSingleNodeContainerPersistor : SSH Connection : 4:146 : Created node directory "C:\Users\tk173537\Knime-Workspace\JCP vs FS\SSH Connection (#146)" 2019-04-11 13:21:01,660 : DEBUG : ModalContext : FileSingleNodeContainerPersistor : WebHDFS Connection : 4:148 : Created node directory "C:\Users\tk173537\Knime-Workspace\JCP vs FS\WebHDFS Connection (#148)" 2019-04-11 13:21:01,663 : DEBUG : ModalContext : FileSingleNodeContainerPersistor : HttpFS Connection : 4:150 : Created node directory "C:\Users\tk173537\Knime-Workspace\JCP vs FS\HttpFS Connection (#150)" 2019-04-11 13:21:01,667 : DEBUG : ModalContext : FileSingleNodeContainerPersistor : Create Local Big Data Environment : 4:151 : Created node directory "C:\Users\tk173537\Knime-Workspace\JCP vs FS\Create Local Big Data Environment (#151)" 2019-04-11 13:21:01,672 : DEBUG : ModalContext : FileSingleNodeContainerPersistor : HttpFS Connection : 4:167 : Created node directory "C:\Users\tk173537\Knime-Workspace\JCP vs FS\HttpFS Connection (#167)" 2019-04-11 13:21:01,688 : DEBUG : ModalContext : FileSingleNodeContainerPersistor : HttpFS Connection : 4:267 : Created node directory "C:\Users\tk173537\Knime-Workspace\JCP vs FS\HttpFS Connection (#267)" 2019-04-11 13:21:01,702 : DEBUG : ModalContext : OpenAPIDefinitionGenerator : : : Writing OpenAPI definition for input parameters of JCP vs FS 2019-04-11 13:21:01,819 : DEBUG : ModalContext : LocalWorkspaceContentProvider : : : Refreshing "/JCP vs FS" 2019-04-11 13:21:20,216 : DEBUG : main : NodeContainerEditPart : : : HDFS Connection 0:152 (EXECUTED) 2019-04-11 13:21:20,216 : DEBUG : main : NodeContainerEditPart : : : Hive Loader 0:128 (CONFIGURED) 2019-04-11 13:21:21,411 : DEBUG : main : NodeContainerEditPart : : : Hive Loader 0:128 (CONFIGURED) 2019-04-11 13:21:29,561 : DEBUG : main : NodeContainerEditPart : : : Data Generator 0:170 (EXECUTED) 2019-04-11 13:21:30,838 : DEBUG : main : CreateConnectionCommand : : : adding connection from 0:170 1 to 0:128 2 2019-04-11 13:21:30,838 : DEBUG : main : NodeContainer : : : Setting dirty flag on KNIME_project 0 2019-04-11 13:21:30,838 : DEBUG : main : Node : Hive Loader : 0:128 : reset 2019-04-11 13:21:30,838 : DEBUG : main : Node : Hive Loader : 0:128 : clean output ports. 2019-04-11 13:21:30,838 : DEBUG : main : NodeContainer : : : Setting dirty flag on Hive Loader 0:128 2019-04-11 13:21:30,838 : DEBUG : main : NodeContainer : : : Hive Loader 0:128 has new state: IDLE 2019-04-11 13:21:30,838 : DEBUG : KNIME-Workflow-Notifier : WorkflowEditor : : : Workflow event triggered: WorkflowEvent [type=WORKFLOW_DIRTY;node=0;old=null;new=null;timestamp=Apr 11, 2019 1:21:30 PM] 2019-04-11 13:21:30,839 : DEBUG : KNIME-Workflow-Notifier : WorkflowEditor : : : Workflow event triggered: WorkflowEvent [type=CONNECTION_REMOVED;node=null;old=STD[0:160(1) -> 0:128( 2)];new=null;timestamp=Apr 11, 2019 1:21:30 PM] 2019-04-11 13:21:30,855 : DEBUG : main : Node : Hive Loader : 0:128 : Configure succeeded. (Hive Loader) 2019-04-11 13:21:30,855 : DEBUG : main : NodeContainer : : : Hive Loader 0:128 has new state: CONFIGURED 2019-04-11 13:21:30,855 : DEBUG : main : WorkflowManager : : : Added new connection from node 0:170(1) to node 0:128(2) 2019-04-11 13:21:30,856 : DEBUG : KNIME-Workflow-Notifier : WorkflowEditor : : : Workflow event triggered: WorkflowEvent [type=CONNECTION_ADDED;node=null;old=null;new=STD[0:170(1) -> 0:128( 2)];timestamp=Apr 11, 2019 1:21:30 PM] 2019-04-11 13:21:30,876 : DEBUG : KNIME-Node-Usage-Writer : NodeTimer$GlobalNodeStats : : : Successfully wrote node usage stats to file: C:\Users\tk173537\Knime-Workspace\.metadata\knime\nodeusage_3.0.json 2019-04-11 13:21:30,918 : DEBUG : main : ConnectionContainerEditPart : : : refreshing visuals for: STD[0:170(1) -> 0:128( 2)] 2019-04-11 13:21:30,918 : DEBUG : main : ConnectionContainerEditPart : : : modelling info: bendpoints: 2019-04-11 13:21:30,921 : DEBUG : main : ConnectionContainerEditPart : : : refreshing visuals for: STD[0:170(1) -> 0:128( 2)] 2019-04-11 13:21:30,921 : DEBUG : main : ConnectionContainerEditPart : : : modelling info: bendpoints: 2019-04-11 13:21:33,607 : DEBUG : main : NodeContainerEditPart : : : Data Generator 0:170 (EXECUTED) 2019-04-11 13:21:33,607 : DEBUG : main : NodeContainerEditPart : : : Hive Loader 0:128 (CONFIGURED) 2019-04-11 13:22:16,904 : DEBUG : main : ExecuteAction : : : Creating execution job for 1 node(s)... 2019-04-11 13:22:16,904 : DEBUG : main : NodeContainer : : : Hive Loader 0:128 has new state: CONFIGURED_MARKEDFOREXEC 2019-04-11 13:22:16,905 : DEBUG : main : NodeContainer : : : Hive Loader 0:128 has new state: CONFIGURED_QUEUED 2019-04-11 13:22:16,906 : DEBUG : main : NodeContainer : : : KNIME_project 0 has new state: EXECUTING 2019-04-11 13:22:16,907 : DEBUG : KNIME-Worker-32 : WorkflowManager : Hive Loader : 0:128 : Hive Loader 0:128 doBeforePreExecution 2019-04-11 13:22:16,907 : DEBUG : KNIME-Worker-32 : NodeContainer : Hive Loader : 0:128 : Hive Loader 0:128 has new state: PREEXECUTE 2019-04-11 13:22:16,907 : DEBUG : KNIME-Worker-32 : WorkflowManager : Hive Loader : 0:128 : Hive Loader 0:128 doBeforeExecution 2019-04-11 13:22:16,911 : DEBUG : KNIME-Worker-32 : NodeContainer : Hive Loader : 0:128 : Hive Loader 0:128 has new state: EXECUTING 2019-04-11 13:22:16,913 : DEBUG : KNIME-Worker-32 : WorkflowDataRepository : Hive Loader : 0:128 : Adding handler 95f59317-8de0-4be9-a980-ab09c508a0a4 (Hive Loader 0:128: ) - 7 in total 2019-04-11 13:22:16,913 : DEBUG : KNIME-WFM-Parent-Notifier : NodeContainer : : : ROOT has new state: EXECUTING 2019-04-11 13:22:16,913 : DEBUG : KNIME-Worker-32 : LocalNodeExecutionJob : Hive Loader : 0:128 : Hive Loader 0:128 Start execute 2019-04-11 13:22:17,051 : DEBUG : KNIME-Worker-32 : AbstractLoaderNodeModel : Hive Loader : 0:128 : Start writing KNIME table to temporary file C:\Users\tk173537\AppData\Local\Temp\knime_KNIME_project93725\hive-import1969665e_ff00_42b3_bbcc_115852cdd31e2185620745091365086.csv 2019-04-11 13:22:17,051 : DEBUG : KNIME-Worker-32 : AbstractLoaderNodeModel : Hive Loader : 0:128 : Table structure name=default,columns=[Universe_0_0; Universe_0_1; Universe_1_0; Universe_1_1; Cluster Membership] 2019-04-11 13:22:17,051 : DEBUG : KNIME-Worker-32 : AbstractLoaderNodeModel : Hive Loader : 0:128 : No of rows to write 100.0 2019-04-11 13:22:17,058 : DEBUG : KNIME-Worker-32 : AbstractLoaderNodeModel : Hive Loader : 0:128 : Temporary file successful created at C:\Users\tk173537\AppData\Local\Temp\knime_KNIME_project93725\hive-import1969665e_ff00_42b3_bbcc_115852cdd31e2185620745091365086.csv 2019-04-11 13:22:17,058 : DEBUG : KNIME-Worker-32 : HiveLoader : Hive Loader : 0:128 : Uploading local file C:\Users\tk173537\AppData\Local\Temp\knime_KNIME_project93725\hive-import1969665e_ff00_42b3_bbcc_115852cdd31e2185620745091365086.csv 2019-04-11 13:22:17,058 : DEBUG : KNIME-Worker-32 : HiveLoader : Hive Loader : 0:128 : Create remote folder with URI hdfs://tanul.kala@10.77.1.14:8020/apps/hive/warehouse/tanul_kala.db/ 2019-04-11 13:22:17,122 : DEBUG : KNIME-Worker-32 : HDFSConnection : Hive Loader : 0:128 : Adding fs.defaultFS to config: hdfs://10.77.1.14:8020/ 2019-04-11 13:22:17,122 : DEBUG : KNIME-Worker-32 : UserGroupUtil : Hive Loader : 0:128 : Retrieving user for simple authentication 2019-04-11 13:22:17,123 : DEBUG : KNIME-Worker-32 : UserGroupUtil : Hive Loader : 0:128 : Current user: tk173537 (auth:SIMPLE) 2019-04-11 13:22:17,123 : DEBUG : KNIME-Worker-32 : UserGroupUtil : Hive Loader : 0:128 : Login user: tanul.kala 2019-04-11 13:22:17,123 : DEBUG : KNIME-Worker-32 : UserGroupUtil : Hive Loader : 0:128 : Creating remote user tanul.kala using current user tk173537 2019-04-11 13:22:17,123 : DEBUG : KNIME-Worker-32 : UserGroupUtil : Hive Loader : 0:128 : Returning simple authentication user: tanul.kala (auth:SIMPLE) 2019-04-11 13:22:17,361 : DEBUG : KNIME-Worker-32 : HiveLoader : Hive Loader : 0:128 : Remote folder created 2019-04-11 13:22:17,362 : DEBUG : KNIME-Worker-32 : HiveLoader : Hive Loader : 0:128 : Create remote file with URI hdfs://tanul.kala@10.77.1.14:8020/apps/hive/warehouse/tanul_kala.db/hive-import1969665e_ff00_42b3_bbcc_115852cdd31e2185620745091365086.csv 2019-04-11 13:22:17,362 : DEBUG : KNIME-Worker-32 : HiveLoader : Hive Loader : 0:128 : Remote file created. Start writing file content... 2019-04-11 13:23:23,834 : DEBUG : main : NodeContainerEditPart : : : Hive Loader 0:128 (EXECUTING) 2019-04-11 13:23:32,745 : DEBUG : main : NodeContainerEditPart : : : Hive Loader 0:128 (EXECUTING) 2019-04-11 13:23:42,173 : ERROR : KNIME-Worker-32 : DFSClient : : : Failed to close inode 243883616 java.net.ConnectException: Connection timed out: no further information at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206) at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:531) at org.apache.hadoop.hdfs.DFSOutputStream.createSocketForPipeline(DFSOutputStream.java:1717) at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.createBlockOutputStream(DFSOutputStream.java:1447) at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1400) at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:554) 2019-04-11 13:23:42,181 : DEBUG : KNIME-Worker-32 : Node : Hive Loader : 0:128 : reset 2019-04-11 13:23:42,181 : ERROR : KNIME-Worker-32 : Node : Hive Loader : 0:128 : Execute failed: Connection timed out: no further information 2019-04-11 13:23:42,182 : DEBUG : KNIME-Worker-32 : Node : Hive Loader : 0:128 : Execute failed: Connection timed out: no further information java.net.ConnectException: Connection timed out: no further information at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206) at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:531) at org.apache.hadoop.hdfs.DFSOutputStream.createSocketForPipeline(DFSOutputStream.java:1717) at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.createBlockOutputStream(DFSOutputStream.java:1447) at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1400) at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:554) 2019-04-11 13:23:42,182 : DEBUG : KNIME-Worker-32 : WorkflowManager : Hive Loader : 0:128 : Hive Loader 0:128 doBeforePostExecution 2019-04-11 13:23:42,182 : DEBUG : KNIME-Worker-32 : NodeContainer : Hive Loader : 0:128 : Hive Loader 0:128 has new state: POSTEXECUTE 2019-04-11 13:23:42,183 : DEBUG : KNIME-Worker-32 : WorkflowManager : Hive Loader : 0:128 : Hive Loader 0:128 doAfterExecute - failure 2019-04-11 13:23:42,183 : DEBUG : KNIME-Worker-32 : Node : Hive Loader : 0:128 : reset 2019-04-11 13:23:42,183 : DEBUG : KNIME-Worker-32 : Node : Hive Loader : 0:128 : clean output ports. 2019-04-11 13:23:42,183 : DEBUG : KNIME-Worker-32 : WorkflowDataRepository : Hive Loader : 0:128 : Removing handler 95f59317-8de0-4be9-a980-ab09c508a0a4 (Hive Loader 0:128: ) - 6 remaining 2019-04-11 13:23:42,184 : DEBUG : KNIME-Worker-32 : NodeContainer : Hive Loader : 0:128 : Hive Loader 0:128 has new state: IDLE 2019-04-11 13:23:42,250 : DEBUG : KNIME-Worker-32 : Node : Hive Loader : 0:128 : Configure succeeded. (Hive Loader) 2019-04-11 13:23:42,250 : DEBUG : KNIME-Worker-32 : NodeContainer : Hive Loader : 0:128 : Hive Loader 0:128 has new state: CONFIGURED 2019-04-11 13:23:42,250 : DEBUG : KNIME-Worker-32 : NodeContainer : Hive Loader : 0:128 : KNIME_project 0 has new state: IDLE 2019-04-11 13:23:42,250 : DEBUG : KNIME-WFM-Parent-Notifier : NodeContainer : : : ROOT has new state: IDLE