2021-08-02 14:43:29 [INFO] Starting. 2021-08-02 14:43:29 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP119332/ 2021-08-02 14:43:29 [INFO] Creating new aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP119332/aggregate.hdf5 2021-08-02 14:43:29 [INFO] Using chromosome sizes at /grid/gillis/data/nfox/genomes/mus_musculus_10/mm10.chrom.sizes 2021-08-02 14:43:29 [INFO] Using only main chromosomes: chr1, chr2, chrX, chr3, chr4, chr5, chr6, chr7, chr10, chr8, chr14, chr9, chr11, chr13, chr12, chr15, chr16, chr17, chrY, chr18, chr19, chrM 2021-08-02 14:43:30 [INFO] Building aggregate. 2021-08-02 14:43:30 [INFO] Writing every 10 Runs. 2021-08-02 14:43:30 [INFO] Processing SRX3241592. (1/37) 2021-08-02 14:43:30 [INFO] Processing SRX3241592-SRR6129111. (1/37) 2021-08-02 14:43:37 [INFO] Processing SRX3241587. (2/37) 2021-08-02 14:43:37 [INFO] Processing SRX3241587-SRR6129106. (2/37) 2021-08-02 14:43:55 [INFO] Processing SRX3241604. (3/37) 2021-08-02 14:43:55 [INFO] Processing SRX3241604-SRR6129123. (3/37) 2021-08-02 14:44:05 [INFO] Processing SRX3241576. (4/37) 2021-08-02 14:44:05 [INFO] Processing SRX3241576-SRR6129095. (4/37) 2021-08-02 14:44:19 [INFO] Processing SRX3241573. (5/37) 2021-08-02 14:44:19 [INFO] Processing SRX3241573-SRR6129092. (5/37) 2021-08-02 14:44:28 [INFO] Processing SRX3241581. (6/37) 2021-08-02 14:44:28 [INFO] Processing SRX3241581-SRR6129100. (6/37) 2021-08-02 14:44:37 [INFO] Processing SRX3241607. (7/37) 2021-08-02 14:44:37 [INFO] Processing SRX3241607-SRR6129126. (7/37) 2021-08-02 14:44:45 [INFO] Processing SRX3241572. (8/37) 2021-08-02 14:44:45 [INFO] Processing SRX3241572-SRR6129091. (8/37) 2021-08-02 14:45:04 [INFO] Processing SRX3241583. (9/37) 2021-08-02 14:45:04 [INFO] Processing SRX3241583-SRR6129102. (9/37) 2021-08-02 14:45:13 [INFO] Processing SRX3241588. (10/37) 2021-08-02 14:45:13 [INFO] Processing SRX3241588-SRR6129107. (10/37) 2021-08-02 14:45:38 [INFO] Writing to disk... 2021-08-02 14:45:49 [INFO] Processing SRX3241579. (11/37) 2021-08-02 14:45:49 [INFO] Processing SRX3241579-SRR6129098. (11/37) 2021-08-02 14:46:03 [INFO] Processing SRX3241599. (12/37) 2021-08-02 14:46:03 [INFO] Processing SRX3241599-SRR6129118. (12/37) 2021-08-02 14:46:22 [INFO] Processing SRX3241601. (13/37) 2021-08-02 14:46:22 [INFO] Processing SRX3241601-SRR6129120. (13/37) 2021-08-02 14:46:31 [INFO] Processing SRX3241598. (14/37) 2021-08-02 14:46:31 [INFO] Processing SRX3241598-SRR6129117. (14/37) 2021-08-02 14:46:51 [INFO] Processing SRX3241600. (15/37) 2021-08-02 14:46:51 [INFO] Processing SRX3241600-SRR6129119. (15/37) 2021-08-02 14:47:00 [INFO] Processing SRX3241594. (16/37) 2021-08-02 14:47:00 [INFO] Processing SRX3241594-SRR6129113. (16/37) 2021-08-02 14:47:08 [INFO] Processing SRX3241595. (17/37) 2021-08-02 14:47:08 [INFO] Processing SRX3241595-SRR6129114. (17/37) 2021-08-02 14:47:14 [INFO] Processing SRX3241590. (18/37) 2021-08-02 14:47:14 [INFO] Processing SRX3241590-SRR6129109. (18/37) 2021-08-02 14:47:22 [INFO] Processing SRX3241586. (19/37) 2021-08-02 14:47:22 [INFO] Processing SRX3241586-SRR6129105. (19/37) 2021-08-02 14:47:30 [INFO] Processing SRX3241602. (20/37) 2021-08-02 14:47:30 [INFO] Processing SRX3241602-SRR6129121. (20/37) 2021-08-02 14:47:42 [INFO] Writing to disk... 2021-08-02 14:47:56 [INFO] Processing SRX3241575. (21/37) 2021-08-02 14:47:56 [INFO] Processing SRX3241575-SRR6129094. (21/37) 2021-08-02 14:48:05 [INFO] Processing SRX3241596. (22/37) 2021-08-02 14:48:05 [INFO] Processing SRX3241596-SRR6129115. (22/37) 2021-08-02 14:48:20 [INFO] Processing SRX3241593. (23/37) 2021-08-02 14:48:20 [INFO] Processing SRX3241593-SRR6129112. (23/37) 2021-08-02 14:48:28 [INFO] Processing SRX3241582. (24/37) 2021-08-02 14:48:28 [INFO] Processing SRX3241582-SRR6129101. (24/37) 2021-08-02 14:48:39 [INFO] Processing SRX3241571. (25/37) 2021-08-02 14:48:39 [INFO] Processing SRX3241571-SRR6129090. (25/37) 2021-08-02 14:48:55 [INFO] Processing SRX3241603. (26/37) 2021-08-02 14:48:55 [INFO] Processing SRX3241603-SRR6129122. (26/37) 2021-08-02 14:49:07 [INFO] Processing SRX3241584. (27/37) 2021-08-02 14:49:07 [INFO] Processing SRX3241584-SRR6129103. (27/37) 2021-08-02 14:49:09 [INFO] Processing SRX3241605. (28/37) 2021-08-02 14:49:09 [INFO] Processing SRX3241605-SRR6129124. (28/37) 2021-08-02 14:49:21 [INFO] Processing SRX3241580. (29/37) 2021-08-02 14:49:21 [INFO] Processing SRX3241580-SRR6129099. (29/37) 2021-08-02 14:49:38 [INFO] Processing SRX3241577. (30/37) 2021-08-02 14:49:38 [INFO] Processing SRX3241577-SRR6129096. (30/37) 2021-08-02 14:49:51 [INFO] Writing to disk... 2021-08-02 14:50:12 [INFO] Processing SRX3241585. (31/37) 2021-08-02 14:50:12 [INFO] Processing SRX3241585-SRR6129104. (31/37) 2021-08-02 14:50:15 [INFO] Processing SRX3241606. (32/37) 2021-08-02 14:50:15 [INFO] Processing SRX3241606-SRR6129125. (32/37) 2021-08-02 14:50:25 [INFO] Processing SRX3241597. (33/37) 2021-08-02 14:50:25 [INFO] Processing SRX3241597-SRR6129116. (33/37) 2021-08-02 14:50:40 [INFO] Processing SRX3241589. (34/37) 2021-08-02 14:50:40 [INFO] Processing SRX3241589-SRR6129108. (34/37) 2021-08-02 14:51:12 [INFO] Processing SRX3241591. (35/37) 2021-08-02 14:51:12 [INFO] Processing SRX3241591-SRR6129110. (35/37) 2021-08-02 14:51:21 [INFO] Processing SRX3241574. (36/37) 2021-08-02 14:51:21 [INFO] Processing SRX3241574-SRR6129093. (36/37) 2021-08-02 14:51:33 [INFO] Processing SRX3241578. (37/37) 2021-08-02 14:51:33 [INFO] Processing SRX3241578-SRR6129097. (37/37) 2021-08-02 14:51:46 [INFO] Writing to disk... 2021-08-02 14:52:04 [INFO] Finished. 2021-08-12 14:31:21 [INFO] Starting. 2021-08-12 14:31:21 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP119332/ 2021-08-12 14:31:21 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP119332/aggregate.hdf5 2021-08-12 14:31:21 [WARNING] chroms=/grid/gillis/data/nfox/genomes/mus_musculus_10/mm10.chrom.sizes is ignored due to existing aggregate. 2021-08-12 14:31:21 [INFO] Building aggregate for 40kbp_raw network. 2021-08-12 14:31:21 [INFO] Writing every 10 Runs. 2021-08-12 14:31:22 [INFO] Processing SRX3241592. (1/37) 2021-08-12 14:31:22 [INFO] Processing SRX3241592-SRR6129111. (1/37) 2021-08-12 14:31:27 [INFO] Processing SRX3241587. (2/37) 2021-08-12 14:31:27 [INFO] Processing SRX3241587-SRR6129106. (2/37) 2021-08-12 14:31:46 [INFO] Processing SRX3241604. (3/37) 2021-08-12 14:31:46 [INFO] Processing SRX3241604-SRR6129123. (3/37) 2021-08-12 14:31:59 [INFO] Processing SRX3241576. (4/37) 2021-08-12 14:31:59 [INFO] Processing SRX3241576-SRR6129095. (4/37) 2021-08-12 14:32:16 [INFO] Processing SRX3241573. (5/37) 2021-08-12 14:32:16 [INFO] Processing SRX3241573-SRR6129092. (5/37) 2021-08-12 14:32:27 [INFO] Processing SRX3241581. (6/37) 2021-08-12 14:32:27 [INFO] Processing SRX3241581-SRR6129100. (6/37) 2021-08-12 14:32:41 [INFO] Processing SRX3241607. (7/37) 2021-08-12 14:32:41 [INFO] Processing SRX3241607-SRR6129126. (7/37) 2021-08-12 14:32:49 [INFO] Processing SRX3241572. (8/37) 2021-08-12 14:32:49 [INFO] Processing SRX3241572-SRR6129091. (8/37) 2021-08-12 14:33:09 [INFO] Processing SRX3241583. (9/37) 2021-08-12 14:33:09 [INFO] Processing SRX3241583-SRR6129102. (9/37) 2021-08-12 14:33:21 [INFO] Processing SRX3241588. (10/37) 2021-08-12 14:33:21 [INFO] Processing SRX3241588-SRR6129107. (10/37) 2021-08-12 14:33:54 [INFO] Writing to disk... 2021-08-12 14:34:05 [INFO] Processing SRX3241579. (11/37) 2021-08-12 14:34:05 [INFO] Processing SRX3241579-SRR6129098. (11/37) 2021-08-12 14:34:23 [INFO] Processing SRX3241599. (12/37) 2021-08-12 14:34:23 [INFO] Processing SRX3241599-SRR6129118. (12/37) 2021-08-12 14:34:41 [INFO] Processing SRX3241601. (13/37) 2021-08-12 14:34:41 [INFO] Processing SRX3241601-SRR6129120. (13/37) 2021-08-12 14:34:51 [INFO] Processing SRX3241598. (14/37) 2021-08-12 14:34:51 [INFO] Processing SRX3241598-SRR6129117. (14/37) 2021-08-12 14:35:11 [INFO] Processing SRX3241600. (15/37) 2021-08-12 14:35:11 [INFO] Processing SRX3241600-SRR6129119. (15/37) 2021-08-12 14:35:22 [INFO] Processing SRX3241594. (16/37) 2021-08-12 14:35:22 [INFO] Processing SRX3241594-SRR6129113. (16/37) 2021-08-12 14:35:31 [INFO] Processing SRX3241595. (17/37) 2021-08-12 14:35:31 [INFO] Processing SRX3241595-SRR6129114. (17/37) 2021-08-12 14:35:38 [INFO] Processing SRX3241590. (18/37) 2021-08-12 14:35:38 [INFO] Processing SRX3241590-SRR6129109. (18/37) 2021-08-12 14:35:48 [INFO] Processing SRX3241586. (19/37) 2021-08-12 14:35:48 [INFO] Processing SRX3241586-SRR6129105. (19/37) 2021-08-12 14:35:58 [INFO] Processing SRX3241602. (20/37) 2021-08-12 14:35:58 [INFO] Processing SRX3241602-SRR6129121. (20/37) 2021-08-12 14:36:10 [INFO] Writing to disk... 2021-08-12 14:36:28 [INFO] Processing SRX3241575. (21/37) 2021-08-12 14:36:28 [INFO] Processing SRX3241575-SRR6129094. (21/37) 2021-08-12 14:36:38 [INFO] Processing SRX3241596. (22/37) 2021-08-12 14:36:38 [INFO] Processing SRX3241596-SRR6129115. (22/37) 2021-08-12 14:36:54 [INFO] Processing SRX3241593. (23/37) 2021-08-12 14:36:54 [INFO] Processing SRX3241593-SRR6129112. (23/37) 2021-08-12 14:37:02 [INFO] Processing SRX3241582. (24/37) 2021-08-12 14:37:02 [INFO] Processing SRX3241582-SRR6129101. (24/37) 2021-08-12 14:37:13 [INFO] Processing SRX3241571. (25/37) 2021-08-12 14:37:13 [INFO] Processing SRX3241571-SRR6129090. (25/37) 2021-08-12 14:37:31 [INFO] Processing SRX3241603. (26/37) 2021-08-12 14:37:31 [INFO] Processing SRX3241603-SRR6129122. (26/37) 2021-08-12 14:37:45 [INFO] Processing SRX3241584. (27/37) 2021-08-12 14:37:45 [INFO] Processing SRX3241584-SRR6129103. (27/37) 2021-08-12 14:37:47 [INFO] Processing SRX3241605. (28/37) 2021-08-12 14:37:47 [INFO] Processing SRX3241605-SRR6129124. (28/37) 2021-08-12 14:37:58 [INFO] Processing SRX3241580. (29/37) 2021-08-12 14:37:58 [INFO] Processing SRX3241580-SRR6129099. (29/37) 2021-08-12 14:38:15 [INFO] Processing SRX3241577. (30/37) 2021-08-12 14:38:15 [INFO] Processing SRX3241577-SRR6129096. (30/37) 2021-08-12 14:38:31 [INFO] Writing to disk... 2021-08-12 14:38:49 [INFO] Processing SRX3241585. (31/37) 2021-08-12 14:38:49 [INFO] Processing SRX3241585-SRR6129104. (31/37) 2021-08-12 14:38:52 [INFO] Processing SRX3241606. (32/37) 2021-08-12 14:38:52 [INFO] Processing SRX3241606-SRR6129125. (32/37) 2021-08-12 14:39:01 [INFO] Processing SRX3241597. (33/37) 2021-08-12 14:39:01 [INFO] Processing SRX3241597-SRR6129116. (33/37) 2021-08-12 14:39:15 [INFO] Processing SRX3241589. (34/37) 2021-08-12 14:39:15 [INFO] Processing SRX3241589-SRR6129108. (34/37) 2021-08-12 14:39:48 [INFO] Processing SRX3241591. (35/37) 2021-08-12 14:39:48 [INFO] Processing SRX3241591-SRR6129110. (35/37) 2021-08-12 14:39:58 [INFO] Processing SRX3241574. (36/37) 2021-08-12 14:39:58 [INFO] Processing SRX3241574-SRR6129093. (36/37) 2021-08-12 14:40:11 [INFO] Processing SRX3241578. (37/37) 2021-08-12 14:40:11 [INFO] Processing SRX3241578-SRR6129097. (37/37) 2021-08-12 14:40:27 [INFO] Writing to disk... 2021-08-12 14:40:49 [INFO] Finished. 2021-08-12 16:35:40 [INFO] Starting. 2021-08-12 16:35:40 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP119332/ 2021-08-12 16:35:40 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP119332/aggregate.hdf5 2021-08-12 16:35:40 [WARNING] chroms=/grid/gillis/data/nfox/genomes/mus_musculus_10/mm10.chrom.sizes is ignored due to existing aggregate. 2021-08-12 16:35:41 [INFO] Building aggregate for 25kbp_raw network. 2021-08-12 16:35:41 [INFO] Writing every 10 Runs. 2021-08-12 16:35:41 [INFO] Processing SRX3241592. (1/37) 2021-08-12 16:35:41 [INFO] Processing SRX3241592-SRR6129111. (1/37) 2021-08-12 16:35:49 [INFO] Processing SRX3241587. (2/37) 2021-08-12 16:35:49 [INFO] Processing SRX3241587-SRR6129106. (2/37) 2021-08-12 16:36:16 [INFO] Processing SRX3241604. (3/37) 2021-08-12 16:36:16 [INFO] Processing SRX3241604-SRR6129123. (3/37) 2021-08-12 16:36:28 [INFO] Processing SRX3241576. (4/37) 2021-08-12 16:36:28 [INFO] Processing SRX3241576-SRR6129095. (4/37) 2021-08-12 16:36:43 [INFO] Processing SRX3241573. (5/37) 2021-08-12 16:36:43 [INFO] Processing SRX3241573-SRR6129092. (5/37) 2021-08-12 16:36:54 [INFO] Processing SRX3241581. (6/37) 2021-08-12 16:36:54 [INFO] Processing SRX3241581-SRR6129100. (6/37) 2021-08-12 16:37:05 [INFO] Processing SRX3241607. (7/37) 2021-08-12 16:37:05 [INFO] Processing SRX3241607-SRR6129126. (7/37) 2021-08-12 16:37:13 [INFO] Processing SRX3241572. (8/37) 2021-08-12 16:37:13 [INFO] Processing SRX3241572-SRR6129091. (8/37) 2021-08-12 16:37:34 [INFO] Processing SRX3241583. (9/37) 2021-08-12 16:37:34 [INFO] Processing SRX3241583-SRR6129102. (9/37) 2021-08-12 16:37:47 [INFO] Processing SRX3241588. (10/37) 2021-08-12 16:37:47 [INFO] Processing SRX3241588-SRR6129107. (10/37) 2021-08-12 16:38:26 [INFO] Writing to disk... 2021-08-12 16:38:38 [INFO] Processing SRX3241579. (11/37) 2021-08-12 16:38:38 [INFO] Processing SRX3241579-SRR6129098. (11/37) 2021-08-12 16:38:54 [INFO] Processing SRX3241599. (12/37) 2021-08-12 16:38:54 [INFO] Processing SRX3241599-SRR6129118. (12/37) 2021-08-12 16:39:12 [INFO] Processing SRX3241601. (13/37) 2021-08-12 16:39:12 [INFO] Processing SRX3241601-SRR6129120. (13/37) 2021-08-12 16:39:22 [INFO] Processing SRX3241598. (14/37) 2021-08-12 16:39:22 [INFO] Processing SRX3241598-SRR6129117. (14/37) 2021-08-12 16:39:40 [INFO] Processing SRX3241600. (15/37) 2021-08-12 16:39:40 [INFO] Processing SRX3241600-SRR6129119. (15/37) 2021-08-12 16:39:50 [INFO] Processing SRX3241594. (16/37) 2021-08-12 16:39:50 [INFO] Processing SRX3241594-SRR6129113. (16/37) 2021-08-12 16:39:58 [INFO] Processing SRX3241595. (17/37) 2021-08-12 16:39:58 [INFO] Processing SRX3241595-SRR6129114. (17/37) 2021-08-12 16:40:05 [INFO] Processing SRX3241590. (18/37) 2021-08-12 16:40:05 [INFO] Processing SRX3241590-SRR6129109. (18/37) 2021-08-12 16:40:14 [INFO] Processing SRX3241586. (19/37) 2021-08-12 16:40:14 [INFO] Processing SRX3241586-SRR6129105. (19/37) 2021-08-12 16:40:23 [INFO] Processing SRX3241602. (20/37) 2021-08-12 16:40:23 [INFO] Processing SRX3241602-SRR6129121. (20/37) 2021-08-12 16:40:39 [INFO] Writing to disk... 2021-08-12 16:40:56 [INFO] Processing SRX3241575. (21/37) 2021-08-12 16:40:56 [INFO] Processing SRX3241575-SRR6129094. (21/37) 2021-08-12 16:41:11 [INFO] Processing SRX3241596. (22/37) 2021-08-12 16:41:11 [INFO] Processing SRX3241596-SRR6129115. (22/37) 2021-08-12 16:41:30 [INFO] Processing SRX3241593. (23/37) 2021-08-12 16:41:30 [INFO] Processing SRX3241593-SRR6129112. (23/37) 2021-08-12 16:41:38 [INFO] Processing SRX3241582. (24/37) 2021-08-12 16:41:38 [INFO] Processing SRX3241582-SRR6129101. (24/37) 2021-08-12 16:41:51 [INFO] Processing SRX3241571. (25/37) 2021-08-12 16:41:51 [INFO] Processing SRX3241571-SRR6129090. (25/37) 2021-08-12 16:42:07 [INFO] Processing SRX3241603. (26/37) 2021-08-12 16:42:07 [INFO] Processing SRX3241603-SRR6129122. (26/37) 2021-08-12 16:42:20 [INFO] Processing SRX3241584. (27/37) 2021-08-12 16:42:20 [INFO] Processing SRX3241584-SRR6129103. (27/37) 2021-08-12 16:42:21 [INFO] Processing SRX3241605. (28/37) 2021-08-12 16:42:21 [INFO] Processing SRX3241605-SRR6129124. (28/37) 2021-08-12 16:42:32 [INFO] Processing SRX3241580. (29/37) 2021-08-12 16:42:32 [INFO] Processing SRX3241580-SRR6129099. (29/37) 2021-08-12 16:42:49 [INFO] Processing SRX3241577. (30/37) 2021-08-12 16:42:49 [INFO] Processing SRX3241577-SRR6129096. (30/37) 2021-08-12 16:43:03 [INFO] Writing to disk... 2021-08-12 16:43:22 [INFO] Processing SRX3241585. (31/37) 2021-08-12 16:43:22 [INFO] Processing SRX3241585-SRR6129104. (31/37) 2021-08-12 16:43:25 [INFO] Processing SRX3241606. (32/37) 2021-08-12 16:43:25 [INFO] Processing SRX3241606-SRR6129125. (32/37) 2021-08-12 16:43:35 [INFO] Processing SRX3241597. (33/37) 2021-08-12 16:43:35 [INFO] Processing SRX3241597-SRR6129116. (33/37) 2021-08-12 16:43:49 [INFO] Processing SRX3241589. (34/37) 2021-08-12 16:43:49 [INFO] Processing SRX3241589-SRR6129108. (34/37) 2021-08-12 16:44:22 [INFO] Processing SRX3241591. (35/37) 2021-08-12 16:44:22 [INFO] Processing SRX3241591-SRR6129110. (35/37) 2021-08-12 16:44:29 [INFO] Processing SRX3241574. (36/37) 2021-08-12 16:44:29 [INFO] Processing SRX3241574-SRR6129093. (36/37) 2021-08-12 16:44:42 [INFO] Processing SRX3241578. (37/37) 2021-08-12 16:44:42 [INFO] Processing SRX3241578-SRR6129097. (37/37) 2021-08-12 16:44:59 [INFO] Writing to disk... 2021-08-12 16:45:20 [INFO] Finished. 2021-08-13 09:44:55 [INFO] Starting. 2021-08-13 09:44:55 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP119332/ 2021-08-13 09:44:55 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP119332/aggregate.hdf5 2021-08-13 09:44:55 [WARNING] chroms=/grid/gillis/data/nfox/genomes/mus_musculus_10/mm10.chrom.sizes is ignored due to existing aggregate. 2021-08-13 09:44:56 [INFO] Building aggregate for 5kbp_raw network. 2021-08-13 09:44:56 [INFO] Writing every 10 Runs. 2021-08-13 09:44:56 [INFO] Processing SRX3241592. (1/37) 2021-08-13 09:44:56 [INFO] Processing SRX3241592-SRR6129111. (1/37) 2021-08-13 09:45:02 [INFO] Processing SRX3241587. (2/37) 2021-08-13 09:45:02 [INFO] Processing SRX3241587-SRR6129106. (2/37) 2021-08-13 09:45:19 [INFO] Processing SRX3241604. (3/37) 2021-08-13 09:45:19 [INFO] Processing SRX3241604-SRR6129123. (3/37) 2021-08-13 09:45:29 [INFO] Processing SRX3241576. (4/37) 2021-08-13 09:45:29 [INFO] Processing SRX3241576-SRR6129095. (4/37) 2021-08-13 09:45:39 [INFO] Processing SRX3241573. (5/37) 2021-08-13 09:45:39 [INFO] Processing SRX3241573-SRR6129092. (5/37) 2021-08-13 09:45:46 [INFO] Processing SRX3241581. (6/37) 2021-08-13 09:45:46 [INFO] Processing SRX3241581-SRR6129100. (6/37) 2021-08-13 09:45:55 [INFO] Processing SRX3241607. (7/37) 2021-08-13 09:45:55 [INFO] Processing SRX3241607-SRR6129126. (7/37) 2021-08-13 09:46:00 [INFO] Processing SRX3241572. (8/37) 2021-08-13 09:46:00 [INFO] Processing SRX3241572-SRR6129091. (8/37) 2021-08-13 09:46:15 [INFO] Processing SRX3241583. (9/37) 2021-08-13 09:46:15 [INFO] Processing SRX3241583-SRR6129102. (9/37) 2021-08-13 09:46:24 [INFO] Processing SRX3241588. (10/37) 2021-08-13 09:46:24 [INFO] Processing SRX3241588-SRR6129107. (10/37) 2021-08-13 09:46:52 [INFO] Writing to disk... 2021-08-13 09:47:05 [INFO] Processing SRX3241579. (11/37) 2021-08-13 09:47:05 [INFO] Processing SRX3241579-SRR6129098. (11/37) 2021-08-13 09:47:17 [INFO] Processing SRX3241599. (12/37) 2021-08-13 09:47:17 [INFO] Processing SRX3241599-SRR6129118. (12/37) 2021-08-13 09:47:33 [INFO] Processing SRX3241601. (13/37) 2021-08-13 09:47:33 [INFO] Processing SRX3241601-SRR6129120. (13/37) 2021-08-13 09:47:41 [INFO] Processing SRX3241598. (14/37) 2021-08-13 09:47:41 [INFO] Processing SRX3241598-SRR6129117. (14/37) 2021-08-13 09:47:56 [INFO] Processing SRX3241600. (15/37) 2021-08-13 09:47:56 [INFO] Processing SRX3241600-SRR6129119. (15/37) 2021-08-13 09:48:06 [INFO] Processing SRX3241594. (16/37) 2021-08-13 09:48:06 [INFO] Processing SRX3241594-SRR6129113. (16/37) 2021-08-13 09:48:14 [INFO] Processing SRX3241595. (17/37) 2021-08-13 09:48:14 [INFO] Processing SRX3241595-SRR6129114. (17/37) 2021-08-13 09:48:21 [INFO] Processing SRX3241590. (18/37) 2021-08-13 09:48:21 [INFO] Processing SRX3241590-SRR6129109. (18/37) 2021-08-13 09:48:29 [INFO] Processing SRX3241586. (19/37) 2021-08-13 09:48:29 [INFO] Processing SRX3241586-SRR6129105. (19/37) 2021-08-13 09:48:39 [INFO] Processing SRX3241602. (20/37) 2021-08-13 09:48:39 [INFO] Processing SRX3241602-SRR6129121. (20/37) 2021-08-13 09:48:49 [INFO] Writing to disk... 2021-08-13 09:49:06 [INFO] Processing SRX3241575. (21/37) 2021-08-13 09:49:06 [INFO] Processing SRX3241575-SRR6129094. (21/37) 2021-08-13 09:49:16 [INFO] Processing SRX3241596. (22/37) 2021-08-13 09:49:16 [INFO] Processing SRX3241596-SRR6129115. (22/37) 2021-08-13 09:49:30 [INFO] Processing SRX3241593. (23/37) 2021-08-13 09:49:30 [INFO] Processing SRX3241593-SRR6129112. (23/37) 2021-08-13 09:49:38 [INFO] Processing SRX3241582. (24/37) 2021-08-13 09:49:38 [INFO] Processing SRX3241582-SRR6129101. (24/37) 2021-08-13 09:49:51 [INFO] Processing SRX3241571. (25/37) 2021-08-13 09:49:51 [INFO] Processing SRX3241571-SRR6129090. (25/37) 2021-08-13 09:50:09 [INFO] Processing SRX3241603. (26/37) 2021-08-13 09:50:09 [INFO] Processing SRX3241603-SRR6129122. (26/37) 2021-08-13 09:50:23 [INFO] Processing SRX3241584. (27/37) 2021-08-13 09:50:23 [INFO] Processing SRX3241584-SRR6129103. (27/37) 2021-08-13 09:50:26 [INFO] Processing SRX3241605. (28/37) 2021-08-13 09:50:26 [INFO] Processing SRX3241605-SRR6129124. (28/37) 2021-08-13 09:50:36 [INFO] Processing SRX3241580. (29/37) 2021-08-13 09:50:36 [INFO] Processing SRX3241580-SRR6129099. (29/37) 2021-08-13 09:50:46 [INFO] Processing SRX3241577. (30/37) 2021-08-13 09:50:46 [INFO] Processing SRX3241577-SRR6129096. (30/37) 2021-08-13 09:51:03 [INFO] Writing to disk... 2021-08-13 09:51:25 [INFO] Processing SRX3241585. (31/37) 2021-08-13 09:51:25 [INFO] Processing SRX3241585-SRR6129104. (31/37) 2021-08-13 09:51:29 [INFO] Processing SRX3241606. (32/37) 2021-08-13 09:51:29 [INFO] Processing SRX3241606-SRR6129125. (32/37) 2021-08-13 09:51:40 [INFO] Processing SRX3241597. (33/37) 2021-08-13 09:51:40 [INFO] Processing SRX3241597-SRR6129116. (33/37) 2021-08-13 09:51:56 [INFO] Processing SRX3241589. (34/37) 2021-08-13 09:51:56 [INFO] Processing SRX3241589-SRR6129108. (34/37) 2021-08-13 09:52:27 [INFO] Processing SRX3241591. (35/37) 2021-08-13 09:52:27 [INFO] Processing SRX3241591-SRR6129110. (35/37) 2021-08-13 09:52:36 [INFO] Processing SRX3241574. (36/37) 2021-08-13 09:52:36 [INFO] Processing SRX3241574-SRR6129093. (36/37) 2021-08-13 09:52:47 [INFO] Processing SRX3241578. (37/37) 2021-08-13 09:52:47 [INFO] Processing SRX3241578-SRR6129097. (37/37) 2021-08-13 09:53:02 [INFO] Writing to disk... 2021-08-13 09:53:26 [INFO] Finished. 2021-08-13 17:23:58 [INFO] Starting. 2021-08-13 17:23:58 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP119332/ 2021-08-13 17:23:58 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP119332/aggregate.hdf5 2021-08-13 17:23:58 [WARNING] chroms=/grid/gillis/data/nfox/genomes/mus_musculus_10/mm10.chrom.sizes is ignored due to existing aggregate. 2021-08-13 17:23:59 [INFO] Building aggregate for 1kbp_raw network. 2021-08-13 17:23:59 [INFO] Writing every 10 Runs. 2021-08-13 17:23:59 [INFO] Processing SRX3241592. (1/37) 2021-08-13 17:23:59 [INFO] Processing SRX3241592-SRR6129111. (1/37) 2021-08-13 17:24:08 [INFO] Processing SRX3241587. (2/37) 2021-08-13 17:24:08 [INFO] Processing SRX3241587-SRR6129106. (2/37) 2021-08-13 17:24:41 [INFO] Processing SRX3241604. (3/37) 2021-08-13 17:24:41 [INFO] Processing SRX3241604-SRR6129123. (3/37) 2021-08-13 17:24:57 [INFO] Processing SRX3241576. (4/37) 2021-08-13 17:24:57 [INFO] Processing SRX3241576-SRR6129095. (4/37) 2021-08-13 17:25:19 [INFO] Processing SRX3241573. (5/37) 2021-08-13 17:25:19 [INFO] Processing SRX3241573-SRR6129092. (5/37) 2021-08-13 17:25:34 [INFO] Processing SRX3241581. (6/37) 2021-08-13 17:25:34 [INFO] Processing SRX3241581-SRR6129100. (6/37) 2021-08-13 17:25:51 [INFO] Processing SRX3241607. (7/37) 2021-08-13 17:25:51 [INFO] Processing SRX3241607-SRR6129126. (7/37) 2021-08-13 17:26:02 [INFO] Processing SRX3241572. (8/37) 2021-08-13 17:26:02 [INFO] Processing SRX3241572-SRR6129091. (8/37) 2021-08-13 17:26:27 [INFO] Processing SRX3241583. (9/37) 2021-08-13 17:26:27 [INFO] Processing SRX3241583-SRR6129102. (9/37) 2021-08-13 17:26:45 [INFO] Processing SRX3241588. (10/37) 2021-08-13 17:26:45 [INFO] Processing SRX3241588-SRR6129107. (10/37) 2021-08-13 17:27:23 [INFO] Writing to disk... 2021-08-13 17:27:44 [INFO] Processing SRX3241579. (11/37) 2021-08-13 17:27:44 [INFO] Processing SRX3241579-SRR6129098. (11/37) 2021-08-13 17:28:08 [INFO] Processing SRX3241599. (12/37) 2021-08-13 17:28:08 [INFO] Processing SRX3241599-SRR6129118. (12/37) 2021-08-13 17:28:34 [INFO] Processing SRX3241601. (13/37) 2021-08-13 17:28:34 [INFO] Processing SRX3241601-SRR6129120. (13/37) 2021-08-13 17:28:52 [INFO] Processing SRX3241598. (14/37) 2021-08-13 17:28:52 [INFO] Processing SRX3241598-SRR6129117. (14/37) 2021-08-13 17:29:23 [INFO] Processing SRX3241600. (15/37) 2021-08-13 17:29:23 [INFO] Processing SRX3241600-SRR6129119. (15/37) 2021-08-13 17:29:40 [INFO] Processing SRX3241594. (16/37) 2021-08-13 17:29:40 [INFO] Processing SRX3241594-SRR6129113. (16/37) 2021-08-13 17:29:53 [INFO] Processing SRX3241595. (17/37) 2021-08-13 17:29:53 [INFO] Processing SRX3241595-SRR6129114. (17/37) 2021-08-13 17:30:06 [INFO] Processing SRX3241590. (18/37) 2021-08-13 17:30:06 [INFO] Processing SRX3241590-SRR6129109. (18/37) 2021-08-13 17:30:21 [INFO] Processing SRX3241586. (19/37) 2021-08-13 17:30:21 [INFO] Processing SRX3241586-SRR6129105. (19/37) 2021-08-13 17:30:40 [INFO] Processing SRX3241602. (20/37) 2021-08-13 17:30:40 [INFO] Processing SRX3241602-SRR6129121. (20/37) 2021-08-13 17:30:58 [INFO] Writing to disk... 2021-08-13 17:31:25 [INFO] Processing SRX3241575. (21/37) 2021-08-13 17:31:25 [INFO] Processing SRX3241575-SRR6129094. (21/37) 2021-08-13 17:31:44 [INFO] Processing SRX3241596. (22/37) 2021-08-13 17:31:44 [INFO] Processing SRX3241596-SRR6129115. (22/37) 2021-08-13 17:32:11 [INFO] Processing SRX3241593. (23/37) 2021-08-13 17:32:11 [INFO] Processing SRX3241593-SRR6129112. (23/37) 2021-08-13 17:32:28 [INFO] Processing SRX3241582. (24/37) 2021-08-13 17:32:28 [INFO] Processing SRX3241582-SRR6129101. (24/37) 2021-08-13 17:32:49 [INFO] Processing SRX3241571. (25/37) 2021-08-13 17:32:49 [INFO] Processing SRX3241571-SRR6129090. (25/37) 2021-08-13 17:33:20 [INFO] Processing SRX3241603. (26/37) 2021-08-13 17:33:20 [INFO] Processing SRX3241603-SRR6129122. (26/37) 2021-08-13 17:33:40 [INFO] Processing SRX3241584. (27/37) 2021-08-13 17:33:40 [INFO] Processing SRX3241584-SRR6129103. (27/37) 2021-08-13 17:33:45 [INFO] Processing SRX3241605. (28/37) 2021-08-13 17:33:45 [INFO] Processing SRX3241605-SRR6129124. (28/37) 2021-08-13 17:34:06 [INFO] Processing SRX3241580. (29/37) 2021-08-13 17:34:06 [INFO] Processing SRX3241580-SRR6129099. (29/37) 2021-08-13 17:34:28 [INFO] Processing SRX3241577. (30/37) 2021-08-13 17:34:28 [INFO] Processing SRX3241577-SRR6129096. (30/37) 2021-08-13 17:34:57 [INFO] Writing to disk... 2021-08-13 17:35:33 [INFO] Processing SRX3241585. (31/37) 2021-08-13 17:35:33 [INFO] Processing SRX3241585-SRR6129104. (31/37) 2021-08-13 17:35:42 [INFO] Processing SRX3241606. (32/37) 2021-08-13 17:35:42 [INFO] Processing SRX3241606-SRR6129125. (32/37) 2021-08-13 17:36:00 [INFO] Processing SRX3241597. (33/37) 2021-08-13 17:36:00 [INFO] Processing SRX3241597-SRR6129116. (33/37) 2021-08-13 17:36:28 [INFO] Processing SRX3241589. (34/37) 2021-08-13 17:36:28 [INFO] Processing SRX3241589-SRR6129108. (34/37) 2021-08-13 17:37:13 [INFO] Processing SRX3241591. (35/37) 2021-08-13 17:37:13 [INFO] Processing SRX3241591-SRR6129110. (35/37) 2021-08-13 17:37:29 [INFO] Processing SRX3241574. (36/37) 2021-08-13 17:37:29 [INFO] Processing SRX3241574-SRR6129093. (36/37) 2021-08-13 17:37:49 [INFO] Processing SRX3241578. (37/37) 2021-08-13 17:37:49 [INFO] Processing SRX3241578-SRR6129097. (37/37) 2021-08-13 17:38:21 [INFO] Writing to disk... 2021-08-13 17:38:59 [INFO] Finished. 2021-08-16 11:36:46 [INFO] Starting. 2021-08-16 11:36:46 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP119332/ 2021-08-16 11:36:46 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP119332/aggregate.hdf5 2021-08-16 11:36:46 [WARNING] chroms=/grid/gillis/data/nfox/genomes/mus_musculus_10/mm10.chrom.sizes is ignored due to existing aggregate. 2021-08-16 11:36:46 [INFO] Building aggregate for 1bp_raw network. 2021-08-16 11:36:46 [INFO] Writing every 10 Runs. 2021-08-16 11:36:46 [INFO] Processing SRX3241592. (1/37) 2021-08-16 11:36:46 [INFO] Processing SRX3241592-SRR6129111. (1/37) 2021-08-16 11:44:18 [INFO] Processing SRX3241587. (2/37) 2021-08-16 11:44:18 [INFO] Processing SRX3241587-SRR6129106. (2/37) 2021-08-16 11:50:19 [ERROR] Adding SRR6129106:chr17_vs_chr7 to in memory aggregate failed. Error message: Traceback (most recent call last): File "/grid/gillis/data/nfox/hi_c_data_processing/software/aggregate.py", line 445, in add_dataset aggregate_data[c] = aggregate_data[c] + net File "/grid/gillis/home/nfox/software/miniconda3/lib/python3.8/site-packages/scipy/sparse/base.py", line 415, in __add__ return self._add_sparse(other) File "/grid/gillis/home/nfox/software/miniconda3/lib/python3.8/site-packages/scipy/sparse/compressed.py", line 359, in _add_sparse return self._binopt(other, '_plus_') File "/grid/gillis/home/nfox/software/miniconda3/lib/python3.8/site-packages/scipy/sparse/compressed.py", line 1226, in _binopt indptr = np.empty(self.indptr.shape, dtype=idx_dtype) MemoryError: Unable to allocate 362. MiB for an array with shape (94987272,) and data type int32 2021-08-16 23:37:58 [INFO] Starting. 2021-08-16 23:37:58 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP119332/ 2021-08-16 23:37:58 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP119332/aggregate.hdf5 2021-08-16 23:37:58 [WARNING] chroms=/grid/gillis/data/nfox/genomes/mus_musculus_10/mm10.chrom.sizes is ignored due to existing aggregate. 2021-08-16 23:37:58 [INFO] Building aggregate for 1bp_raw network. 2021-08-16 23:37:58 [INFO] Writing every 10 Runs. 2021-08-16 23:37:58 [INFO] Processing SRX3241592. (1/37) 2021-08-16 23:37:58 [INFO] Processing SRX3241592-SRR6129111. (1/37) 2021-08-16 23:41:30 [INFO] Processing SRX3241587. (2/37) 2021-08-16 23:41:30 [INFO] Processing SRX3241587-SRR6129106. (2/37) 2021-08-16 23:48:32 [INFO] Processing SRX3241604. (3/37) 2021-08-16 23:48:32 [INFO] Processing SRX3241604-SRR6129123. (3/37) 2021-08-16 23:55:31 [INFO] Processing SRX3241576. (4/37) 2021-08-16 23:55:31 [INFO] Processing SRX3241576-SRR6129095. (4/37) 2021-08-17 00:02:29 [INFO] Processing SRX3241573. (5/37) 2021-08-17 00:02:29 [INFO] Processing SRX3241573-SRR6129092. (5/37) 2021-08-17 00:09:10 [INFO] Processing SRX3241581. (6/37) 2021-08-17 00:09:10 [INFO] Processing SRX3241581-SRR6129100. (6/37) 2021-08-17 00:16:01 [INFO] Processing SRX3241607. (7/37) 2021-08-17 00:16:01 [INFO] Processing SRX3241607-SRR6129126. (7/37) 2021-08-17 00:23:11 [INFO] Processing SRX3241572. (8/37) 2021-08-17 00:23:11 [INFO] Processing SRX3241572-SRR6129091. (8/37) 2021-08-17 00:30:15 [INFO] Processing SRX3241583. (9/37) 2021-08-17 00:30:15 [INFO] Processing SRX3241583-SRR6129102. (9/37) 2021-08-17 00:37:01 [INFO] Processing SRX3241588. (10/37) 2021-08-17 00:37:01 [INFO] Processing SRX3241588-SRR6129107. (10/37) 2021-08-17 00:44:40 [INFO] Writing to disk... 2021-08-17 00:45:50 [INFO] Processing SRX3241579. (11/37) 2021-08-17 00:45:50 [INFO] Processing SRX3241579-SRR6129098. (11/37) 2021-08-17 00:53:26 [INFO] Processing SRX3241599. (12/37) 2021-08-17 00:53:26 [INFO] Processing SRX3241599-SRR6129118. (12/37) 2021-08-17 01:00:26 [INFO] Processing SRX3241601. (13/37) 2021-08-17 01:00:26 [INFO] Processing SRX3241601-SRR6129120. (13/37) 2021-08-17 01:07:28 [INFO] Processing SRX3241598. (14/37) 2021-08-17 01:07:28 [INFO] Processing SRX3241598-SRR6129117. (14/37) 2021-08-17 01:14:50 [INFO] Processing SRX3241600. (15/37) 2021-08-17 01:14:50 [INFO] Processing SRX3241600-SRR6129119. (15/37) 2021-08-17 01:21:46 [INFO] Processing SRX3241594. (16/37) 2021-08-17 01:21:46 [INFO] Processing SRX3241594-SRR6129113. (16/37) 2021-08-17 01:28:53 [INFO] Processing SRX3241595. (17/37) 2021-08-17 01:28:53 [INFO] Processing SRX3241595-SRR6129114. (17/37) 2021-08-17 01:35:52 [INFO] Processing SRX3241590. (18/37) 2021-08-17 01:35:52 [INFO] Processing SRX3241590-SRR6129109. (18/37) 2021-08-17 01:42:41 [INFO] Processing SRX3241586. (19/37) 2021-08-17 01:42:41 [INFO] Processing SRX3241586-SRR6129105. (19/37) 2021-08-17 01:49:37 [INFO] Processing SRX3241602. (20/37) 2021-08-17 01:49:37 [INFO] Processing SRX3241602-SRR6129121. (20/37) 2021-08-17 01:57:04 [INFO] Writing to disk... 2021-08-17 01:58:24 [INFO] Processing SRX3241575. (21/37) 2021-08-17 01:58:24 [INFO] Processing SRX3241575-SRR6129094. (21/37) 2021-08-17 02:05:34 [INFO] Processing SRX3241596. (22/37) 2021-08-17 02:05:34 [INFO] Processing SRX3241596-SRR6129115. (22/37) 2021-08-17 02:12:38 [INFO] Processing SRX3241593. (23/37) 2021-08-17 02:12:38 [INFO] Processing SRX3241593-SRR6129112. (23/37) 2021-08-17 02:19:39 [INFO] Processing SRX3241582. (24/37) 2021-08-17 02:19:39 [INFO] Processing SRX3241582-SRR6129101. (24/37) 2021-08-17 02:26:34 [INFO] Processing SRX3241571. (25/37) 2021-08-17 02:26:34 [INFO] Processing SRX3241571-SRR6129090. (25/37) 2021-08-17 02:33:29 [INFO] Processing SRX3241603. (26/37) 2021-08-17 02:33:29 [INFO] Processing SRX3241603-SRR6129122. (26/37) 2021-08-17 02:40:38 [INFO] Processing SRX3241584. (27/37) 2021-08-17 02:40:38 [INFO] Processing SRX3241584-SRR6129103. (27/37) 2021-08-17 02:46:40 [INFO] Processing SRX3241605. (28/37) 2021-08-17 02:46:40 [INFO] Processing SRX3241605-SRR6129124. (28/37) 2021-08-17 02:53:38 [INFO] Processing SRX3241580. (29/37) 2021-08-17 02:53:38 [INFO] Processing SRX3241580-SRR6129099. (29/37) 2021-08-17 03:00:37 [INFO] Processing SRX3241577. (30/37) 2021-08-17 03:00:37 [INFO] Processing SRX3241577-SRR6129096. (30/37) 2021-08-17 03:07:49 [INFO] Writing to disk... 2021-08-17 03:09:13 [INFO] Processing SRX3241585. (31/37) 2021-08-17 03:09:13 [INFO] Processing SRX3241585-SRR6129104. (31/37) 2021-08-17 03:16:06 [INFO] Processing SRX3241606. (32/37) 2021-08-17 03:16:06 [INFO] Processing SRX3241606-SRR6129125. (32/37) 2021-08-17 03:23:01 [INFO] Processing SRX3241597. (33/37) 2021-08-17 03:23:01 [INFO] Processing SRX3241597-SRR6129116. (33/37) 2021-08-17 03:30:07 [INFO] Processing SRX3241589. (34/37) 2021-08-17 03:30:07 [INFO] Processing SRX3241589-SRR6129108. (34/37) 2021-08-17 03:37:46 [INFO] Processing SRX3241591. (35/37) 2021-08-17 03:37:46 [INFO] Processing SRX3241591-SRR6129110. (35/37) 2021-08-17 03:44:34 [INFO] Processing SRX3241574. (36/37) 2021-08-17 03:44:34 [INFO] Processing SRX3241574-SRR6129093. (36/37) 2021-08-17 03:51:35 [INFO] Processing SRX3241578. (37/37) 2021-08-17 03:51:35 [INFO] Processing SRX3241578-SRR6129097. (37/37) 2021-08-17 03:58:41 [INFO] Writing to disk... 2021-08-17 04:00:16 [INFO] Finished. 2021-08-23 13:34:04 [INFO] Starting. 2021-08-23 13:34:04 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP119332/ 2021-08-23 13:34:04 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP119332/aggregate.hdf5 2021-08-23 13:34:04 [WARNING] chroms=/grid/gillis/data/nfox/genomes/mus_musculus_10/mm10.chrom.sizes is ignored due to existing aggregate. 2021-08-23 13:34:04 [INFO] Building aggregate for 100kbp_raw network. 2021-08-23 13:34:04 [INFO] Writing every 10 Runs. 2021-08-23 13:34:04 [INFO] Processing SRX3241592. (1/37) 2021-08-23 13:34:04 [INFO] Processing SRX3241592-SRR6129111. (1/37) 2021-08-23 13:34:08 [INFO] Processing SRX3241587. (2/37) 2021-08-23 13:34:08 [INFO] Processing SRX3241587-SRR6129106. (2/37) 2021-08-23 13:34:25 [INFO] Processing SRX3241604. (3/37) 2021-08-23 13:34:25 [INFO] Processing SRX3241604-SRR6129123. (3/37) 2021-08-23 13:34:32 [INFO] Processing SRX3241576. (4/37) 2021-08-23 13:34:32 [INFO] Processing SRX3241576-SRR6129095. (4/37) 2021-08-23 13:34:40 [INFO] Processing SRX3241573. (5/37) 2021-08-23 13:34:40 [INFO] Processing SRX3241573-SRR6129092. (5/37) 2021-08-23 13:34:46 [INFO] Processing SRX3241581. (6/37) 2021-08-23 13:34:46 [INFO] Processing SRX3241581-SRR6129100. (6/37) 2021-08-23 13:34:52 [INFO] Processing SRX3241607. (7/37) 2021-08-23 13:34:52 [INFO] Processing SRX3241607-SRR6129126. (7/37) 2021-08-23 13:34:56 [INFO] Processing SRX3241572. (8/37) 2021-08-23 13:34:56 [INFO] Processing SRX3241572-SRR6129091. (8/37) 2021-08-23 13:35:08 [INFO] Processing SRX3241583. (9/37) 2021-08-23 13:35:08 [INFO] Processing SRX3241583-SRR6129102. (9/37) 2021-08-23 13:35:15 [INFO] Processing SRX3241588. (10/37) 2021-08-23 13:35:15 [INFO] Processing SRX3241588-SRR6129107. (10/37) 2021-08-23 13:35:36 [INFO] Writing to disk... 2021-08-23 13:35:43 [INFO] Processing SRX3241579. (11/37) 2021-08-23 13:35:43 [INFO] Processing SRX3241579-SRR6129098. (11/37) 2021-08-23 13:35:53 [INFO] Processing SRX3241599. (12/37) 2021-08-23 13:35:53 [INFO] Processing SRX3241599-SRR6129118. (12/37) 2021-08-23 13:36:02 [INFO] Processing SRX3241601. (13/37) 2021-08-23 13:36:02 [INFO] Processing SRX3241601-SRR6129120. (13/37) 2021-08-23 13:36:08 [INFO] Processing SRX3241598. (14/37) 2021-08-23 13:36:08 [INFO] Processing SRX3241598-SRR6129117. (14/37) 2021-08-23 13:36:18 [INFO] Processing SRX3241600. (15/37) 2021-08-23 13:36:18 [INFO] Processing SRX3241600-SRR6129119. (15/37) 2021-08-23 13:36:24 [INFO] Processing SRX3241594. (16/37) 2021-08-23 13:36:24 [INFO] Processing SRX3241594-SRR6129113. (16/37) 2021-08-23 13:36:28 [INFO] Processing SRX3241595. (17/37) 2021-08-23 13:36:28 [INFO] Processing SRX3241595-SRR6129114. (17/37) 2021-08-23 13:36:33 [INFO] Processing SRX3241590. (18/37) 2021-08-23 13:36:33 [INFO] Processing SRX3241590-SRR6129109. (18/37) 2021-08-23 13:36:37 [INFO] Processing SRX3241586. (19/37) 2021-08-23 13:36:37 [INFO] Processing SRX3241586-SRR6129105. (19/37) 2021-08-23 13:36:43 [INFO] Processing SRX3241602. (20/37) 2021-08-23 13:36:43 [INFO] Processing SRX3241602-SRR6129121. (20/37) 2021-08-23 13:36:52 [INFO] Writing to disk... 2021-08-23 13:37:04 [INFO] Processing SRX3241575. (21/37) 2021-08-23 13:37:04 [INFO] Processing SRX3241575-SRR6129094. (21/37) 2021-08-23 13:37:11 [INFO] Processing SRX3241596. (22/37) 2021-08-23 13:37:11 [INFO] Processing SRX3241596-SRR6129115. (22/37) 2021-08-23 13:37:19 [INFO] Processing SRX3241593. (23/37) 2021-08-23 13:37:19 [INFO] Processing SRX3241593-SRR6129112. (23/37) 2021-08-23 13:37:23 [INFO] Processing SRX3241582. (24/37) 2021-08-23 13:37:23 [INFO] Processing SRX3241582-SRR6129101. (24/37) 2021-08-23 13:37:30 [INFO] Processing SRX3241571. (25/37) 2021-08-23 13:37:30 [INFO] Processing SRX3241571-SRR6129090. (25/37) 2021-08-23 13:37:44 [INFO] Processing SRX3241603. (26/37) 2021-08-23 13:37:44 [INFO] Processing SRX3241603-SRR6129122. (26/37) 2021-08-23 13:37:53 [INFO] Processing SRX3241584. (27/37) 2021-08-23 13:37:53 [INFO] Processing SRX3241584-SRR6129103. (27/37) 2021-08-23 13:37:54 [INFO] Processing SRX3241605. (28/37) 2021-08-23 13:37:54 [INFO] Processing SRX3241605-SRR6129124. (28/37) 2021-08-23 13:38:02 [INFO] Processing SRX3241580. (29/37) 2021-08-23 13:38:02 [INFO] Processing SRX3241580-SRR6129099. (29/37) 2021-08-23 13:38:13 [INFO] Processing SRX3241577. (30/37) 2021-08-23 13:38:13 [INFO] Processing SRX3241577-SRR6129096. (30/37) 2021-08-23 13:38:22 [INFO] Writing to disk... 2021-08-23 13:38:36 [INFO] Processing SRX3241585. (31/37) 2021-08-23 13:38:36 [INFO] Processing SRX3241585-SRR6129104. (31/37) 2021-08-23 13:38:37 [INFO] Processing SRX3241606. (32/37) 2021-08-23 13:38:37 [INFO] Processing SRX3241606-SRR6129125. (32/37) 2021-08-23 13:38:43 [INFO] Processing SRX3241597. (33/37) 2021-08-23 13:38:43 [INFO] Processing SRX3241597-SRR6129116. (33/37) 2021-08-23 13:38:52 [INFO] Processing SRX3241589. (34/37) 2021-08-23 13:38:52 [INFO] Processing SRX3241589-SRR6129108. (34/37) 2021-08-23 13:39:15 [INFO] Processing SRX3241591. (35/37) 2021-08-23 13:39:15 [INFO] Processing SRX3241591-SRR6129110. (35/37) 2021-08-23 13:39:20 [INFO] Processing SRX3241574. (36/37) 2021-08-23 13:39:20 [INFO] Processing SRX3241574-SRR6129093. (36/37) 2021-08-23 13:39:26 [INFO] Processing SRX3241578. (37/37) 2021-08-23 13:39:26 [INFO] Processing SRX3241578-SRR6129097. (37/37) 2021-08-23 13:39:35 [INFO] Writing to disk... 2021-08-23 13:39:51 [INFO] Finished. 2021-08-30 12:45:57 [INFO] Starting. 2021-08-30 12:45:57 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP119332/ 2021-08-30 12:45:57 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP119332/aggregate.hdf5 2021-08-30 12:45:57 [WARNING] chroms=/grid/gillis/data/nfox/genomes/mus_musculus_10/mm10.chrom.sizes is ignored due to existing aggregate. 2021-08-30 12:45:58 [INFO] Building aggregate for 250kbp_raw network. 2021-08-30 12:45:58 [INFO] Writing every 10 Runs. 2021-08-30 12:45:58 [INFO] Processing SRX3241592. (1/37) 2021-08-30 12:45:58 [INFO] Processing SRX3241592-SRR6129111. (1/37) 2021-08-30 12:46:01 [INFO] Processing SRX3241587. (2/37) 2021-08-30 12:46:01 [INFO] Processing SRX3241587-SRR6129106. (2/37) 2021-08-30 12:46:09 [INFO] Processing SRX3241604. (3/37) 2021-08-30 12:46:10 [INFO] Processing SRX3241604-SRR6129123. (3/37) 2021-08-30 12:46:16 [INFO] Processing SRX3241576. (4/37) 2021-08-30 12:46:16 [INFO] Processing SRX3241576-SRR6129095. (4/37) 2021-08-30 12:46:22 [INFO] Processing SRX3241573. (5/37) 2021-08-30 12:46:22 [INFO] Processing SRX3241573-SRR6129092. (5/37) 2021-08-30 12:46:27 [INFO] Processing SRX3241581. (6/37) 2021-08-30 12:46:27 [INFO] Processing SRX3241581-SRR6129100. (6/37) 2021-08-30 12:46:32 [INFO] Processing SRX3241607. (7/37) 2021-08-30 12:46:32 [INFO] Processing SRX3241607-SRR6129126. (7/37) 2021-08-30 12:46:35 [INFO] Processing SRX3241572. (8/37) 2021-08-30 12:46:35 [INFO] Processing SRX3241572-SRR6129091. (8/37) 2021-08-30 12:46:41 [INFO] Processing SRX3241583. (9/37) 2021-08-30 12:46:41 [INFO] Processing SRX3241583-SRR6129102. (9/37) 2021-08-30 12:46:45 [INFO] Processing SRX3241588. (10/37) 2021-08-30 12:46:45 [INFO] Processing SRX3241588-SRR6129107. (10/37) 2021-08-30 12:47:00 [INFO] Writing to disk... 2021-08-30 12:47:02 [INFO] Processing SRX3241579. (11/37) 2021-08-30 12:47:02 [INFO] Processing SRX3241579-SRR6129098. (11/37) 2021-08-30 12:47:10 [INFO] Processing SRX3241599. (12/37) 2021-08-30 12:47:10 [INFO] Processing SRX3241599-SRR6129118. (12/37) 2021-08-30 12:47:19 [INFO] Processing SRX3241601. (13/37) 2021-08-30 12:47:19 [INFO] Processing SRX3241601-SRR6129120. (13/37) 2021-08-30 12:47:23 [INFO] Processing SRX3241598. (14/37) 2021-08-30 12:47:23 [INFO] Processing SRX3241598-SRR6129117. (14/37) 2021-08-30 12:47:32 [INFO] Processing SRX3241600. (15/37) 2021-08-30 12:47:32 [INFO] Processing SRX3241600-SRR6129119. (15/37) 2021-08-30 12:47:35 [INFO] Processing SRX3241594. (16/37) 2021-08-30 12:47:35 [INFO] Processing SRX3241594-SRR6129113. (16/37) 2021-08-30 12:47:39 [INFO] Processing SRX3241595. (17/37) 2021-08-30 12:47:39 [INFO] Processing SRX3241595-SRR6129114. (17/37) 2021-08-30 12:47:42 [INFO] Processing SRX3241590. (18/37) 2021-08-30 12:47:42 [INFO] Processing SRX3241590-SRR6129109. (18/37) 2021-08-30 12:47:46 [INFO] Processing SRX3241586. (19/37) 2021-08-30 12:47:46 [INFO] Processing SRX3241586-SRR6129105. (19/37) 2021-08-30 12:47:51 [INFO] Processing SRX3241602. (20/37) 2021-08-30 12:47:51 [INFO] Processing SRX3241602-SRR6129121. (20/37) 2021-08-30 12:47:56 [INFO] Writing to disk... 2021-08-30 12:48:07 [INFO] Processing SRX3241575. (21/37) 2021-08-30 12:48:07 [INFO] Processing SRX3241575-SRR6129094. (21/37) 2021-08-30 12:48:13 [INFO] Processing SRX3241596. (22/37) 2021-08-30 12:48:13 [INFO] Processing SRX3241596-SRR6129115. (22/37) 2021-08-30 12:48:20 [INFO] Processing SRX3241593. (23/37) 2021-08-30 12:48:20 [INFO] Processing SRX3241593-SRR6129112. (23/37) 2021-08-30 12:48:23 [INFO] Processing SRX3241582. (24/37) 2021-08-30 12:48:23 [INFO] Processing SRX3241582-SRR6129101. (24/37) 2021-08-30 12:48:29 [INFO] Processing SRX3241571. (25/37) 2021-08-30 12:48:29 [INFO] Processing SRX3241571-SRR6129090. (25/37) 2021-08-30 12:48:37 [INFO] Processing SRX3241603. (26/37) 2021-08-30 12:48:37 [INFO] Processing SRX3241603-SRR6129122. (26/37) 2021-08-30 12:48:44 [INFO] Processing SRX3241584. (27/37) 2021-08-30 12:48:44 [INFO] Processing SRX3241584-SRR6129103. (27/37) 2021-08-30 12:48:45 [INFO] Processing SRX3241605. (28/37) 2021-08-30 12:48:45 [INFO] Processing SRX3241605-SRR6129124. (28/37) 2021-08-30 12:48:52 [INFO] Processing SRX3241580. (29/37) 2021-08-30 12:48:52 [INFO] Processing SRX3241580-SRR6129099. (29/37) 2021-08-30 12:49:00 [INFO] Processing SRX3241577. (30/37) 2021-08-30 12:49:00 [INFO] Processing SRX3241577-SRR6129096. (30/37) 2021-08-30 12:49:07 [INFO] Writing to disk... 2021-08-30 12:49:19 [INFO] Processing SRX3241585. (31/37) 2021-08-30 12:49:19 [INFO] Processing SRX3241585-SRR6129104. (31/37) 2021-08-30 12:49:20 [INFO] Processing SRX3241606. (32/37) 2021-08-30 12:49:20 [INFO] Processing SRX3241606-SRR6129125. (32/37) 2021-08-30 12:49:24 [INFO] Processing SRX3241597. (33/37) 2021-08-30 12:49:24 [INFO] Processing SRX3241597-SRR6129116. (33/37) 2021-08-30 12:49:32 [INFO] Processing SRX3241589. (34/37) 2021-08-30 12:49:32 [INFO] Processing SRX3241589-SRR6129108. (34/37) 2021-08-30 12:49:47 [INFO] Processing SRX3241591. (35/37) 2021-08-30 12:49:47 [INFO] Processing SRX3241591-SRR6129110. (35/37) 2021-08-30 12:49:51 [INFO] Processing SRX3241574. (36/37) 2021-08-30 12:49:51 [INFO] Processing SRX3241574-SRR6129093. (36/37) 2021-08-30 12:49:55 [INFO] Processing SRX3241578. (37/37) 2021-08-30 12:49:55 [INFO] Processing SRX3241578-SRR6129097. (37/37) 2021-08-30 12:50:03 [INFO] Writing to disk... 2021-08-30 12:50:11 [INFO] Finished. 2021-08-30 21:27:35 [INFO] Starting. 2021-08-30 21:27:35 [INFO] Processing /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP119332/ 2021-08-30 21:27:35 [INFO] Appending to existing aggregate : /grid/gillis/data/nfox/hi_c_data_processing/data_mouse/SRP119332/aggregate.hdf5 2021-08-30 21:27:35 [WARNING] chroms=/grid/gillis/data/nfox/genomes/mus_musculus_10/mm10.chrom.sizes is ignored due to existing aggregate. 2021-08-30 21:27:36 [INFO] Building aggregate for 500kbp_raw network. 2021-08-30 21:27:36 [INFO] Writing every 10 Runs. 2021-08-30 21:27:36 [INFO] Processing SRX3241592. (1/37) 2021-08-30 21:27:36 [INFO] Processing SRX3241592-SRR6129111. (1/37) 2021-08-30 21:27:38 [INFO] Processing SRX3241587. (2/37) 2021-08-30 21:27:38 [INFO] Processing SRX3241587-SRR6129106. (2/37) 2021-08-30 21:27:44 [INFO] Processing SRX3241604. (3/37) 2021-08-30 21:27:44 [INFO] Processing SRX3241604-SRR6129123. (3/37) 2021-08-30 21:27:48 [INFO] Processing SRX3241576. (4/37) 2021-08-30 21:27:48 [INFO] Processing SRX3241576-SRR6129095. (4/37) 2021-08-30 21:27:53 [INFO] Processing SRX3241573. (5/37) 2021-08-30 21:27:53 [INFO] Processing SRX3241573-SRR6129092. (5/37) 2021-08-30 21:27:57 [INFO] Processing SRX3241581. (6/37) 2021-08-30 21:27:57 [INFO] Processing SRX3241581-SRR6129100. (6/37) 2021-08-30 21:28:02 [INFO] Processing SRX3241607. (7/37) 2021-08-30 21:28:02 [INFO] Processing SRX3241607-SRR6129126. (7/37) 2021-08-30 21:28:04 [INFO] Processing SRX3241572. (8/37) 2021-08-30 21:28:04 [INFO] Processing SRX3241572-SRR6129091. (8/37) 2021-08-30 21:28:10 [INFO] Processing SRX3241583. (9/37) 2021-08-30 21:28:10 [INFO] Processing SRX3241583-SRR6129102. (9/37) 2021-08-30 21:28:14 [INFO] Processing SRX3241588. (10/37) 2021-08-30 21:28:14 [INFO] Processing SRX3241588-SRR6129107. (10/37) 2021-08-30 21:28:22 [INFO] Writing to disk... 2021-08-30 21:28:23 [INFO] Processing SRX3241579. (11/37) 2021-08-30 21:28:23 [INFO] Processing SRX3241579-SRR6129098. (11/37) 2021-08-30 21:28:27 [INFO] Processing SRX3241599. (12/37) 2021-08-30 21:28:27 [INFO] Processing SRX3241599-SRR6129118. (12/37) 2021-08-30 21:28:33 [INFO] Processing SRX3241601. (13/37) 2021-08-30 21:28:33 [INFO] Processing SRX3241601-SRR6129120. (13/37) 2021-08-30 21:28:36 [INFO] Processing SRX3241598. (14/37) 2021-08-30 21:28:36 [INFO] Processing SRX3241598-SRR6129117. (14/37) 2021-08-30 21:28:43 [INFO] Processing SRX3241600. (15/37) 2021-08-30 21:28:43 [INFO] Processing SRX3241600-SRR6129119. (15/37) 2021-08-30 21:28:46 [INFO] Processing SRX3241594. (16/37) 2021-08-30 21:28:46 [INFO] Processing SRX3241594-SRR6129113. (16/37) 2021-08-30 21:28:48 [INFO] Processing SRX3241595. (17/37) 2021-08-30 21:28:48 [INFO] Processing SRX3241595-SRR6129114. (17/37) 2021-08-30 21:28:50 [INFO] Processing SRX3241590. (18/37) 2021-08-30 21:28:50 [INFO] Processing SRX3241590-SRR6129109. (18/37) 2021-08-30 21:28:53 [INFO] Processing SRX3241586. (19/37) 2021-08-30 21:28:53 [INFO] Processing SRX3241586-SRR6129105. (19/37) 2021-08-30 21:28:56 [INFO] Processing SRX3241602. (20/37) 2021-08-30 21:28:56 [INFO] Processing SRX3241602-SRR6129121. (20/37) 2021-08-30 21:28:59 [INFO] Writing to disk... 2021-08-30 21:29:00 [INFO] Processing SRX3241575. (21/37) 2021-08-30 21:29:00 [INFO] Processing SRX3241575-SRR6129094. (21/37) 2021-08-30 21:29:04 [INFO] Processing SRX3241596. (22/37) 2021-08-30 21:29:04 [INFO] Processing SRX3241596-SRR6129115. (22/37) 2021-08-30 21:29:09 [INFO] Processing SRX3241593. (23/37) 2021-08-30 21:29:09 [INFO] Processing SRX3241593-SRR6129112. (23/37) 2021-08-30 21:29:12 [INFO] Processing SRX3241582. (24/37) 2021-08-30 21:29:12 [INFO] Processing SRX3241582-SRR6129101. (24/37) 2021-08-30 21:29:16 [INFO] Processing SRX3241571. (25/37) 2021-08-30 21:29:16 [INFO] Processing SRX3241571-SRR6129090. (25/37) 2021-08-30 21:29:21 [INFO] Processing SRX3241603. (26/37) 2021-08-30 21:29:21 [INFO] Processing SRX3241603-SRR6129122. (26/37) 2021-08-30 21:29:25 [INFO] Processing SRX3241584. (27/37) 2021-08-30 21:29:25 [INFO] Processing SRX3241584-SRR6129103. (27/37) 2021-08-30 21:29:26 [INFO] Processing SRX3241605. (28/37) 2021-08-30 21:29:26 [INFO] Processing SRX3241605-SRR6129124. (28/37) 2021-08-30 21:29:30 [INFO] Processing SRX3241580. (29/37) 2021-08-30 21:29:30 [INFO] Processing SRX3241580-SRR6129099. (29/37) 2021-08-30 21:29:36 [INFO] Processing SRX3241577. (30/37) 2021-08-30 21:29:36 [INFO] Processing SRX3241577-SRR6129096. (30/37) 2021-08-30 21:29:41 [INFO] Writing to disk... 2021-08-30 21:29:46 [INFO] Processing SRX3241585. (31/37) 2021-08-30 21:29:46 [INFO] Processing SRX3241585-SRR6129104. (31/37) 2021-08-30 21:29:47 [INFO] Processing SRX3241606. (32/37) 2021-08-30 21:29:47 [INFO] Processing SRX3241606-SRR6129125. (32/37) 2021-08-30 21:29:51 [INFO] Processing SRX3241597. (33/37) 2021-08-30 21:29:51 [INFO] Processing SRX3241597-SRR6129116. (33/37) 2021-08-30 21:29:56 [INFO] Processing SRX3241589. (34/37) 2021-08-30 21:29:56 [INFO] Processing SRX3241589-SRR6129108. (34/37) 2021-08-30 21:30:04 [INFO] Processing SRX3241591. (35/37) 2021-08-30 21:30:04 [INFO] Processing SRX3241591-SRR6129110. (35/37) 2021-08-30 21:30:07 [INFO] Processing SRX3241574. (36/37) 2021-08-30 21:30:07 [INFO] Processing SRX3241574-SRR6129093. (36/37) 2021-08-30 21:30:11 [INFO] Processing SRX3241578. (37/37) 2021-08-30 21:30:11 [INFO] Processing SRX3241578-SRR6129097. (37/37) 2021-08-30 21:30:16 [INFO] Writing to disk... 2021-08-30 21:30:20 [INFO] Finished.