Skip to content

Instantly share code, notes, and snippets.

@meghbhalerao
Created September 8, 2023 17:53
Show Gist options
  • Select an option

  • Save meghbhalerao/8ef4f971fd4391e14bdaccf290fd82bc to your computer and use it in GitHub Desktop.

Select an option

Save meghbhalerao/8ef4f971fd4391e14bdaccf290fd82bc to your computer and use it in GitHub Desktop.
[16:55:34] ----- Submarine logging started -----
[16:55:34] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices ....
[16:55:34] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit.
[16:55:34] Using 22 threads for general operations.
[16:55:34] Command line: smraiz -flfilename /mnt/disks/spinning_scratch0/smrai-container-documentation/src/saved_results/tinyimagenet/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks
[16:55:34] Loading FL matrix.
[16:55:34] RNPHR: Reading numpy file v1.0 with header size 70.
[16:55:34] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false.
[16:55:34] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false.
[16:55:34] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting.
[16:55:34] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000.
[16:55:35] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353.
[16:55:36] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706.
[16:55:37] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059.
[16:55:38] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412.
[16:55:39] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765.
[16:55:39] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118.
[16:55:40] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471.
[16:55:41] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824.
[16:55:42] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177.
[16:55:43] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530.
[16:55:44] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883.
[16:55:44] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236.
[16:55:45] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589.
[16:55:46] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942.
[16:55:47] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295.
[16:55:48] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648.
[16:55:49] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001.
[16:55:49] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354.
[16:55:50] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0.
[16:55:50] RMNF: directly read 100000x100000 numpy matrix.
[16:55:50] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7f0462a63040.
[16:55:50] Loaded FL 100000x100000 matrix.
[16:55:50] No transform requested for loaded FL 100000x100000 matrix.
[16:55:50] Finished loading FL 100000x100000 matrix.
[16:55:50] Creating a Facility Location Function with a 100000x100000 matrix.
[16:55:50] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7f0462a63040.
[16:55:53] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7f0462a63040, 1/norm_const = 2.2285229856085104e-06.
[16:55:53] Finished creating a Facility Location Function.
[16:55:53] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1.
[16:55:53] Created function mixture with 1 component.
[16:55:53] Using 1 thread for summarization.
[16:55:53] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1.
[16:55:53] Gain permit type = 1, Gain threshold = 0.
[16:55:53] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647.
[16:55:53] ACGR: Computing 100000 singleton values.
[16:56:09] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain.
[16:56:09] ACGR: Building initial PQ.
[16:56:09] ACGR: Finished building initial PQ.
[16:56:09] ACGR: Finished running accelerated greedy, solution has 1 elements.
[16:56:09] Summarization time: CPU 15.558601s (User: 15.558601s; System: 0s); Wall Clock 15.559099786s.
[16:56:09] Computing final summary valuations.
[16:56:09] Summary valuation: f(Solution) = 9.9988415035e-01
[16:56:09] Computing conditional curvature for 1 elements.
[16:56:09] Computing conditional curvature.
[16:56:09] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08.
[16:56:09] Finished execution successfully, exiting ....
real 0m35.520s
user 0m18.749s
sys 0m16.765s
[16:56:10] ----- Submarine logging started -----
[16:56:10] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices ....
[16:56:10] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit.
[16:56:10] Using 22 threads for general operations.
[16:56:10] Command line: smraiz -flfilename /mnt/disks/spinning_scratch0/smrai-container-documentation/src/saved_results/tinyimagenet/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks
[16:56:10] Loading FL matrix.
[16:56:10] RNPHR: Reading numpy file v1.0 with header size 70.
[16:56:10] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false.
[16:56:10] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false.
[16:56:10] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting.
[16:56:10] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000.
[16:56:10] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353.
[16:56:11] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706.
[16:56:12] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059.
[16:56:12] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412.
[16:56:13] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765.
[16:56:14] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118.
[16:56:14] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471.
[16:56:15] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824.
[16:56:15] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177.
[16:56:16] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530.
[16:56:17] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883.
[16:56:18] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236.
[16:56:19] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589.
[16:56:19] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942.
[16:56:20] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295.
[16:56:21] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648.
[16:56:22] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001.
[16:56:23] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354.
[16:56:23] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0.
[16:56:23] RMNF: directly read 100000x100000 numpy matrix.
[16:56:23] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7f7136d45040.
[16:56:23] Loaded FL 100000x100000 matrix.
[16:56:23] No transform requested for loaded FL 100000x100000 matrix.
[16:56:23] Finished loading FL 100000x100000 matrix.
[16:56:23] Creating a Facility Location Function with a 100000x100000 matrix.
[16:56:23] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7f7136d45040.
[16:56:26] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7f7136d45040, 1/norm_const = 2.2285229856085104e-06.
[16:56:26] Finished creating a Facility Location Function.
[16:56:26] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1.
[16:56:26] Created function mixture with 1 component.
[16:56:26] Using 1 thread for summarization.
[16:56:26] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1.
[16:56:26] Gain permit type = 1, Gain threshold = 0.
[16:56:26] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647.
[16:56:26] ACGR: Computing 100000 singleton values.
[16:56:41] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain.
[16:56:41] ACGR: Building initial PQ.
[16:56:41] ACGR: Finished building initial PQ.
[16:56:41] ACGR: Finished running accelerated greedy, solution has 1 elements.
[16:56:41] Summarization time: CPU 15.094123s (User: 15.092909s; System: 0.001214s); Wall Clock 15.09468622s.
[16:56:41] Computing final summary valuations.
[16:56:41] Summary valuation: f(Solution) = 9.9988415035e-01
[16:56:41] Computing conditional curvature for 1 elements.
[16:56:41] Computing conditional curvature.
[16:56:41] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08.
[16:56:41] Finished execution successfully, exiting ....
real 0m32.195s
user 0m18.229s
sys 0m13.963s
[16:56:42] ----- Submarine logging started -----
[16:56:42] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices ....
[16:56:42] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit.
[16:56:42] Using 22 threads for general operations.
[16:56:42] Command line: smraiz -flfilename /mnt/disks/spinning_scratch0/smrai-container-documentation/src/saved_results/tinyimagenet/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks
[16:56:42] Loading FL matrix.
[16:56:42] RNPHR: Reading numpy file v1.0 with header size 70.
[16:56:42] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false.
[16:56:42] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false.
[16:56:42] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting.
[16:56:42] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000.
[16:56:43] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353.
[16:56:43] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706.
[16:56:44] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059.
[16:56:45] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412.
[16:56:45] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765.
[16:56:46] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118.
[16:56:46] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471.
[16:56:47] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824.
[16:56:48] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177.
[16:56:48] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530.
[16:56:49] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883.
[16:56:50] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236.
[16:56:51] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589.
[16:56:52] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942.
[16:56:53] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295.
[16:56:53] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648.
[16:56:54] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001.
[16:56:55] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354.
[16:56:56] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0.
[16:56:56] RMNF: directly read 100000x100000 numpy matrix.
[16:56:56] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7fa6b7e22040.
[16:56:56] Loaded FL 100000x100000 matrix.
[16:56:56] No transform requested for loaded FL 100000x100000 matrix.
[16:56:56] Finished loading FL 100000x100000 matrix.
[16:56:56] Creating a Facility Location Function with a 100000x100000 matrix.
[16:56:56] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7fa6b7e22040.
[16:56:59] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7fa6b7e22040, 1/norm_const = 2.2285229856085104e-06.
[16:56:59] Finished creating a Facility Location Function.
[16:56:59] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1.
[16:56:59] Created function mixture with 1 component.
[16:56:59] Using 1 thread for summarization.
[16:56:59] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1.
[16:56:59] Gain permit type = 1, Gain threshold = 0.
[16:56:59] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647.
[16:56:59] ACGR: Computing 100000 singleton values.
[16:57:14] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain.
[16:57:14] ACGR: Building initial PQ.
[16:57:14] ACGR: Finished building initial PQ.
[16:57:14] ACGR: Finished running accelerated greedy, solution has 1 elements.
[16:57:14] Summarization time: CPU 15.179708999999999s (User: 15.179312s; System: 0.000397s); Wall Clock 15.180313206000001s.
[16:57:14] Computing final summary valuations.
[16:57:14] Summary valuation: f(Solution) = 9.9988415035e-01
[16:57:14] Computing conditional curvature for 1 elements.
[16:57:14] Computing conditional curvature.
[16:57:14] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08.
[16:57:14] Finished execution successfully, exiting ....
real 0m32.591s
user 0m18.395s
sys 0m14.195s
[16:57:15] ----- Submarine logging started -----
[16:57:15] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices ....
[16:57:15] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit.
[16:57:15] Using 22 threads for general operations.
[16:57:15] Command line: smraiz -flfilename /mnt/disks/spinning_scratch0/smrai-container-documentation/src/saved_results/tinyimagenet/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks
[16:57:15] Loading FL matrix.
[16:57:15] RNPHR: Reading numpy file v1.0 with header size 70.
[16:57:15] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false.
[16:57:15] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false.
[16:57:15] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting.
[16:57:15] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000.
[16:57:15] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353.
[16:57:16] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706.
[16:57:16] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059.
[16:57:17] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412.
[16:57:18] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765.
[16:57:18] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118.
[16:57:19] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471.
[16:57:20] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824.
[16:57:20] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177.
[16:57:21] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530.
[16:57:22] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883.
[16:57:23] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236.
[16:57:24] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589.
[16:57:24] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942.
[16:57:25] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295.
[16:57:26] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648.
[16:57:27] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001.
[16:57:28] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354.
[16:57:28] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0.
[16:57:28] RMNF: directly read 100000x100000 numpy matrix.
[16:57:28] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7fb46bc97040.
[16:57:28] Loaded FL 100000x100000 matrix.
[16:57:28] No transform requested for loaded FL 100000x100000 matrix.
[16:57:28] Finished loading FL 100000x100000 matrix.
[16:57:28] Creating a Facility Location Function with a 100000x100000 matrix.
[16:57:28] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7fb46bc97040.
[16:57:32] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7fb46bc97040, 1/norm_const = 2.2285229856085104e-06.
[16:57:32] Finished creating a Facility Location Function.
[16:57:32] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1.
[16:57:32] Created function mixture with 1 component.
[16:57:32] Using 1 thread for summarization.
[16:57:32] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1.
[16:57:32] Gain permit type = 1, Gain threshold = 0.
[16:57:32] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647.
[16:57:32] ACGR: Computing 100000 singleton values.
[16:57:47] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain.
[16:57:47] ACGR: Building initial PQ.
[16:57:47] ACGR: Finished building initial PQ.
[16:57:47] ACGR: Finished running accelerated greedy, solution has 1 elements.
[16:57:47] Summarization time: CPU 15.2169s (User: 15.2169s; System: 0s); Wall Clock 15.217678164999999s.
[16:57:47] Computing final summary valuations.
[16:57:47] Summary valuation: f(Solution) = 9.9988415035e-01
[16:57:47] Computing conditional curvature for 1 elements.
[16:57:47] Computing conditional curvature.
[16:57:47] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08.
[16:57:47] Finished execution successfully, exiting ....
real 0m32.639s
user 0m18.434s
sys 0m14.202s
[16:57:47] ----- Submarine logging started -----
[16:57:47] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices ....
[16:57:47] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit.
[16:57:47] Using 22 threads for general operations.
[16:57:47] Command line: smraiz -flfilename /mnt/disks/spinning_scratch0/smrai-container-documentation/src/saved_results/tinyimagenet/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks
[16:57:47] Loading FL matrix.
[16:57:47] RNPHR: Reading numpy file v1.0 with header size 70.
[16:57:47] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false.
[16:57:47] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false.
[16:57:47] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting.
[16:57:47] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000.
[16:57:48] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353.
[16:57:49] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706.
[16:57:49] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059.
[16:57:50] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412.
[16:57:50] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765.
[16:57:51] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118.
[16:57:52] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471.
[16:57:52] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824.
[16:57:53] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177.
[16:57:54] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530.
[16:57:54] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883.
[16:57:55] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236.
[16:57:56] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589.
[16:57:56] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942.
[16:57:57] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295.
[16:57:58] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648.
[16:57:59] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001.
[16:58:00] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354.
[16:58:00] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0.
[16:58:00] RMNF: directly read 100000x100000 numpy matrix.
[16:58:00] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7fee20928040.
[16:58:00] Loaded FL 100000x100000 matrix.
[16:58:00] No transform requested for loaded FL 100000x100000 matrix.
[16:58:00] Finished loading FL 100000x100000 matrix.
[16:58:00] Creating a Facility Location Function with a 100000x100000 matrix.
[16:58:00] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7fee20928040.
[16:58:04] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7fee20928040, 1/norm_const = 2.2285229856085104e-06.
[16:58:04] Finished creating a Facility Location Function.
[16:58:04] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1.
[16:58:04] Created function mixture with 1 component.
[16:58:04] Using 1 thread for summarization.
[16:58:04] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1.
[16:58:04] Gain permit type = 1, Gain threshold = 0.
[16:58:04] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647.
[16:58:04] ACGR: Computing 100000 singleton values.
[16:58:19] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain.
[16:58:19] ACGR: Building initial PQ.
[16:58:19] ACGR: Finished building initial PQ.
[16:58:19] ACGR: Finished running accelerated greedy, solution has 1 elements.
[16:58:19] Summarization time: CPU 15.030913s (User: 15.030913s; System: 0s); Wall Clock 15.03159048s.
[16:58:19] Computing final summary valuations.
[16:58:19] Summary valuation: f(Solution) = 9.9988415035e-01
[16:58:19] Computing conditional curvature for 1 elements.
[16:58:19] Computing conditional curvature.
[16:58:19] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08.
[16:58:19] Finished execution successfully, exiting ....
real 0m31.638s
user 0m18.276s
sys 0m13.360s
[16:58:19] ----- Submarine logging started -----
[16:58:19] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices ....
[16:58:19] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit.
[16:58:19] Using 22 threads for general operations.
[16:58:19] Command line: smraiz -flfilename /mnt/disks/ssd1/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks
[16:58:19] Loading FL matrix.
[16:58:19] RNPHR: Reading numpy file v1.0 with header size 70.
[16:58:19] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false.
[16:58:19] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false.
[16:58:19] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting.
[16:58:19] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000.
[16:58:22] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353.
[16:58:25] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706.
[16:58:28] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059.
[16:58:31] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412.
[16:58:33] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765.
[16:58:36] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118.
[16:58:39] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471.
[16:58:42] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824.
[16:58:45] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177.
[16:58:48] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530.
[16:58:51] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883.
[16:58:54] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236.
[16:58:57] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589.
[16:59:00] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942.
[16:59:03] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295.
[16:59:06] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648.
[16:59:08] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001.
[16:59:11] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354.
[16:59:13] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0.
[16:59:13] RMNF: directly read 100000x100000 numpy matrix.
[16:59:13] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7f4f6aa48040.
[16:59:13] Loaded FL 100000x100000 matrix.
[16:59:13] No transform requested for loaded FL 100000x100000 matrix.
[16:59:13] Finished loading FL 100000x100000 matrix.
[16:59:13] Creating a Facility Location Function with a 100000x100000 matrix.
[16:59:13] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7f4f6aa48040.
[16:59:16] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7f4f6aa48040, 1/norm_const = 2.2285229856085104e-06.
[16:59:16] Finished creating a Facility Location Function.
[16:59:16] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1.
[16:59:16] Created function mixture with 1 component.
[16:59:16] Using 1 thread for summarization.
[16:59:16] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1.
[16:59:16] Gain permit type = 1, Gain threshold = 0.
[16:59:16] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647.
[16:59:16] ACGR: Computing 100000 singleton values.
[16:59:32] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain.
[16:59:32] ACGR: Building initial PQ.
[16:59:32] ACGR: Finished building initial PQ.
[16:59:32] ACGR: Finished running accelerated greedy, solution has 1 elements.
[16:59:32] Summarization time: CPU 15.18736s (User: 15.18736s; System: 0s); Wall Clock 15.187891508s.
[16:59:32] Computing final summary valuations.
[16:59:32] Summary valuation: f(Solution) = 9.9988415035e-01
[16:59:32] Computing conditional curvature for 1 elements.
[16:59:32] Computing conditional curvature.
[16:59:32] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08.
[16:59:32] Finished execution successfully, exiting ....
real 1m13.106s
user 0m18.511s
sys 0m21.365s
[16:59:32] ----- Submarine logging started -----
[16:59:32] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices ....
[16:59:32] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit.
[16:59:32] Using 22 threads for general operations.
[16:59:32] Command line: smraiz -flfilename /mnt/disks/ssd1/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks
[16:59:32] Loading FL matrix.
[16:59:32] RNPHR: Reading numpy file v1.0 with header size 70.
[16:59:32] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false.
[16:59:32] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false.
[16:59:32] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting.
[16:59:32] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000.
[16:59:35] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353.
[16:59:38] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706.
[16:59:41] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059.
[16:59:44] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412.
[16:59:47] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765.
[16:59:49] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118.
[16:59:52] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471.
[16:59:55] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824.
[16:59:58] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177.
[17:00:01] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530.
[17:00:04] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883.
[17:00:07] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236.
[17:00:10] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589.
[17:00:13] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942.
[17:00:16] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295.
[17:00:19] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648.
[17:00:22] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001.
[17:00:24] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354.
[17:00:26] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0.
[17:00:26] RMNF: directly read 100000x100000 numpy matrix.
[17:00:26] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7f2ba3ac2040.
[17:00:26] Loaded FL 100000x100000 matrix.
[17:00:26] No transform requested for loaded FL 100000x100000 matrix.
[17:00:26] Finished loading FL 100000x100000 matrix.
[17:00:26] Creating a Facility Location Function with a 100000x100000 matrix.
[17:00:26] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7f2ba3ac2040.
[17:00:29] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7f2ba3ac2040, 1/norm_const = 2.2285229856085104e-06.
[17:00:29] Finished creating a Facility Location Function.
[17:00:29] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1.
[17:00:29] Created function mixture with 1 component.
[17:00:29] Using 1 thread for summarization.
[17:00:29] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1.
[17:00:29] Gain permit type = 1, Gain threshold = 0.
[17:00:29] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647.
[17:00:29] ACGR: Computing 100000 singleton values.
[17:00:45] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain.
[17:00:45] ACGR: Building initial PQ.
[17:00:45] ACGR: Finished building initial PQ.
[17:00:45] ACGR: Finished running accelerated greedy, solution has 1 elements.
[17:00:45] Summarization time: CPU 15.076679s (User: 15.076679s; System: 0s); Wall Clock 15.077196248s.
[17:00:45] Computing final summary valuations.
[17:00:45] Summary valuation: f(Solution) = 9.9988415035e-01
[17:00:45] Computing conditional curvature for 1 elements.
[17:00:45] Computing conditional curvature.
[17:00:45] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08.
[17:00:45] Finished execution successfully, exiting ....
real 1m12.806s
user 0m18.295s
sys 0m21.886s
[17:00:45] ----- Submarine logging started -----
[17:00:45] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices ....
[17:00:45] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit.
[17:00:45] Using 22 threads for general operations.
[17:00:45] Command line: smraiz -flfilename /mnt/disks/ssd1/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks
[17:00:45] Loading FL matrix.
[17:00:45] RNPHR: Reading numpy file v1.0 with header size 70.
[17:00:45] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false.
[17:00:45] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false.
[17:00:45] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting.
[17:00:45] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000.
[17:00:48] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353.
[17:00:51] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706.
[17:00:54] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059.
[17:00:56] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412.
[17:00:58] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765.
[17:00:58] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118.
[17:00:59] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471.
[17:01:00] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824.
[17:01:00] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177.
[17:01:01] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530.
[17:01:02] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883.
[17:01:03] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236.
[17:01:06] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589.
[17:01:08] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942.
[17:01:09] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295.
[17:01:09] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648.
[17:01:10] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001.
[17:01:13] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354.
[17:01:15] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0.
[17:01:15] RMNF: directly read 100000x100000 numpy matrix.
[17:01:15] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7fc317d1d040.
[17:01:15] Loaded FL 100000x100000 matrix.
[17:01:15] No transform requested for loaded FL 100000x100000 matrix.
[17:01:15] Finished loading FL 100000x100000 matrix.
[17:01:15] Creating a Facility Location Function with a 100000x100000 matrix.
[17:01:15] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7fc317d1d040.
[17:01:18] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7fc317d1d040, 1/norm_const = 2.2285229856085104e-06.
[17:01:18] Finished creating a Facility Location Function.
[17:01:18] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1.
[17:01:18] Created function mixture with 1 component.
[17:01:18] Using 1 thread for summarization.
[17:01:18] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1.
[17:01:18] Gain permit type = 1, Gain threshold = 0.
[17:01:18] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647.
[17:01:18] ACGR: Computing 100000 singleton values.
[17:01:33] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain.
[17:01:33] ACGR: Building initial PQ.
[17:01:33] ACGR: Finished building initial PQ.
[17:01:33] ACGR: Finished running accelerated greedy, solution has 1 elements.
[17:01:33] Summarization time: CPU 14.955116s (User: 14.955116s; System: 0s); Wall Clock 14.955635191999999s.
[17:01:33] Computing final summary valuations.
[17:01:33] Summary valuation: f(Solution) = 9.9988415035e-01
[17:01:33] Computing conditional curvature for 1 elements.
[17:01:33] Computing conditional curvature.
[17:01:33] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08.
[17:01:33] Finished execution successfully, exiting ....
real 0m48.572s
user 0m18.210s
sys 0m17.111s
[17:01:33] ----- Submarine logging started -----
[17:01:33] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices ....
[17:01:33] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit.
[17:01:33] Using 22 threads for general operations.
[17:01:33] Command line: smraiz -flfilename /mnt/disks/ssd1/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks
[17:01:33] Loading FL matrix.
[17:01:33] RNPHR: Reading numpy file v1.0 with header size 70.
[17:01:33] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false.
[17:01:33] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false.
[17:01:33] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting.
[17:01:33] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000.
[17:01:35] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353.
[17:01:35] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706.
[17:01:36] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059.
[17:01:37] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412.
[17:01:37] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765.
[17:01:38] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118.
[17:01:39] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471.
[17:01:39] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824.
[17:01:41] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177.
[17:01:44] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530.
[17:01:45] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883.
[17:01:45] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236.
[17:01:46] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589.
[17:01:46] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942.
[17:01:47] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295.
[17:01:48] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648.
[17:01:49] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001.
[17:01:50] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354.
[17:01:50] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0.
[17:01:50] RMNF: directly read 100000x100000 numpy matrix.
[17:01:50] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7faa65440040.
[17:01:50] Loaded FL 100000x100000 matrix.
[17:01:50] No transform requested for loaded FL 100000x100000 matrix.
[17:01:50] Finished loading FL 100000x100000 matrix.
[17:01:50] Creating a Facility Location Function with a 100000x100000 matrix.
[17:01:50] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7faa65440040.
[17:01:53] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7faa65440040, 1/norm_const = 2.2285229856085104e-06.
[17:01:53] Finished creating a Facility Location Function.
[17:01:53] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1.
[17:01:53] Created function mixture with 1 component.
[17:01:53] Using 1 thread for summarization.
[17:01:53] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1.
[17:01:53] Gain permit type = 1, Gain threshold = 0.
[17:01:53] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647.
[17:01:53] ACGR: Computing 100000 singleton values.
[17:02:08] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain.
[17:02:08] ACGR: Building initial PQ.
[17:02:08] ACGR: Finished building initial PQ.
[17:02:08] ACGR: Finished running accelerated greedy, solution has 1 elements.
[17:02:08] Summarization time: CPU 15.018291s (User: 15.018291s; System: 0s); Wall Clock 15.019029713s.
[17:02:08] Computing final summary valuations.
[17:02:08] Summary valuation: f(Solution) = 9.9988415035e-01
[17:02:08] Computing conditional curvature for 1 elements.
[17:02:08] Computing conditional curvature.
[17:02:08] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08.
[17:02:08] Finished execution successfully, exiting ....
real 0m35.206s
user 0m18.264s
sys 0m13.808s
[17:02:09] ----- Submarine logging started -----
[17:02:09] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices ....
[17:02:09] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit.
[17:02:09] Using 22 threads for general operations.
[17:02:09] Command line: smraiz -flfilename /mnt/disks/ssd1/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks
[17:02:09] Loading FL matrix.
[17:02:09] RNPHR: Reading numpy file v1.0 with header size 70.
[17:02:09] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false.
[17:02:09] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false.
[17:02:09] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting.
[17:02:09] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000.
[17:02:09] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353.
[17:02:11] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706.
[17:02:12] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059.
[17:02:12] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412.
[17:02:13] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765.
[17:02:14] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118.
[17:02:14] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471.
[17:02:15] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824.
[17:02:16] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177.
[17:02:16] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530.
[17:02:17] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883.
[17:02:17] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236.
[17:02:18] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589.
[17:02:19] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942.
[17:02:19] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295.
[17:02:20] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648.
[17:02:21] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001.
[17:02:21] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354.
[17:02:22] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0.
[17:02:22] RMNF: directly read 100000x100000 numpy matrix.
[17:02:22] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7f7610c32040.
[17:02:22] Loaded FL 100000x100000 matrix.
[17:02:22] No transform requested for loaded FL 100000x100000 matrix.
[17:02:22] Finished loading FL 100000x100000 matrix.
[17:02:22] Creating a Facility Location Function with a 100000x100000 matrix.
[17:02:22] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7f7610c32040.
[17:02:25] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7f7610c32040, 1/norm_const = 2.2285229856085104e-06.
[17:02:25] Finished creating a Facility Location Function.
[17:02:25] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1.
[17:02:25] Created function mixture with 1 component.
[17:02:25] Using 1 thread for summarization.
[17:02:25] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1.
[17:02:25] Gain permit type = 1, Gain threshold = 0.
[17:02:25] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647.
[17:02:25] ACGR: Computing 100000 singleton values.
[17:02:40] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain.
[17:02:40] ACGR: Building initial PQ.
[17:02:40] ACGR: Finished building initial PQ.
[17:02:40] ACGR: Finished running accelerated greedy, solution has 1 elements.
[17:02:40] Summarization time: CPU 14.895523s (User: 14.893803s; System: 0.00172s); Wall Clock 14.896218615s.
[17:02:40] Computing final summary valuations.
[17:02:40] Summary valuation: f(Solution) = 9.9988415035e-01
[17:02:40] Computing conditional curvature for 1 elements.
[17:02:40] Computing conditional curvature.
[17:02:40] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08.
[17:02:40] Finished execution successfully, exiting ....
real 0m31.600s
user 0m18.113s
sys 0m12.604s
[17:02:40] ----- Submarine logging started -----
[17:02:40] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices ....
[17:02:40] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit.
[17:02:40] Using 22 threads for general operations.
[17:02:40] Command line: smraiz -flfilename /mnt/disks/ssd2/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks
[17:02:40] Loading FL matrix.
[17:02:40] RNPHR: Reading numpy file v1.0 with header size 70.
[17:02:40] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false.
[17:02:40] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false.
[17:02:40] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting.
[17:02:40] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000.
[17:02:43] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353.
[17:02:46] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706.
[17:02:49] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059.
[17:02:52] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412.
[17:02:55] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765.
[17:02:58] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118.
[17:03:01] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471.
[17:03:03] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824.
[17:03:06] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177.
[17:03:09] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530.
[17:03:12] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883.
[17:03:15] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236.
[17:03:18] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589.
[17:03:21] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942.
[17:03:24] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295.
[17:03:27] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648.
[17:03:30] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001.
[17:03:33] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354.
[17:03:34] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0.
[17:03:34] RMNF: directly read 100000x100000 numpy matrix.
[17:03:34] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7fb2ad76d040.
[17:03:34] Loaded FL 100000x100000 matrix.
[17:03:34] No transform requested for loaded FL 100000x100000 matrix.
[17:03:34] Finished loading FL 100000x100000 matrix.
[17:03:34] Creating a Facility Location Function with a 100000x100000 matrix.
[17:03:34] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7fb2ad76d040.
[17:03:38] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7fb2ad76d040, 1/norm_const = 2.2285229856085104e-06.
[17:03:38] Finished creating a Facility Location Function.
[17:03:38] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1.
[17:03:38] Created function mixture with 1 component.
[17:03:38] Using 1 thread for summarization.
[17:03:38] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1.
[17:03:38] Gain permit type = 1, Gain threshold = 0.
[17:03:38] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647.
[17:03:38] ACGR: Computing 100000 singleton values.
[17:03:53] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain.
[17:03:53] ACGR: Building initial PQ.
[17:03:53] ACGR: Finished building initial PQ.
[17:03:53] ACGR: Finished running accelerated greedy, solution has 1 elements.
[17:03:53] Summarization time: CPU 14.873961s (User: 14.873961s; System: 0s); Wall Clock 14.874654598s.
[17:03:53] Computing final summary valuations.
[17:03:53] Summary valuation: f(Solution) = 9.9988415035e-01
[17:03:53] Computing conditional curvature for 1 elements.
[17:03:53] Computing conditional curvature.
[17:03:53] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08.
[17:03:53] Finished execution successfully, exiting ....
real 1m12.478s
user 0m18.284s
sys 0m20.423s
[17:03:53] ----- Submarine logging started -----
[17:03:53] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices ....
[17:03:53] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit.
[17:03:53] Using 22 threads for general operations.
[17:03:53] Command line: smraiz -flfilename /mnt/disks/ssd2/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks
[17:03:53] Loading FL matrix.
[17:03:53] RNPHR: Reading numpy file v1.0 with header size 70.
[17:03:53] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false.
[17:03:53] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false.
[17:03:53] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting.
[17:03:53] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000.
[17:03:56] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353.
[17:03:58] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706.
[17:04:01] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059.
[17:04:04] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412.
[17:04:07] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765.
[17:04:10] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118.
[17:04:13] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471.
[17:04:16] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824.
[17:04:19] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177.
[17:04:22] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530.
[17:04:25] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883.
[17:04:28] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236.
[17:04:31] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589.
[17:04:33] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942.
[17:04:36] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295.
[17:04:39] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648.
[17:04:42] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001.
[17:04:45] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354.
[17:04:47] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0.
[17:04:47] RMNF: directly read 100000x100000 numpy matrix.
[17:04:47] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7fddbb638040.
[17:04:47] Loaded FL 100000x100000 matrix.
[17:04:47] No transform requested for loaded FL 100000x100000 matrix.
[17:04:47] Finished loading FL 100000x100000 matrix.
[17:04:47] Creating a Facility Location Function with a 100000x100000 matrix.
[17:04:47] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7fddbb638040.
[17:04:50] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7fddbb638040, 1/norm_const = 2.2285229856085104e-06.
[17:04:50] Finished creating a Facility Location Function.
[17:04:50] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1.
[17:04:50] Created function mixture with 1 component.
[17:04:50] Using 1 thread for summarization.
[17:04:50] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1.
[17:04:50] Gain permit type = 1, Gain threshold = 0.
[17:04:50] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647.
[17:04:50] ACGR: Computing 100000 singleton values.
[17:05:05] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain.
[17:05:05] ACGR: Building initial PQ.
[17:05:05] ACGR: Finished building initial PQ.
[17:05:05] ACGR: Finished running accelerated greedy, solution has 1 elements.
[17:05:05] Summarization time: CPU 15.14096s (User: 15.14096s; System: 0s); Wall Clock 15.143327201s.
[17:05:05] Computing final summary valuations.
[17:05:05] Summary valuation: f(Solution) = 9.9988415035e-01
[17:05:05] Computing conditional curvature for 1 elements.
[17:05:05] Computing conditional curvature.
[17:05:05] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08.
[17:05:05] Finished execution successfully, exiting ....
real 1m12.975s
user 0m18.377s
sys 0m22.028s
[17:05:06] ----- Submarine logging started -----
[17:05:06] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices ....
[17:05:06] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit.
[17:05:06] Using 22 threads for general operations.
[17:05:06] Command line: smraiz -flfilename /mnt/disks/ssd2/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks
[17:05:06] Loading FL matrix.
[17:05:06] RNPHR: Reading numpy file v1.0 with header size 70.
[17:05:06] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false.
[17:05:06] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false.
[17:05:06] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting.
[17:05:06] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000.
[17:05:06] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353.
[17:05:07] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706.
[17:05:08] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059.
[17:05:08] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412.
[17:05:09] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765.
[17:05:09] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118.
[17:05:10] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471.
[17:05:11] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824.
[17:05:11] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177.
[17:05:12] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530.
[17:05:13] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883.
[17:05:15] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236.
[17:05:18] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589.
[17:05:20] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942.
[17:05:22] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295.
[17:05:23] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648.
[17:05:24] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001.
[17:05:25] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354.
[17:05:25] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0.
[17:05:25] RMNF: directly read 100000x100000 numpy matrix.
[17:05:25] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7f6396d22040.
[17:05:25] Loaded FL 100000x100000 matrix.
[17:05:25] No transform requested for loaded FL 100000x100000 matrix.
[17:05:25] Finished loading FL 100000x100000 matrix.
[17:05:25] Creating a Facility Location Function with a 100000x100000 matrix.
[17:05:25] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7f6396d22040.
[17:05:29] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7f6396d22040, 1/norm_const = 2.2285229856085104e-06.
[17:05:29] Finished creating a Facility Location Function.
[17:05:29] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1.
[17:05:29] Created function mixture with 1 component.
[17:05:29] Using 1 thread for summarization.
[17:05:29] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1.
[17:05:29] Gain permit type = 1, Gain threshold = 0.
[17:05:29] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647.
[17:05:29] ACGR: Computing 100000 singleton values.
[17:05:44] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain.
[17:05:44] ACGR: Building initial PQ.
[17:05:44] ACGR: Finished building initial PQ.
[17:05:44] ACGR: Finished running accelerated greedy, solution has 1 elements.
[17:05:44] Summarization time: CPU 14.915012s (User: 14.909299s; System: 0.005713s); Wall Clock 14.915481162s.
[17:05:44] Computing final summary valuations.
[17:05:44] Summary valuation: f(Solution) = 9.9988415035e-01
[17:05:44] Computing conditional curvature for 1 elements.
[17:05:44] Computing conditional curvature.
[17:05:44] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08.
[17:05:44] Finished execution successfully, exiting ....
real 0m38.181s
user 0m18.111s
sys 0m14.801s
[17:05:44] ----- Submarine logging started -----
[17:05:44] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices ....
[17:05:44] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit.
[17:05:44] Using 22 threads for general operations.
[17:05:44] Command line: smraiz -flfilename /mnt/disks/ssd2/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks
[17:05:44] Loading FL matrix.
[17:05:44] RNPHR: Reading numpy file v1.0 with header size 70.
[17:05:44] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false.
[17:05:44] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false.
[17:05:44] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting.
[17:05:44] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000.
[17:05:44] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353.
[17:05:45] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706.
[17:05:46] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059.
[17:05:46] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412.
[17:05:47] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765.
[17:05:48] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118.
[17:05:48] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471.
[17:05:49] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824.
[17:05:49] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177.
[17:05:50] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530.
[17:05:51] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883.
[17:05:51] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236.
[17:05:52] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589.
[17:05:53] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942.
[17:05:53] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295.
[17:05:54] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648.
[17:05:55] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001.
[17:05:56] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354.
[17:05:57] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0.
[17:05:57] RMNF: directly read 100000x100000 numpy matrix.
[17:05:57] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7f4238b47040.
[17:05:57] Loaded FL 100000x100000 matrix.
[17:05:57] No transform requested for loaded FL 100000x100000 matrix.
[17:05:57] Finished loading FL 100000x100000 matrix.
[17:05:57] Creating a Facility Location Function with a 100000x100000 matrix.
[17:05:57] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7f4238b47040.
[17:06:00] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7f4238b47040, 1/norm_const = 2.2285229856085104e-06.
[17:06:00] Finished creating a Facility Location Function.
[17:06:00] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1.
[17:06:00] Created function mixture with 1 component.
[17:06:00] Using 1 thread for summarization.
[17:06:00] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1.
[17:06:00] Gain permit type = 1, Gain threshold = 0.
[17:06:00] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647.
[17:06:00] ACGR: Computing 100000 singleton values.
[17:06:15] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain.
[17:06:15] ACGR: Building initial PQ.
[17:06:15] ACGR: Finished building initial PQ.
[17:06:15] ACGR: Finished running accelerated greedy, solution has 1 elements.
[17:06:15] Summarization time: CPU 15.01097s (User: 15.009777s; System: 0.001193s); Wall Clock 15.011550100000001s.
[17:06:15] Computing final summary valuations.
[17:06:15] Summary valuation: f(Solution) = 9.9988415035e-01
[17:06:15] Computing conditional curvature for 1 elements.
[17:06:15] Computing conditional curvature.
[17:06:15] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08.
[17:06:15] Finished execution successfully, exiting ....
real 0m31.402s
user 0m18.333s
sys 0m13.066s
[17:06:15] ----- Submarine logging started -----
[17:06:15] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices ....
[17:06:15] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit.
[17:06:15] Using 22 threads for general operations.
[17:06:15] Command line: smraiz -flfilename /mnt/disks/ssd2/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks
[17:06:15] Loading FL matrix.
[17:06:15] RNPHR: Reading numpy file v1.0 with header size 70.
[17:06:15] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false.
[17:06:15] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false.
[17:06:15] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting.
[17:06:15] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000.
[17:06:16] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353.
[17:06:17] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706.
[17:06:17] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059.
[17:06:18] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412.
[17:06:18] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765.
[17:06:19] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118.
[17:06:20] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471.
[17:06:20] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824.
[17:06:21] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177.
[17:06:22] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530.
[17:06:22] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883.
[17:06:23] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236.
[17:06:24] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589.
[17:06:24] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942.
[17:06:25] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295.
[17:06:26] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648.
[17:06:27] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001.
[17:06:28] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354.
[17:06:28] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0.
[17:06:28] RMNF: directly read 100000x100000 numpy matrix.
[17:06:28] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7ef77ca7d040.
[17:06:28] Loaded FL 100000x100000 matrix.
[17:06:28] No transform requested for loaded FL 100000x100000 matrix.
[17:06:28] Finished loading FL 100000x100000 matrix.
[17:06:28] Creating a Facility Location Function with a 100000x100000 matrix.
[17:06:28] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7ef77ca7d040.
[17:06:32] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7ef77ca7d040, 1/norm_const = 2.2285229856085104e-06.
[17:06:32] Finished creating a Facility Location Function.
[17:06:32] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1.
[17:06:32] Created function mixture with 1 component.
[17:06:32] Using 1 thread for summarization.
[17:06:32] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1.
[17:06:32] Gain permit type = 1, Gain threshold = 0.
[17:06:32] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647.
[17:06:32] ACGR: Computing 100000 singleton values.
[17:06:47] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain.
[17:06:47] ACGR: Building initial PQ.
[17:06:47] ACGR: Finished building initial PQ.
[17:06:47] ACGR: Finished running accelerated greedy, solution has 1 elements.
[17:06:47] Summarization time: CPU 15.019812s (User: 15.019812s; System: 0s); Wall Clock 15.020345654s.
[17:06:47] Computing final summary valuations.
[17:06:47] Summary valuation: f(Solution) = 9.9988415035e-01
[17:06:47] Computing conditional curvature for 1 elements.
[17:06:47] Computing conditional curvature.
[17:06:47] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08.
[17:06:47] Finished execution successfully, exiting ....
real 0m31.592s
user 0m18.279s
sys 0m13.311s
[17:06:47] ----- Submarine logging started -----
[17:06:47] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices ....
[17:06:47] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit.
[17:06:47] Using 22 threads for general operations.
[17:06:47] Command line: smraiz -flfilename /mnt/disks/ssd3/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks
[17:06:47] Loading FL matrix.
[17:06:47] RNPHR: Reading numpy file v1.0 with header size 70.
[17:06:47] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false.
[17:06:47] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false.
[17:06:47] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting.
[17:06:47] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000.
[17:06:50] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353.
[17:06:53] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706.
[17:06:56] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059.
[17:06:58] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412.
[17:07:01] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765.
[17:07:04] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118.
[17:07:07] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471.
[17:07:10] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824.
[17:07:13] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177.
[17:07:16] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530.
[17:07:19] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883.
[17:07:22] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236.
[17:07:25] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589.
[17:07:28] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942.
[17:07:31] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295.
[17:07:33] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648.
[17:07:36] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001.
[17:07:39] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354.
[17:07:41] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0.
[17:07:41] RMNF: directly read 100000x100000 numpy matrix.
[17:07:41] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7f205461c040.
[17:07:41] Loaded FL 100000x100000 matrix.
[17:07:41] No transform requested for loaded FL 100000x100000 matrix.
[17:07:41] Finished loading FL 100000x100000 matrix.
[17:07:41] Creating a Facility Location Function with a 100000x100000 matrix.
[17:07:41] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7f205461c040.
[17:07:44] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7f205461c040, 1/norm_const = 2.2285229856085104e-06.
[17:07:44] Finished creating a Facility Location Function.
[17:07:44] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1.
[17:07:44] Created function mixture with 1 component.
[17:07:44] Using 1 thread for summarization.
[17:07:44] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1.
[17:07:44] Gain permit type = 1, Gain threshold = 0.
[17:07:44] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647.
[17:07:44] ACGR: Computing 100000 singleton values.
[17:07:59] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain.
[17:07:59] ACGR: Building initial PQ.
[17:07:59] ACGR: Finished building initial PQ.
[17:07:59] ACGR: Finished running accelerated greedy, solution has 1 elements.
[17:07:59] Summarization time: CPU 15.07693s (User: 15.07693s; System: 0s); Wall Clock 15.077365896s.
[17:07:59] Computing final summary valuations.
[17:07:59] Summary valuation: f(Solution) = 9.9988415035e-01
[17:07:59] Computing conditional curvature for 1 elements.
[17:07:59] Computing conditional curvature.
[17:07:59] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08.
[17:07:59] Finished execution successfully, exiting ....
real 1m12.893s
user 0m18.488s
sys 0m20.959s
[17:08:00] ----- Submarine logging started -----
[17:08:00] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices ....
[17:08:00] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit.
[17:08:00] Using 22 threads for general operations.
[17:08:00] Command line: smraiz -flfilename /mnt/disks/ssd3/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks
[17:08:00] Loading FL matrix.
[17:08:00] RNPHR: Reading numpy file v1.0 with header size 70.
[17:08:00] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false.
[17:08:00] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false.
[17:08:00] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting.
[17:08:00] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000.
[17:08:03] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353.
[17:08:06] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706.
[17:08:08] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059.
[17:08:11] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412.
[17:08:14] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765.
[17:08:17] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118.
[17:08:20] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471.
[17:08:23] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824.
[17:08:26] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177.
[17:08:29] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530.
[17:08:32] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883.
[17:08:35] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236.
[17:08:38] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589.
[17:08:40] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942.
[17:08:43] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295.
[17:08:46] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648.
[17:08:49] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001.
[17:08:52] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354.
[17:08:54] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0.
[17:08:54] RMNF: directly read 100000x100000 numpy matrix.
[17:08:54] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7f54efad2040.
[17:08:54] Loaded FL 100000x100000 matrix.
[17:08:54] No transform requested for loaded FL 100000x100000 matrix.
[17:08:54] Finished loading FL 100000x100000 matrix.
[17:08:54] Creating a Facility Location Function with a 100000x100000 matrix.
[17:08:54] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7f54efad2040.
[17:08:57] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7f54efad2040, 1/norm_const = 2.2285229856085104e-06.
[17:08:57] Finished creating a Facility Location Function.
[17:08:57] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1.
[17:08:57] Created function mixture with 1 component.
[17:08:57] Using 1 thread for summarization.
[17:08:57] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1.
[17:08:57] Gain permit type = 1, Gain threshold = 0.
[17:08:57] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647.
[17:08:57] ACGR: Computing 100000 singleton values.
[17:09:12] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain.
[17:09:12] ACGR: Building initial PQ.
[17:09:12] ACGR: Finished building initial PQ.
[17:09:12] ACGR: Finished running accelerated greedy, solution has 1 elements.
[17:09:12] Summarization time: CPU 15.029378s (User: 15.029378s; System: 0s); Wall Clock 15.030304303000001s.
[17:09:12] Computing final summary valuations.
[17:09:12] Summary valuation: f(Solution) = 9.9988415035e-01
[17:09:12] Computing conditional curvature for 1 elements.
[17:09:12] Computing conditional curvature.
[17:09:12] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08.
[17:09:12] Finished execution successfully, exiting ....
real 1m12.749s
user 0m18.248s
sys 0m21.672s
[17:09:12] ----- Submarine logging started -----
[17:09:12] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices ....
[17:09:12] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit.
[17:09:12] Using 22 threads for general operations.
[17:09:12] Command line: smraiz -flfilename /mnt/disks/ssd3/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks
[17:09:12] Loading FL matrix.
[17:09:12] RNPHR: Reading numpy file v1.0 with header size 70.
[17:09:12] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false.
[17:09:12] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false.
[17:09:12] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting.
[17:09:12] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000.
[17:09:13] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353.
[17:09:14] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706.
[17:09:14] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059.
[17:09:15] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412.
[17:09:16] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765.
[17:09:16] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118.
[17:09:17] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471.
[17:09:18] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824.
[17:09:18] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177.
[17:09:19] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530.
[17:09:19] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883.
[17:09:22] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236.
[17:09:25] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589.
[17:09:28] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942.
[17:09:29] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295.
[17:09:31] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648.
[17:09:32] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001.
[17:09:33] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354.
[17:09:33] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0.
[17:09:33] RMNF: directly read 100000x100000 numpy matrix.
[17:09:33] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7f0728146040.
[17:09:33] Loaded FL 100000x100000 matrix.
[17:09:33] No transform requested for loaded FL 100000x100000 matrix.
[17:09:33] Finished loading FL 100000x100000 matrix.
[17:09:33] Creating a Facility Location Function with a 100000x100000 matrix.
[17:09:33] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7f0728146040.
[17:09:37] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7f0728146040, 1/norm_const = 2.2285229856085104e-06.
[17:09:37] Finished creating a Facility Location Function.
[17:09:37] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1.
[17:09:37] Created function mixture with 1 component.
[17:09:37] Using 1 thread for summarization.
[17:09:37] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1.
[17:09:37] Gain permit type = 1, Gain threshold = 0.
[17:09:37] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647.
[17:09:37] ACGR: Computing 100000 singleton values.
[17:09:52] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain.
[17:09:52] ACGR: Building initial PQ.
[17:09:52] ACGR: Finished building initial PQ.
[17:09:52] ACGR: Finished running accelerated greedy, solution has 1 elements.
[17:09:52] Summarization time: CPU 15.025878s (User: 15.025878s; System: 0s); Wall Clock 15.026298205s.
[17:09:52] Computing final summary valuations.
[17:09:52] Summary valuation: f(Solution) = 9.9988415035e-01
[17:09:52] Computing conditional curvature for 1 elements.
[17:09:52] Computing conditional curvature.
[17:09:52] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08.
[17:09:52] Finished execution successfully, exiting ....
real 0m39.365s
user 0m18.243s
sys 0m14.838s
[17:09:52] ----- Submarine logging started -----
[17:09:52] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices ....
[17:09:52] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit.
[17:09:52] Using 22 threads for general operations.
[17:09:52] Command line: smraiz -flfilename /mnt/disks/ssd3/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks
[17:09:52] Loading FL matrix.
[17:09:52] RNPHR: Reading numpy file v1.0 with header size 70.
[17:09:52] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false.
[17:09:52] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false.
[17:09:52] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting.
[17:09:52] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000.
[17:09:52] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353.
[17:09:53] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706.
[17:09:54] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059.
[17:09:54] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412.
[17:09:55] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765.
[17:09:56] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118.
[17:09:56] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471.
[17:09:57] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824.
[17:09:58] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177.
[17:09:58] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530.
[17:09:59] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883.
[17:09:59] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236.
[17:10:00] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589.
[17:10:01] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942.
[17:10:01] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295.
[17:10:02] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648.
[17:10:03] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001.
[17:10:04] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354.
[17:10:04] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0.
[17:10:04] RMNF: directly read 100000x100000 numpy matrix.
[17:10:04] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7fce5d592040.
[17:10:04] Loaded FL 100000x100000 matrix.
[17:10:04] No transform requested for loaded FL 100000x100000 matrix.
[17:10:04] Finished loading FL 100000x100000 matrix.
[17:10:04] Creating a Facility Location Function with a 100000x100000 matrix.
[17:10:04] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7fce5d592040.
[17:10:08] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7fce5d592040, 1/norm_const = 2.2285229856085104e-06.
[17:10:08] Finished creating a Facility Location Function.
[17:10:08] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1.
[17:10:08] Created function mixture with 1 component.
[17:10:08] Using 1 thread for summarization.
[17:10:08] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1.
[17:10:08] Gain permit type = 1, Gain threshold = 0.
[17:10:08] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647.
[17:10:08] ACGR: Computing 100000 singleton values.
[17:10:23] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain.
[17:10:23] ACGR: Building initial PQ.
[17:10:23] ACGR: Finished building initial PQ.
[17:10:23] ACGR: Finished running accelerated greedy, solution has 1 elements.
[17:10:23] Summarization time: CPU 14.959245s (User: 14.957891s; System: 0.001354s); Wall Clock 14.959705832s.
[17:10:23] Computing final summary valuations.
[17:10:23] Summary valuation: f(Solution) = 9.9988415035e-01
[17:10:23] Computing conditional curvature for 1 elements.
[17:10:23] Computing conditional curvature.
[17:10:23] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08.
[17:10:23] Finished execution successfully, exiting ....
real 0m31.024s
user 0m18.181s
sys 0m12.837s
[17:10:23] ----- Submarine logging started -----
[17:10:23] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices ....
[17:10:23] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit.
[17:10:23] Using 22 threads for general operations.
[17:10:23] Command line: smraiz -flfilename /mnt/disks/ssd3/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks
[17:10:23] Loading FL matrix.
[17:10:23] RNPHR: Reading numpy file v1.0 with header size 70.
[17:10:23] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false.
[17:10:23] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false.
[17:10:23] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting.
[17:10:23] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000.
[17:10:24] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353.
[17:10:24] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706.
[17:10:25] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059.
[17:10:25] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412.
[17:10:26] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765.
[17:10:27] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118.
[17:10:27] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471.
[17:10:28] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824.
[17:10:29] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177.
[17:10:29] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530.
[17:10:30] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883.
[17:10:31] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236.
[17:10:31] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589.
[17:10:32] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942.
[17:10:32] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295.
[17:10:33] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648.
[17:10:34] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001.
[17:10:35] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354.
[17:10:35] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0.
[17:10:35] RMNF: directly read 100000x100000 numpy matrix.
[17:10:35] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7fa216baf040.
[17:10:35] Loaded FL 100000x100000 matrix.
[17:10:35] No transform requested for loaded FL 100000x100000 matrix.
[17:10:35] Finished loading FL 100000x100000 matrix.
[17:10:35] Creating a Facility Location Function with a 100000x100000 matrix.
[17:10:35] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7fa216baf040.
[17:10:38] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7fa216baf040, 1/norm_const = 2.2285229856085104e-06.
[17:10:38] Finished creating a Facility Location Function.
[17:10:38] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1.
[17:10:38] Created function mixture with 1 component.
[17:10:38] Using 1 thread for summarization.
[17:10:38] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1.
[17:10:38] Gain permit type = 1, Gain threshold = 0.
[17:10:38] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647.
[17:10:38] ACGR: Computing 100000 singleton values.
[17:10:53] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain.
[17:10:53] ACGR: Building initial PQ.
[17:10:53] ACGR: Finished building initial PQ.
[17:10:53] ACGR: Finished running accelerated greedy, solution has 1 elements.
[17:10:53] Summarization time: CPU 14.952793s (User: 14.944103s; System: 0.00869s); Wall Clock 14.953541663s.
[17:10:53] Computing final summary valuations.
[17:10:53] Summary valuation: f(Solution) = 9.9988415035e-01
[17:10:53] Computing conditional curvature for 1 elements.
[17:10:53] Computing conditional curvature.
[17:10:53] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08.
[17:10:53] Finished execution successfully, exiting ....
real 0m30.597s
user 0m18.164s
sys 0m12.431s
[17:10:53] ----- Submarine logging started -----
[17:10:53] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices ....
[17:10:53] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit.
[17:10:53] Using 22 threads for general operations.
[17:10:53] Command line: smraiz -flfilename /mnt/disks/ssd4/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks
[17:10:53] Loading FL matrix.
[17:10:53] RNPHR: Reading numpy file v1.0 with header size 70.
[17:10:53] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false.
[17:10:53] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false.
[17:10:53] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting.
[17:10:53] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000.
[17:10:56] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353.
[17:10:59] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706.
[17:11:02] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059.
[17:11:05] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412.
[17:11:08] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765.
[17:11:11] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118.
[17:11:14] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471.
[17:11:17] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824.
[17:11:20] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177.
[17:11:23] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530.
[17:11:25] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883.
[17:11:28] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236.
[17:11:31] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589.
[17:11:34] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942.
[17:11:37] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295.
[17:11:40] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648.
[17:11:43] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001.
[17:11:46] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354.
[17:11:48] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0.
[17:11:48] RMNF: directly read 100000x100000 numpy matrix.
[17:11:48] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7f1fa1346040.
[17:11:48] Loaded FL 100000x100000 matrix.
[17:11:48] No transform requested for loaded FL 100000x100000 matrix.
[17:11:48] Finished loading FL 100000x100000 matrix.
[17:11:48] Creating a Facility Location Function with a 100000x100000 matrix.
[17:11:48] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7f1fa1346040.
[17:11:51] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7f1fa1346040, 1/norm_const = 2.2285229856085104e-06.
[17:11:51] Finished creating a Facility Location Function.
[17:11:51] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1.
[17:11:51] Created function mixture with 1 component.
[17:11:51] Using 1 thread for summarization.
[17:11:51] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1.
[17:11:51] Gain permit type = 1, Gain threshold = 0.
[17:11:51] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647.
[17:11:51] ACGR: Computing 100000 singleton values.
[17:12:06] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain.
[17:12:06] ACGR: Building initial PQ.
[17:12:06] ACGR: Finished building initial PQ.
[17:12:06] ACGR: Finished running accelerated greedy, solution has 1 elements.
[17:12:06] Summarization time: CPU 15.036308s (User: 15.036308s; System: 0s); Wall Clock 15.036772725s.
[17:12:06] Computing final summary valuations.
[17:12:06] Summary valuation: f(Solution) = 9.9988415035e-01
[17:12:06] Computing conditional curvature for 1 elements.
[17:12:06] Computing conditional curvature.
[17:12:06] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08.
[17:12:06] Finished execution successfully, exiting ....
real 1m12.775s
user 0m18.350s
sys 0m21.262s
[17:12:06] ----- Submarine logging started -----
[17:12:06] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices ....
[17:12:06] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit.
[17:12:06] Using 22 threads for general operations.
[17:12:06] Command line: smraiz -flfilename /mnt/disks/ssd4/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks
[17:12:06] Loading FL matrix.
[17:12:06] RNPHR: Reading numpy file v1.0 with header size 70.
[17:12:06] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false.
[17:12:06] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false.
[17:12:06] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting.
[17:12:06] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000.
[17:12:09] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353.
[17:12:12] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706.
[17:12:15] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059.
[17:12:18] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412.
[17:12:21] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765.
[17:12:24] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118.
[17:12:27] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471.
[17:12:30] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824.
[17:12:32] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177.
[17:12:35] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530.
[17:12:38] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883.
[17:12:41] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236.
[17:12:44] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589.
[17:12:47] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942.
[17:12:50] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295.
[17:12:53] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648.
[17:12:56] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001.
[17:12:59] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354.
[17:13:00] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0.
[17:13:00] RMNF: directly read 100000x100000 numpy matrix.
[17:13:00] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7fbafef1c040.
[17:13:00] Loaded FL 100000x100000 matrix.
[17:13:00] No transform requested for loaded FL 100000x100000 matrix.
[17:13:00] Finished loading FL 100000x100000 matrix.
[17:13:00] Creating a Facility Location Function with a 100000x100000 matrix.
[17:13:00] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7fbafef1c040.
[17:13:04] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7fbafef1c040, 1/norm_const = 2.2285229856085104e-06.
[17:13:04] Finished creating a Facility Location Function.
[17:13:04] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1.
[17:13:04] Created function mixture with 1 component.
[17:13:04] Using 1 thread for summarization.
[17:13:04] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1.
[17:13:04] Gain permit type = 1, Gain threshold = 0.
[17:13:04] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647.
[17:13:04] ACGR: Computing 100000 singleton values.
[17:13:19] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain.
[17:13:19] ACGR: Building initial PQ.
[17:13:19] ACGR: Finished building initial PQ.
[17:13:19] ACGR: Finished running accelerated greedy, solution has 1 elements.
[17:13:19] Summarization time: CPU 15.276239s (User: 15.276239s; System: 0s); Wall Clock 15.278974932999999s.
[17:13:19] Computing final summary valuations.
[17:13:19] Summary valuation: f(Solution) = 9.9988415035e-01
[17:13:19] Computing conditional curvature for 1 elements.
[17:13:19] Computing conditional curvature.
[17:13:19] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08.
[17:13:19] Finished execution successfully, exiting ....
real 1m13.490s
user 0m18.891s
sys 0m22.446s
[17:13:20] ----- Submarine logging started -----
[17:13:20] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices ....
[17:13:20] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit.
[17:13:20] Using 22 threads for general operations.
[17:13:20] Command line: smraiz -flfilename /mnt/disks/ssd4/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks
[17:13:20] Loading FL matrix.
[17:13:20] RNPHR: Reading numpy file v1.0 with header size 70.
[17:13:20] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false.
[17:13:20] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false.
[17:13:20] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting.
[17:13:20] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000.
[17:13:20] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353.
[17:13:21] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706.
[17:13:22] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059.
[17:13:22] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412.
[17:13:23] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765.
[17:13:24] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118.
[17:13:24] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471.
[17:13:25] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824.
[17:13:25] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177.
[17:13:26] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530.
[17:13:27] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883.
[17:13:28] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236.
[17:13:31] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589.
[17:13:34] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942.
[17:13:35] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295.
[17:13:36] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648.
[17:13:37] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001.
[17:13:38] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354.
[17:13:38] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0.
[17:13:38] RMNF: directly read 100000x100000 numpy matrix.
[17:13:38] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7f7030196040.
[17:13:38] Loaded FL 100000x100000 matrix.
[17:13:38] No transform requested for loaded FL 100000x100000 matrix.
[17:13:38] Finished loading FL 100000x100000 matrix.
[17:13:38] Creating a Facility Location Function with a 100000x100000 matrix.
[17:13:38] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7f7030196040.
[17:13:42] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7f7030196040, 1/norm_const = 2.2285229856085104e-06.
[17:13:42] Finished creating a Facility Location Function.
[17:13:42] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1.
[17:13:42] Created function mixture with 1 component.
[17:13:42] Using 1 thread for summarization.
[17:13:42] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1.
[17:13:42] Gain permit type = 1, Gain threshold = 0.
[17:13:42] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647.
[17:13:42] ACGR: Computing 100000 singleton values.
[17:13:57] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain.
[17:13:57] ACGR: Building initial PQ.
[17:13:57] ACGR: Finished building initial PQ.
[17:13:57] ACGR: Finished running accelerated greedy, solution has 1 elements.
[17:13:57] Summarization time: CPU 15.064633s (User: 15.064633s; System: 0s); Wall Clock 15.065159453s.
[17:13:57] Computing final summary valuations.
[17:13:57] Summary valuation: f(Solution) = 9.9988415035e-01
[17:13:57] Computing conditional curvature for 1 elements.
[17:13:57] Computing conditional curvature.
[17:13:57] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08.
[17:13:57] Finished execution successfully, exiting ....
real 0m37.378s
user 0m18.309s
sys 0m14.997s
[17:13:57] ----- Submarine logging started -----
[17:13:57] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices ....
[17:13:57] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit.
[17:13:57] Using 22 threads for general operations.
[17:13:57] Command line: smraiz -flfilename /mnt/disks/ssd4/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks
[17:13:57] Loading FL matrix.
[17:13:57] RNPHR: Reading numpy file v1.0 with header size 70.
[17:13:57] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false.
[17:13:57] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false.
[17:13:57] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting.
[17:13:57] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000.
[17:13:58] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353.
[17:13:58] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706.
[17:13:59] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059.
[17:14:00] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412.
[17:14:00] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765.
[17:14:01] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118.
[17:14:02] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471.
[17:14:02] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824.
[17:14:03] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177.
[17:14:03] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530.
[17:14:04] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883.
[17:14:05] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236.
[17:14:05] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589.
[17:14:06] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942.
[17:14:07] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295.
[17:14:08] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648.
[17:14:09] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001.
[17:14:10] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354.
[17:14:10] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0.
[17:14:10] RMNF: directly read 100000x100000 numpy matrix.
[17:14:10] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7f8c0e60b040.
[17:14:10] Loaded FL 100000x100000 matrix.
[17:14:10] No transform requested for loaded FL 100000x100000 matrix.
[17:14:10] Finished loading FL 100000x100000 matrix.
[17:14:10] Creating a Facility Location Function with a 100000x100000 matrix.
[17:14:10] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7f8c0e60b040.
[17:14:13] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7f8c0e60b040, 1/norm_const = 2.2285229856085104e-06.
[17:14:13] Finished creating a Facility Location Function.
[17:14:13] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1.
[17:14:13] Created function mixture with 1 component.
[17:14:13] Using 1 thread for summarization.
[17:14:13] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1.
[17:14:13] Gain permit type = 1, Gain threshold = 0.
[17:14:13] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647.
[17:14:13] ACGR: Computing 100000 singleton values.
[17:14:28] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain.
[17:14:28] ACGR: Building initial PQ.
[17:14:28] ACGR: Finished building initial PQ.
[17:14:28] ACGR: Finished running accelerated greedy, solution has 1 elements.
[17:14:28] Summarization time: CPU 15.157068s (User: 15.157068s; System: 0s); Wall Clock 15.157636216999999s.
[17:14:28] Computing final summary valuations.
[17:14:28] Summary valuation: f(Solution) = 9.9988415035e-01
[17:14:28] Computing conditional curvature for 1 elements.
[17:14:28] Computing conditional curvature.
[17:14:28] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08.
[17:14:28] Finished execution successfully, exiting ....
real 0m31.757s
user 0m18.383s
sys 0m13.371s
[17:14:29] ----- Submarine logging started -----
[17:14:29] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices ....
[17:14:29] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit.
[17:14:29] Using 22 threads for general operations.
[17:14:29] Command line: smraiz -flfilename /mnt/disks/ssd4/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks
[17:14:29] Loading FL matrix.
[17:14:29] RNPHR: Reading numpy file v1.0 with header size 70.
[17:14:29] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false.
[17:14:29] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false.
[17:14:29] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting.
[17:14:29] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000.
[17:14:30] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353.
[17:14:30] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706.
[17:14:31] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059.
[17:14:31] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412.
[17:14:32] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765.
[17:14:33] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118.
[17:14:33] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471.
[17:14:34] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824.
[17:14:35] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177.
[17:14:35] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530.
[17:14:36] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883.
[17:14:36] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236.
[17:14:37] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589.
[17:14:38] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942.
[17:14:39] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295.
[17:14:40] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648.
[17:14:40] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001.
[17:14:41] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354.
[17:14:42] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0.
[17:14:42] RMNF: directly read 100000x100000 numpy matrix.
[17:14:42] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7fdf13f47040.
[17:14:42] Loaded FL 100000x100000 matrix.
[17:14:42] No transform requested for loaded FL 100000x100000 matrix.
[17:14:42] Finished loading FL 100000x100000 matrix.
[17:14:42] Creating a Facility Location Function with a 100000x100000 matrix.
[17:14:42] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7fdf13f47040.
[17:14:45] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7fdf13f47040, 1/norm_const = 2.2285229856085104e-06.
[17:14:45] Finished creating a Facility Location Function.
[17:14:45] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1.
[17:14:45] Created function mixture with 1 component.
[17:14:45] Using 1 thread for summarization.
[17:14:45] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1.
[17:14:45] Gain permit type = 1, Gain threshold = 0.
[17:14:45] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647.
[17:14:45] ACGR: Computing 100000 singleton values.
[17:15:00] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain.
[17:15:00] ACGR: Building initial PQ.
[17:15:00] ACGR: Finished building initial PQ.
[17:15:00] ACGR: Finished running accelerated greedy, solution has 1 elements.
[17:15:00] Summarization time: CPU 15.181177s (User: 15.178063s; System: 0.003114s); Wall Clock 15.18177117s.
[17:15:00] Computing final summary valuations.
[17:15:00] Summary valuation: f(Solution) = 9.9988415035e-01
[17:15:00] Computing conditional curvature for 1 elements.
[17:15:00] Computing conditional curvature.
[17:15:00] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08.
[17:15:00] Finished execution successfully, exiting ....
real 0m31.797s
user 0m18.415s
sys 0m13.379s
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment