Created
September 8, 2023 17:53
-
-
Save meghbhalerao/8ef4f971fd4391e14bdaccf290fd82bc to your computer and use it in GitHub Desktop.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| [16:55:34] ----- Submarine logging started ----- | |
| [16:55:34] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices .... | |
| [16:55:34] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit. | |
| [16:55:34] Using 22 threads for general operations. | |
| [16:55:34] Command line: smraiz -flfilename /mnt/disks/spinning_scratch0/smrai-container-documentation/src/saved_results/tinyimagenet/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks | |
| [16:55:34] Loading FL matrix. | |
| [16:55:34] RNPHR: Reading numpy file v1.0 with header size 70. | |
| [16:55:34] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false. | |
| [16:55:34] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false. | |
| [16:55:34] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting. | |
| [16:55:34] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000. | |
| [16:55:35] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353. | |
| [16:55:36] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706. | |
| [16:55:37] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059. | |
| [16:55:38] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412. | |
| [16:55:39] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765. | |
| [16:55:39] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118. | |
| [16:55:40] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471. | |
| [16:55:41] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824. | |
| [16:55:42] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177. | |
| [16:55:43] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530. | |
| [16:55:44] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883. | |
| [16:55:44] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236. | |
| [16:55:45] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589. | |
| [16:55:46] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942. | |
| [16:55:47] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295. | |
| [16:55:48] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648. | |
| [16:55:49] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001. | |
| [16:55:49] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354. | |
| [16:55:50] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0. | |
| [16:55:50] RMNF: directly read 100000x100000 numpy matrix. | |
| [16:55:50] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7f0462a63040. | |
| [16:55:50] Loaded FL 100000x100000 matrix. | |
| [16:55:50] No transform requested for loaded FL 100000x100000 matrix. | |
| [16:55:50] Finished loading FL 100000x100000 matrix. | |
| [16:55:50] Creating a Facility Location Function with a 100000x100000 matrix. | |
| [16:55:50] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7f0462a63040. | |
| [16:55:53] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7f0462a63040, 1/norm_const = 2.2285229856085104e-06. | |
| [16:55:53] Finished creating a Facility Location Function. | |
| [16:55:53] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1. | |
| [16:55:53] Created function mixture with 1 component. | |
| [16:55:53] Using 1 thread for summarization. | |
| [16:55:53] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1. | |
| [16:55:53] Gain permit type = 1, Gain threshold = 0. | |
| [16:55:53] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647. | |
| [16:55:53] ACGR: Computing 100000 singleton values. | |
| [16:56:09] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain. | |
| [16:56:09] ACGR: Building initial PQ. | |
| [16:56:09] ACGR: Finished building initial PQ. | |
| [16:56:09] ACGR: Finished running accelerated greedy, solution has 1 elements. | |
| [16:56:09] Summarization time: CPU 15.558601s (User: 15.558601s; System: 0s); Wall Clock 15.559099786s. | |
| [16:56:09] Computing final summary valuations. | |
| [16:56:09] Summary valuation: f(Solution) = 9.9988415035e-01 | |
| [16:56:09] Computing conditional curvature for 1 elements. | |
| [16:56:09] Computing conditional curvature. | |
| [16:56:09] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08. | |
| [16:56:09] Finished execution successfully, exiting .... | |
| real 0m35.520s | |
| user 0m18.749s | |
| sys 0m16.765s | |
| [16:56:10] ----- Submarine logging started ----- | |
| [16:56:10] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices .... | |
| [16:56:10] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit. | |
| [16:56:10] Using 22 threads for general operations. | |
| [16:56:10] Command line: smraiz -flfilename /mnt/disks/spinning_scratch0/smrai-container-documentation/src/saved_results/tinyimagenet/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks | |
| [16:56:10] Loading FL matrix. | |
| [16:56:10] RNPHR: Reading numpy file v1.0 with header size 70. | |
| [16:56:10] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false. | |
| [16:56:10] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false. | |
| [16:56:10] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting. | |
| [16:56:10] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000. | |
| [16:56:10] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353. | |
| [16:56:11] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706. | |
| [16:56:12] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059. | |
| [16:56:12] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412. | |
| [16:56:13] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765. | |
| [16:56:14] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118. | |
| [16:56:14] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471. | |
| [16:56:15] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824. | |
| [16:56:15] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177. | |
| [16:56:16] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530. | |
| [16:56:17] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883. | |
| [16:56:18] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236. | |
| [16:56:19] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589. | |
| [16:56:19] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942. | |
| [16:56:20] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295. | |
| [16:56:21] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648. | |
| [16:56:22] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001. | |
| [16:56:23] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354. | |
| [16:56:23] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0. | |
| [16:56:23] RMNF: directly read 100000x100000 numpy matrix. | |
| [16:56:23] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7f7136d45040. | |
| [16:56:23] Loaded FL 100000x100000 matrix. | |
| [16:56:23] No transform requested for loaded FL 100000x100000 matrix. | |
| [16:56:23] Finished loading FL 100000x100000 matrix. | |
| [16:56:23] Creating a Facility Location Function with a 100000x100000 matrix. | |
| [16:56:23] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7f7136d45040. | |
| [16:56:26] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7f7136d45040, 1/norm_const = 2.2285229856085104e-06. | |
| [16:56:26] Finished creating a Facility Location Function. | |
| [16:56:26] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1. | |
| [16:56:26] Created function mixture with 1 component. | |
| [16:56:26] Using 1 thread for summarization. | |
| [16:56:26] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1. | |
| [16:56:26] Gain permit type = 1, Gain threshold = 0. | |
| [16:56:26] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647. | |
| [16:56:26] ACGR: Computing 100000 singleton values. | |
| [16:56:41] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain. | |
| [16:56:41] ACGR: Building initial PQ. | |
| [16:56:41] ACGR: Finished building initial PQ. | |
| [16:56:41] ACGR: Finished running accelerated greedy, solution has 1 elements. | |
| [16:56:41] Summarization time: CPU 15.094123s (User: 15.092909s; System: 0.001214s); Wall Clock 15.09468622s. | |
| [16:56:41] Computing final summary valuations. | |
| [16:56:41] Summary valuation: f(Solution) = 9.9988415035e-01 | |
| [16:56:41] Computing conditional curvature for 1 elements. | |
| [16:56:41] Computing conditional curvature. | |
| [16:56:41] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08. | |
| [16:56:41] Finished execution successfully, exiting .... | |
| real 0m32.195s | |
| user 0m18.229s | |
| sys 0m13.963s | |
| [16:56:42] ----- Submarine logging started ----- | |
| [16:56:42] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices .... | |
| [16:56:42] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit. | |
| [16:56:42] Using 22 threads for general operations. | |
| [16:56:42] Command line: smraiz -flfilename /mnt/disks/spinning_scratch0/smrai-container-documentation/src/saved_results/tinyimagenet/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks | |
| [16:56:42] Loading FL matrix. | |
| [16:56:42] RNPHR: Reading numpy file v1.0 with header size 70. | |
| [16:56:42] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false. | |
| [16:56:42] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false. | |
| [16:56:42] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting. | |
| [16:56:42] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000. | |
| [16:56:43] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353. | |
| [16:56:43] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706. | |
| [16:56:44] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059. | |
| [16:56:45] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412. | |
| [16:56:45] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765. | |
| [16:56:46] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118. | |
| [16:56:46] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471. | |
| [16:56:47] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824. | |
| [16:56:48] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177. | |
| [16:56:48] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530. | |
| [16:56:49] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883. | |
| [16:56:50] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236. | |
| [16:56:51] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589. | |
| [16:56:52] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942. | |
| [16:56:53] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295. | |
| [16:56:53] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648. | |
| [16:56:54] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001. | |
| [16:56:55] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354. | |
| [16:56:56] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0. | |
| [16:56:56] RMNF: directly read 100000x100000 numpy matrix. | |
| [16:56:56] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7fa6b7e22040. | |
| [16:56:56] Loaded FL 100000x100000 matrix. | |
| [16:56:56] No transform requested for loaded FL 100000x100000 matrix. | |
| [16:56:56] Finished loading FL 100000x100000 matrix. | |
| [16:56:56] Creating a Facility Location Function with a 100000x100000 matrix. | |
| [16:56:56] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7fa6b7e22040. | |
| [16:56:59] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7fa6b7e22040, 1/norm_const = 2.2285229856085104e-06. | |
| [16:56:59] Finished creating a Facility Location Function. | |
| [16:56:59] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1. | |
| [16:56:59] Created function mixture with 1 component. | |
| [16:56:59] Using 1 thread for summarization. | |
| [16:56:59] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1. | |
| [16:56:59] Gain permit type = 1, Gain threshold = 0. | |
| [16:56:59] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647. | |
| [16:56:59] ACGR: Computing 100000 singleton values. | |
| [16:57:14] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain. | |
| [16:57:14] ACGR: Building initial PQ. | |
| [16:57:14] ACGR: Finished building initial PQ. | |
| [16:57:14] ACGR: Finished running accelerated greedy, solution has 1 elements. | |
| [16:57:14] Summarization time: CPU 15.179708999999999s (User: 15.179312s; System: 0.000397s); Wall Clock 15.180313206000001s. | |
| [16:57:14] Computing final summary valuations. | |
| [16:57:14] Summary valuation: f(Solution) = 9.9988415035e-01 | |
| [16:57:14] Computing conditional curvature for 1 elements. | |
| [16:57:14] Computing conditional curvature. | |
| [16:57:14] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08. | |
| [16:57:14] Finished execution successfully, exiting .... | |
| real 0m32.591s | |
| user 0m18.395s | |
| sys 0m14.195s | |
| [16:57:15] ----- Submarine logging started ----- | |
| [16:57:15] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices .... | |
| [16:57:15] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit. | |
| [16:57:15] Using 22 threads for general operations. | |
| [16:57:15] Command line: smraiz -flfilename /mnt/disks/spinning_scratch0/smrai-container-documentation/src/saved_results/tinyimagenet/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks | |
| [16:57:15] Loading FL matrix. | |
| [16:57:15] RNPHR: Reading numpy file v1.0 with header size 70. | |
| [16:57:15] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false. | |
| [16:57:15] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false. | |
| [16:57:15] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting. | |
| [16:57:15] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000. | |
| [16:57:15] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353. | |
| [16:57:16] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706. | |
| [16:57:16] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059. | |
| [16:57:17] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412. | |
| [16:57:18] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765. | |
| [16:57:18] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118. | |
| [16:57:19] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471. | |
| [16:57:20] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824. | |
| [16:57:20] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177. | |
| [16:57:21] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530. | |
| [16:57:22] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883. | |
| [16:57:23] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236. | |
| [16:57:24] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589. | |
| [16:57:24] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942. | |
| [16:57:25] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295. | |
| [16:57:26] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648. | |
| [16:57:27] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001. | |
| [16:57:28] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354. | |
| [16:57:28] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0. | |
| [16:57:28] RMNF: directly read 100000x100000 numpy matrix. | |
| [16:57:28] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7fb46bc97040. | |
| [16:57:28] Loaded FL 100000x100000 matrix. | |
| [16:57:28] No transform requested for loaded FL 100000x100000 matrix. | |
| [16:57:28] Finished loading FL 100000x100000 matrix. | |
| [16:57:28] Creating a Facility Location Function with a 100000x100000 matrix. | |
| [16:57:28] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7fb46bc97040. | |
| [16:57:32] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7fb46bc97040, 1/norm_const = 2.2285229856085104e-06. | |
| [16:57:32] Finished creating a Facility Location Function. | |
| [16:57:32] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1. | |
| [16:57:32] Created function mixture with 1 component. | |
| [16:57:32] Using 1 thread for summarization. | |
| [16:57:32] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1. | |
| [16:57:32] Gain permit type = 1, Gain threshold = 0. | |
| [16:57:32] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647. | |
| [16:57:32] ACGR: Computing 100000 singleton values. | |
| [16:57:47] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain. | |
| [16:57:47] ACGR: Building initial PQ. | |
| [16:57:47] ACGR: Finished building initial PQ. | |
| [16:57:47] ACGR: Finished running accelerated greedy, solution has 1 elements. | |
| [16:57:47] Summarization time: CPU 15.2169s (User: 15.2169s; System: 0s); Wall Clock 15.217678164999999s. | |
| [16:57:47] Computing final summary valuations. | |
| [16:57:47] Summary valuation: f(Solution) = 9.9988415035e-01 | |
| [16:57:47] Computing conditional curvature for 1 elements. | |
| [16:57:47] Computing conditional curvature. | |
| [16:57:47] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08. | |
| [16:57:47] Finished execution successfully, exiting .... | |
| real 0m32.639s | |
| user 0m18.434s | |
| sys 0m14.202s | |
| [16:57:47] ----- Submarine logging started ----- | |
| [16:57:47] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices .... | |
| [16:57:47] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit. | |
| [16:57:47] Using 22 threads for general operations. | |
| [16:57:47] Command line: smraiz -flfilename /mnt/disks/spinning_scratch0/smrai-container-documentation/src/saved_results/tinyimagenet/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks | |
| [16:57:47] Loading FL matrix. | |
| [16:57:47] RNPHR: Reading numpy file v1.0 with header size 70. | |
| [16:57:47] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false. | |
| [16:57:47] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false. | |
| [16:57:47] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting. | |
| [16:57:47] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000. | |
| [16:57:48] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353. | |
| [16:57:49] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706. | |
| [16:57:49] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059. | |
| [16:57:50] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412. | |
| [16:57:50] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765. | |
| [16:57:51] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118. | |
| [16:57:52] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471. | |
| [16:57:52] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824. | |
| [16:57:53] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177. | |
| [16:57:54] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530. | |
| [16:57:54] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883. | |
| [16:57:55] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236. | |
| [16:57:56] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589. | |
| [16:57:56] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942. | |
| [16:57:57] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295. | |
| [16:57:58] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648. | |
| [16:57:59] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001. | |
| [16:58:00] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354. | |
| [16:58:00] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0. | |
| [16:58:00] RMNF: directly read 100000x100000 numpy matrix. | |
| [16:58:00] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7fee20928040. | |
| [16:58:00] Loaded FL 100000x100000 matrix. | |
| [16:58:00] No transform requested for loaded FL 100000x100000 matrix. | |
| [16:58:00] Finished loading FL 100000x100000 matrix. | |
| [16:58:00] Creating a Facility Location Function with a 100000x100000 matrix. | |
| [16:58:00] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7fee20928040. | |
| [16:58:04] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7fee20928040, 1/norm_const = 2.2285229856085104e-06. | |
| [16:58:04] Finished creating a Facility Location Function. | |
| [16:58:04] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1. | |
| [16:58:04] Created function mixture with 1 component. | |
| [16:58:04] Using 1 thread for summarization. | |
| [16:58:04] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1. | |
| [16:58:04] Gain permit type = 1, Gain threshold = 0. | |
| [16:58:04] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647. | |
| [16:58:04] ACGR: Computing 100000 singleton values. | |
| [16:58:19] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain. | |
| [16:58:19] ACGR: Building initial PQ. | |
| [16:58:19] ACGR: Finished building initial PQ. | |
| [16:58:19] ACGR: Finished running accelerated greedy, solution has 1 elements. | |
| [16:58:19] Summarization time: CPU 15.030913s (User: 15.030913s; System: 0s); Wall Clock 15.03159048s. | |
| [16:58:19] Computing final summary valuations. | |
| [16:58:19] Summary valuation: f(Solution) = 9.9988415035e-01 | |
| [16:58:19] Computing conditional curvature for 1 elements. | |
| [16:58:19] Computing conditional curvature. | |
| [16:58:19] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08. | |
| [16:58:19] Finished execution successfully, exiting .... | |
| real 0m31.638s | |
| user 0m18.276s | |
| sys 0m13.360s | |
| [16:58:19] ----- Submarine logging started ----- | |
| [16:58:19] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices .... | |
| [16:58:19] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit. | |
| [16:58:19] Using 22 threads for general operations. | |
| [16:58:19] Command line: smraiz -flfilename /mnt/disks/ssd1/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks | |
| [16:58:19] Loading FL matrix. | |
| [16:58:19] RNPHR: Reading numpy file v1.0 with header size 70. | |
| [16:58:19] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false. | |
| [16:58:19] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false. | |
| [16:58:19] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting. | |
| [16:58:19] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000. | |
| [16:58:22] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353. | |
| [16:58:25] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706. | |
| [16:58:28] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059. | |
| [16:58:31] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412. | |
| [16:58:33] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765. | |
| [16:58:36] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118. | |
| [16:58:39] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471. | |
| [16:58:42] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824. | |
| [16:58:45] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177. | |
| [16:58:48] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530. | |
| [16:58:51] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883. | |
| [16:58:54] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236. | |
| [16:58:57] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589. | |
| [16:59:00] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942. | |
| [16:59:03] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295. | |
| [16:59:06] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648. | |
| [16:59:08] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001. | |
| [16:59:11] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354. | |
| [16:59:13] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0. | |
| [16:59:13] RMNF: directly read 100000x100000 numpy matrix. | |
| [16:59:13] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7f4f6aa48040. | |
| [16:59:13] Loaded FL 100000x100000 matrix. | |
| [16:59:13] No transform requested for loaded FL 100000x100000 matrix. | |
| [16:59:13] Finished loading FL 100000x100000 matrix. | |
| [16:59:13] Creating a Facility Location Function with a 100000x100000 matrix. | |
| [16:59:13] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7f4f6aa48040. | |
| [16:59:16] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7f4f6aa48040, 1/norm_const = 2.2285229856085104e-06. | |
| [16:59:16] Finished creating a Facility Location Function. | |
| [16:59:16] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1. | |
| [16:59:16] Created function mixture with 1 component. | |
| [16:59:16] Using 1 thread for summarization. | |
| [16:59:16] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1. | |
| [16:59:16] Gain permit type = 1, Gain threshold = 0. | |
| [16:59:16] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647. | |
| [16:59:16] ACGR: Computing 100000 singleton values. | |
| [16:59:32] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain. | |
| [16:59:32] ACGR: Building initial PQ. | |
| [16:59:32] ACGR: Finished building initial PQ. | |
| [16:59:32] ACGR: Finished running accelerated greedy, solution has 1 elements. | |
| [16:59:32] Summarization time: CPU 15.18736s (User: 15.18736s; System: 0s); Wall Clock 15.187891508s. | |
| [16:59:32] Computing final summary valuations. | |
| [16:59:32] Summary valuation: f(Solution) = 9.9988415035e-01 | |
| [16:59:32] Computing conditional curvature for 1 elements. | |
| [16:59:32] Computing conditional curvature. | |
| [16:59:32] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08. | |
| [16:59:32] Finished execution successfully, exiting .... | |
| real 1m13.106s | |
| user 0m18.511s | |
| sys 0m21.365s | |
| [16:59:32] ----- Submarine logging started ----- | |
| [16:59:32] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices .... | |
| [16:59:32] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit. | |
| [16:59:32] Using 22 threads for general operations. | |
| [16:59:32] Command line: smraiz -flfilename /mnt/disks/ssd1/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks | |
| [16:59:32] Loading FL matrix. | |
| [16:59:32] RNPHR: Reading numpy file v1.0 with header size 70. | |
| [16:59:32] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false. | |
| [16:59:32] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false. | |
| [16:59:32] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting. | |
| [16:59:32] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000. | |
| [16:59:35] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353. | |
| [16:59:38] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706. | |
| [16:59:41] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059. | |
| [16:59:44] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412. | |
| [16:59:47] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765. | |
| [16:59:49] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118. | |
| [16:59:52] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471. | |
| [16:59:55] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824. | |
| [16:59:58] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177. | |
| [17:00:01] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530. | |
| [17:00:04] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883. | |
| [17:00:07] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236. | |
| [17:00:10] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589. | |
| [17:00:13] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942. | |
| [17:00:16] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295. | |
| [17:00:19] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648. | |
| [17:00:22] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001. | |
| [17:00:24] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354. | |
| [17:00:26] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0. | |
| [17:00:26] RMNF: directly read 100000x100000 numpy matrix. | |
| [17:00:26] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7f2ba3ac2040. | |
| [17:00:26] Loaded FL 100000x100000 matrix. | |
| [17:00:26] No transform requested for loaded FL 100000x100000 matrix. | |
| [17:00:26] Finished loading FL 100000x100000 matrix. | |
| [17:00:26] Creating a Facility Location Function with a 100000x100000 matrix. | |
| [17:00:26] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7f2ba3ac2040. | |
| [17:00:29] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7f2ba3ac2040, 1/norm_const = 2.2285229856085104e-06. | |
| [17:00:29] Finished creating a Facility Location Function. | |
| [17:00:29] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1. | |
| [17:00:29] Created function mixture with 1 component. | |
| [17:00:29] Using 1 thread for summarization. | |
| [17:00:29] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1. | |
| [17:00:29] Gain permit type = 1, Gain threshold = 0. | |
| [17:00:29] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647. | |
| [17:00:29] ACGR: Computing 100000 singleton values. | |
| [17:00:45] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain. | |
| [17:00:45] ACGR: Building initial PQ. | |
| [17:00:45] ACGR: Finished building initial PQ. | |
| [17:00:45] ACGR: Finished running accelerated greedy, solution has 1 elements. | |
| [17:00:45] Summarization time: CPU 15.076679s (User: 15.076679s; System: 0s); Wall Clock 15.077196248s. | |
| [17:00:45] Computing final summary valuations. | |
| [17:00:45] Summary valuation: f(Solution) = 9.9988415035e-01 | |
| [17:00:45] Computing conditional curvature for 1 elements. | |
| [17:00:45] Computing conditional curvature. | |
| [17:00:45] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08. | |
| [17:00:45] Finished execution successfully, exiting .... | |
| real 1m12.806s | |
| user 0m18.295s | |
| sys 0m21.886s | |
| [17:00:45] ----- Submarine logging started ----- | |
| [17:00:45] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices .... | |
| [17:00:45] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit. | |
| [17:00:45] Using 22 threads for general operations. | |
| [17:00:45] Command line: smraiz -flfilename /mnt/disks/ssd1/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks | |
| [17:00:45] Loading FL matrix. | |
| [17:00:45] RNPHR: Reading numpy file v1.0 with header size 70. | |
| [17:00:45] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false. | |
| [17:00:45] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false. | |
| [17:00:45] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting. | |
| [17:00:45] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000. | |
| [17:00:48] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353. | |
| [17:00:51] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706. | |
| [17:00:54] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059. | |
| [17:00:56] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412. | |
| [17:00:58] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765. | |
| [17:00:58] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118. | |
| [17:00:59] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471. | |
| [17:01:00] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824. | |
| [17:01:00] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177. | |
| [17:01:01] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530. | |
| [17:01:02] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883. | |
| [17:01:03] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236. | |
| [17:01:06] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589. | |
| [17:01:08] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942. | |
| [17:01:09] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295. | |
| [17:01:09] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648. | |
| [17:01:10] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001. | |
| [17:01:13] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354. | |
| [17:01:15] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0. | |
| [17:01:15] RMNF: directly read 100000x100000 numpy matrix. | |
| [17:01:15] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7fc317d1d040. | |
| [17:01:15] Loaded FL 100000x100000 matrix. | |
| [17:01:15] No transform requested for loaded FL 100000x100000 matrix. | |
| [17:01:15] Finished loading FL 100000x100000 matrix. | |
| [17:01:15] Creating a Facility Location Function with a 100000x100000 matrix. | |
| [17:01:15] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7fc317d1d040. | |
| [17:01:18] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7fc317d1d040, 1/norm_const = 2.2285229856085104e-06. | |
| [17:01:18] Finished creating a Facility Location Function. | |
| [17:01:18] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1. | |
| [17:01:18] Created function mixture with 1 component. | |
| [17:01:18] Using 1 thread for summarization. | |
| [17:01:18] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1. | |
| [17:01:18] Gain permit type = 1, Gain threshold = 0. | |
| [17:01:18] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647. | |
| [17:01:18] ACGR: Computing 100000 singleton values. | |
| [17:01:33] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain. | |
| [17:01:33] ACGR: Building initial PQ. | |
| [17:01:33] ACGR: Finished building initial PQ. | |
| [17:01:33] ACGR: Finished running accelerated greedy, solution has 1 elements. | |
| [17:01:33] Summarization time: CPU 14.955116s (User: 14.955116s; System: 0s); Wall Clock 14.955635191999999s. | |
| [17:01:33] Computing final summary valuations. | |
| [17:01:33] Summary valuation: f(Solution) = 9.9988415035e-01 | |
| [17:01:33] Computing conditional curvature for 1 elements. | |
| [17:01:33] Computing conditional curvature. | |
| [17:01:33] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08. | |
| [17:01:33] Finished execution successfully, exiting .... | |
| real 0m48.572s | |
| user 0m18.210s | |
| sys 0m17.111s | |
| [17:01:33] ----- Submarine logging started ----- | |
| [17:01:33] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices .... | |
| [17:01:33] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit. | |
| [17:01:33] Using 22 threads for general operations. | |
| [17:01:33] Command line: smraiz -flfilename /mnt/disks/ssd1/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks | |
| [17:01:33] Loading FL matrix. | |
| [17:01:33] RNPHR: Reading numpy file v1.0 with header size 70. | |
| [17:01:33] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false. | |
| [17:01:33] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false. | |
| [17:01:33] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting. | |
| [17:01:33] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000. | |
| [17:01:35] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353. | |
| [17:01:35] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706. | |
| [17:01:36] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059. | |
| [17:01:37] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412. | |
| [17:01:37] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765. | |
| [17:01:38] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118. | |
| [17:01:39] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471. | |
| [17:01:39] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824. | |
| [17:01:41] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177. | |
| [17:01:44] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530. | |
| [17:01:45] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883. | |
| [17:01:45] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236. | |
| [17:01:46] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589. | |
| [17:01:46] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942. | |
| [17:01:47] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295. | |
| [17:01:48] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648. | |
| [17:01:49] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001. | |
| [17:01:50] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354. | |
| [17:01:50] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0. | |
| [17:01:50] RMNF: directly read 100000x100000 numpy matrix. | |
| [17:01:50] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7faa65440040. | |
| [17:01:50] Loaded FL 100000x100000 matrix. | |
| [17:01:50] No transform requested for loaded FL 100000x100000 matrix. | |
| [17:01:50] Finished loading FL 100000x100000 matrix. | |
| [17:01:50] Creating a Facility Location Function with a 100000x100000 matrix. | |
| [17:01:50] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7faa65440040. | |
| [17:01:53] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7faa65440040, 1/norm_const = 2.2285229856085104e-06. | |
| [17:01:53] Finished creating a Facility Location Function. | |
| [17:01:53] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1. | |
| [17:01:53] Created function mixture with 1 component. | |
| [17:01:53] Using 1 thread for summarization. | |
| [17:01:53] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1. | |
| [17:01:53] Gain permit type = 1, Gain threshold = 0. | |
| [17:01:53] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647. | |
| [17:01:53] ACGR: Computing 100000 singleton values. | |
| [17:02:08] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain. | |
| [17:02:08] ACGR: Building initial PQ. | |
| [17:02:08] ACGR: Finished building initial PQ. | |
| [17:02:08] ACGR: Finished running accelerated greedy, solution has 1 elements. | |
| [17:02:08] Summarization time: CPU 15.018291s (User: 15.018291s; System: 0s); Wall Clock 15.019029713s. | |
| [17:02:08] Computing final summary valuations. | |
| [17:02:08] Summary valuation: f(Solution) = 9.9988415035e-01 | |
| [17:02:08] Computing conditional curvature for 1 elements. | |
| [17:02:08] Computing conditional curvature. | |
| [17:02:08] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08. | |
| [17:02:08] Finished execution successfully, exiting .... | |
| real 0m35.206s | |
| user 0m18.264s | |
| sys 0m13.808s | |
| [17:02:09] ----- Submarine logging started ----- | |
| [17:02:09] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices .... | |
| [17:02:09] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit. | |
| [17:02:09] Using 22 threads for general operations. | |
| [17:02:09] Command line: smraiz -flfilename /mnt/disks/ssd1/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks | |
| [17:02:09] Loading FL matrix. | |
| [17:02:09] RNPHR: Reading numpy file v1.0 with header size 70. | |
| [17:02:09] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false. | |
| [17:02:09] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false. | |
| [17:02:09] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting. | |
| [17:02:09] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000. | |
| [17:02:09] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353. | |
| [17:02:11] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706. | |
| [17:02:12] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059. | |
| [17:02:12] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412. | |
| [17:02:13] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765. | |
| [17:02:14] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118. | |
| [17:02:14] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471. | |
| [17:02:15] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824. | |
| [17:02:16] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177. | |
| [17:02:16] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530. | |
| [17:02:17] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883. | |
| [17:02:17] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236. | |
| [17:02:18] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589. | |
| [17:02:19] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942. | |
| [17:02:19] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295. | |
| [17:02:20] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648. | |
| [17:02:21] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001. | |
| [17:02:21] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354. | |
| [17:02:22] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0. | |
| [17:02:22] RMNF: directly read 100000x100000 numpy matrix. | |
| [17:02:22] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7f7610c32040. | |
| [17:02:22] Loaded FL 100000x100000 matrix. | |
| [17:02:22] No transform requested for loaded FL 100000x100000 matrix. | |
| [17:02:22] Finished loading FL 100000x100000 matrix. | |
| [17:02:22] Creating a Facility Location Function with a 100000x100000 matrix. | |
| [17:02:22] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7f7610c32040. | |
| [17:02:25] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7f7610c32040, 1/norm_const = 2.2285229856085104e-06. | |
| [17:02:25] Finished creating a Facility Location Function. | |
| [17:02:25] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1. | |
| [17:02:25] Created function mixture with 1 component. | |
| [17:02:25] Using 1 thread for summarization. | |
| [17:02:25] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1. | |
| [17:02:25] Gain permit type = 1, Gain threshold = 0. | |
| [17:02:25] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647. | |
| [17:02:25] ACGR: Computing 100000 singleton values. | |
| [17:02:40] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain. | |
| [17:02:40] ACGR: Building initial PQ. | |
| [17:02:40] ACGR: Finished building initial PQ. | |
| [17:02:40] ACGR: Finished running accelerated greedy, solution has 1 elements. | |
| [17:02:40] Summarization time: CPU 14.895523s (User: 14.893803s; System: 0.00172s); Wall Clock 14.896218615s. | |
| [17:02:40] Computing final summary valuations. | |
| [17:02:40] Summary valuation: f(Solution) = 9.9988415035e-01 | |
| [17:02:40] Computing conditional curvature for 1 elements. | |
| [17:02:40] Computing conditional curvature. | |
| [17:02:40] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08. | |
| [17:02:40] Finished execution successfully, exiting .... | |
| real 0m31.600s | |
| user 0m18.113s | |
| sys 0m12.604s | |
| [17:02:40] ----- Submarine logging started ----- | |
| [17:02:40] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices .... | |
| [17:02:40] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit. | |
| [17:02:40] Using 22 threads for general operations. | |
| [17:02:40] Command line: smraiz -flfilename /mnt/disks/ssd2/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks | |
| [17:02:40] Loading FL matrix. | |
| [17:02:40] RNPHR: Reading numpy file v1.0 with header size 70. | |
| [17:02:40] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false. | |
| [17:02:40] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false. | |
| [17:02:40] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting. | |
| [17:02:40] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000. | |
| [17:02:43] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353. | |
| [17:02:46] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706. | |
| [17:02:49] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059. | |
| [17:02:52] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412. | |
| [17:02:55] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765. | |
| [17:02:58] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118. | |
| [17:03:01] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471. | |
| [17:03:03] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824. | |
| [17:03:06] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177. | |
| [17:03:09] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530. | |
| [17:03:12] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883. | |
| [17:03:15] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236. | |
| [17:03:18] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589. | |
| [17:03:21] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942. | |
| [17:03:24] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295. | |
| [17:03:27] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648. | |
| [17:03:30] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001. | |
| [17:03:33] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354. | |
| [17:03:34] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0. | |
| [17:03:34] RMNF: directly read 100000x100000 numpy matrix. | |
| [17:03:34] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7fb2ad76d040. | |
| [17:03:34] Loaded FL 100000x100000 matrix. | |
| [17:03:34] No transform requested for loaded FL 100000x100000 matrix. | |
| [17:03:34] Finished loading FL 100000x100000 matrix. | |
| [17:03:34] Creating a Facility Location Function with a 100000x100000 matrix. | |
| [17:03:34] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7fb2ad76d040. | |
| [17:03:38] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7fb2ad76d040, 1/norm_const = 2.2285229856085104e-06. | |
| [17:03:38] Finished creating a Facility Location Function. | |
| [17:03:38] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1. | |
| [17:03:38] Created function mixture with 1 component. | |
| [17:03:38] Using 1 thread for summarization. | |
| [17:03:38] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1. | |
| [17:03:38] Gain permit type = 1, Gain threshold = 0. | |
| [17:03:38] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647. | |
| [17:03:38] ACGR: Computing 100000 singleton values. | |
| [17:03:53] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain. | |
| [17:03:53] ACGR: Building initial PQ. | |
| [17:03:53] ACGR: Finished building initial PQ. | |
| [17:03:53] ACGR: Finished running accelerated greedy, solution has 1 elements. | |
| [17:03:53] Summarization time: CPU 14.873961s (User: 14.873961s; System: 0s); Wall Clock 14.874654598s. | |
| [17:03:53] Computing final summary valuations. | |
| [17:03:53] Summary valuation: f(Solution) = 9.9988415035e-01 | |
| [17:03:53] Computing conditional curvature for 1 elements. | |
| [17:03:53] Computing conditional curvature. | |
| [17:03:53] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08. | |
| [17:03:53] Finished execution successfully, exiting .... | |
| real 1m12.478s | |
| user 0m18.284s | |
| sys 0m20.423s | |
| [17:03:53] ----- Submarine logging started ----- | |
| [17:03:53] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices .... | |
| [17:03:53] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit. | |
| [17:03:53] Using 22 threads for general operations. | |
| [17:03:53] Command line: smraiz -flfilename /mnt/disks/ssd2/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks | |
| [17:03:53] Loading FL matrix. | |
| [17:03:53] RNPHR: Reading numpy file v1.0 with header size 70. | |
| [17:03:53] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false. | |
| [17:03:53] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false. | |
| [17:03:53] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting. | |
| [17:03:53] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000. | |
| [17:03:56] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353. | |
| [17:03:58] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706. | |
| [17:04:01] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059. | |
| [17:04:04] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412. | |
| [17:04:07] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765. | |
| [17:04:10] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118. | |
| [17:04:13] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471. | |
| [17:04:16] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824. | |
| [17:04:19] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177. | |
| [17:04:22] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530. | |
| [17:04:25] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883. | |
| [17:04:28] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236. | |
| [17:04:31] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589. | |
| [17:04:33] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942. | |
| [17:04:36] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295. | |
| [17:04:39] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648. | |
| [17:04:42] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001. | |
| [17:04:45] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354. | |
| [17:04:47] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0. | |
| [17:04:47] RMNF: directly read 100000x100000 numpy matrix. | |
| [17:04:47] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7fddbb638040. | |
| [17:04:47] Loaded FL 100000x100000 matrix. | |
| [17:04:47] No transform requested for loaded FL 100000x100000 matrix. | |
| [17:04:47] Finished loading FL 100000x100000 matrix. | |
| [17:04:47] Creating a Facility Location Function with a 100000x100000 matrix. | |
| [17:04:47] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7fddbb638040. | |
| [17:04:50] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7fddbb638040, 1/norm_const = 2.2285229856085104e-06. | |
| [17:04:50] Finished creating a Facility Location Function. | |
| [17:04:50] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1. | |
| [17:04:50] Created function mixture with 1 component. | |
| [17:04:50] Using 1 thread for summarization. | |
| [17:04:50] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1. | |
| [17:04:50] Gain permit type = 1, Gain threshold = 0. | |
| [17:04:50] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647. | |
| [17:04:50] ACGR: Computing 100000 singleton values. | |
| [17:05:05] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain. | |
| [17:05:05] ACGR: Building initial PQ. | |
| [17:05:05] ACGR: Finished building initial PQ. | |
| [17:05:05] ACGR: Finished running accelerated greedy, solution has 1 elements. | |
| [17:05:05] Summarization time: CPU 15.14096s (User: 15.14096s; System: 0s); Wall Clock 15.143327201s. | |
| [17:05:05] Computing final summary valuations. | |
| [17:05:05] Summary valuation: f(Solution) = 9.9988415035e-01 | |
| [17:05:05] Computing conditional curvature for 1 elements. | |
| [17:05:05] Computing conditional curvature. | |
| [17:05:05] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08. | |
| [17:05:05] Finished execution successfully, exiting .... | |
| real 1m12.975s | |
| user 0m18.377s | |
| sys 0m22.028s | |
| [17:05:06] ----- Submarine logging started ----- | |
| [17:05:06] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices .... | |
| [17:05:06] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit. | |
| [17:05:06] Using 22 threads for general operations. | |
| [17:05:06] Command line: smraiz -flfilename /mnt/disks/ssd2/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks | |
| [17:05:06] Loading FL matrix. | |
| [17:05:06] RNPHR: Reading numpy file v1.0 with header size 70. | |
| [17:05:06] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false. | |
| [17:05:06] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false. | |
| [17:05:06] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting. | |
| [17:05:06] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000. | |
| [17:05:06] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353. | |
| [17:05:07] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706. | |
| [17:05:08] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059. | |
| [17:05:08] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412. | |
| [17:05:09] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765. | |
| [17:05:09] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118. | |
| [17:05:10] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471. | |
| [17:05:11] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824. | |
| [17:05:11] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177. | |
| [17:05:12] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530. | |
| [17:05:13] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883. | |
| [17:05:15] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236. | |
| [17:05:18] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589. | |
| [17:05:20] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942. | |
| [17:05:22] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295. | |
| [17:05:23] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648. | |
| [17:05:24] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001. | |
| [17:05:25] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354. | |
| [17:05:25] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0. | |
| [17:05:25] RMNF: directly read 100000x100000 numpy matrix. | |
| [17:05:25] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7f6396d22040. | |
| [17:05:25] Loaded FL 100000x100000 matrix. | |
| [17:05:25] No transform requested for loaded FL 100000x100000 matrix. | |
| [17:05:25] Finished loading FL 100000x100000 matrix. | |
| [17:05:25] Creating a Facility Location Function with a 100000x100000 matrix. | |
| [17:05:25] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7f6396d22040. | |
| [17:05:29] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7f6396d22040, 1/norm_const = 2.2285229856085104e-06. | |
| [17:05:29] Finished creating a Facility Location Function. | |
| [17:05:29] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1. | |
| [17:05:29] Created function mixture with 1 component. | |
| [17:05:29] Using 1 thread for summarization. | |
| [17:05:29] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1. | |
| [17:05:29] Gain permit type = 1, Gain threshold = 0. | |
| [17:05:29] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647. | |
| [17:05:29] ACGR: Computing 100000 singleton values. | |
| [17:05:44] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain. | |
| [17:05:44] ACGR: Building initial PQ. | |
| [17:05:44] ACGR: Finished building initial PQ. | |
| [17:05:44] ACGR: Finished running accelerated greedy, solution has 1 elements. | |
| [17:05:44] Summarization time: CPU 14.915012s (User: 14.909299s; System: 0.005713s); Wall Clock 14.915481162s. | |
| [17:05:44] Computing final summary valuations. | |
| [17:05:44] Summary valuation: f(Solution) = 9.9988415035e-01 | |
| [17:05:44] Computing conditional curvature for 1 elements. | |
| [17:05:44] Computing conditional curvature. | |
| [17:05:44] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08. | |
| [17:05:44] Finished execution successfully, exiting .... | |
| real 0m38.181s | |
| user 0m18.111s | |
| sys 0m14.801s | |
| [17:05:44] ----- Submarine logging started ----- | |
| [17:05:44] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices .... | |
| [17:05:44] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit. | |
| [17:05:44] Using 22 threads for general operations. | |
| [17:05:44] Command line: smraiz -flfilename /mnt/disks/ssd2/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks | |
| [17:05:44] Loading FL matrix. | |
| [17:05:44] RNPHR: Reading numpy file v1.0 with header size 70. | |
| [17:05:44] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false. | |
| [17:05:44] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false. | |
| [17:05:44] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting. | |
| [17:05:44] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000. | |
| [17:05:44] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353. | |
| [17:05:45] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706. | |
| [17:05:46] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059. | |
| [17:05:46] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412. | |
| [17:05:47] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765. | |
| [17:05:48] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118. | |
| [17:05:48] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471. | |
| [17:05:49] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824. | |
| [17:05:49] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177. | |
| [17:05:50] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530. | |
| [17:05:51] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883. | |
| [17:05:51] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236. | |
| [17:05:52] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589. | |
| [17:05:53] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942. | |
| [17:05:53] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295. | |
| [17:05:54] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648. | |
| [17:05:55] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001. | |
| [17:05:56] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354. | |
| [17:05:57] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0. | |
| [17:05:57] RMNF: directly read 100000x100000 numpy matrix. | |
| [17:05:57] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7f4238b47040. | |
| [17:05:57] Loaded FL 100000x100000 matrix. | |
| [17:05:57] No transform requested for loaded FL 100000x100000 matrix. | |
| [17:05:57] Finished loading FL 100000x100000 matrix. | |
| [17:05:57] Creating a Facility Location Function with a 100000x100000 matrix. | |
| [17:05:57] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7f4238b47040. | |
| [17:06:00] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7f4238b47040, 1/norm_const = 2.2285229856085104e-06. | |
| [17:06:00] Finished creating a Facility Location Function. | |
| [17:06:00] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1. | |
| [17:06:00] Created function mixture with 1 component. | |
| [17:06:00] Using 1 thread for summarization. | |
| [17:06:00] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1. | |
| [17:06:00] Gain permit type = 1, Gain threshold = 0. | |
| [17:06:00] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647. | |
| [17:06:00] ACGR: Computing 100000 singleton values. | |
| [17:06:15] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain. | |
| [17:06:15] ACGR: Building initial PQ. | |
| [17:06:15] ACGR: Finished building initial PQ. | |
| [17:06:15] ACGR: Finished running accelerated greedy, solution has 1 elements. | |
| [17:06:15] Summarization time: CPU 15.01097s (User: 15.009777s; System: 0.001193s); Wall Clock 15.011550100000001s. | |
| [17:06:15] Computing final summary valuations. | |
| [17:06:15] Summary valuation: f(Solution) = 9.9988415035e-01 | |
| [17:06:15] Computing conditional curvature for 1 elements. | |
| [17:06:15] Computing conditional curvature. | |
| [17:06:15] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08. | |
| [17:06:15] Finished execution successfully, exiting .... | |
| real 0m31.402s | |
| user 0m18.333s | |
| sys 0m13.066s | |
| [17:06:15] ----- Submarine logging started ----- | |
| [17:06:15] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices .... | |
| [17:06:15] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit. | |
| [17:06:15] Using 22 threads for general operations. | |
| [17:06:15] Command line: smraiz -flfilename /mnt/disks/ssd2/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks | |
| [17:06:15] Loading FL matrix. | |
| [17:06:15] RNPHR: Reading numpy file v1.0 with header size 70. | |
| [17:06:15] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false. | |
| [17:06:15] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false. | |
| [17:06:15] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting. | |
| [17:06:15] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000. | |
| [17:06:16] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353. | |
| [17:06:17] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706. | |
| [17:06:17] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059. | |
| [17:06:18] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412. | |
| [17:06:18] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765. | |
| [17:06:19] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118. | |
| [17:06:20] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471. | |
| [17:06:20] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824. | |
| [17:06:21] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177. | |
| [17:06:22] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530. | |
| [17:06:22] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883. | |
| [17:06:23] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236. | |
| [17:06:24] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589. | |
| [17:06:24] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942. | |
| [17:06:25] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295. | |
| [17:06:26] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648. | |
| [17:06:27] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001. | |
| [17:06:28] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354. | |
| [17:06:28] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0. | |
| [17:06:28] RMNF: directly read 100000x100000 numpy matrix. | |
| [17:06:28] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7ef77ca7d040. | |
| [17:06:28] Loaded FL 100000x100000 matrix. | |
| [17:06:28] No transform requested for loaded FL 100000x100000 matrix. | |
| [17:06:28] Finished loading FL 100000x100000 matrix. | |
| [17:06:28] Creating a Facility Location Function with a 100000x100000 matrix. | |
| [17:06:28] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7ef77ca7d040. | |
| [17:06:32] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7ef77ca7d040, 1/norm_const = 2.2285229856085104e-06. | |
| [17:06:32] Finished creating a Facility Location Function. | |
| [17:06:32] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1. | |
| [17:06:32] Created function mixture with 1 component. | |
| [17:06:32] Using 1 thread for summarization. | |
| [17:06:32] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1. | |
| [17:06:32] Gain permit type = 1, Gain threshold = 0. | |
| [17:06:32] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647. | |
| [17:06:32] ACGR: Computing 100000 singleton values. | |
| [17:06:47] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain. | |
| [17:06:47] ACGR: Building initial PQ. | |
| [17:06:47] ACGR: Finished building initial PQ. | |
| [17:06:47] ACGR: Finished running accelerated greedy, solution has 1 elements. | |
| [17:06:47] Summarization time: CPU 15.019812s (User: 15.019812s; System: 0s); Wall Clock 15.020345654s. | |
| [17:06:47] Computing final summary valuations. | |
| [17:06:47] Summary valuation: f(Solution) = 9.9988415035e-01 | |
| [17:06:47] Computing conditional curvature for 1 elements. | |
| [17:06:47] Computing conditional curvature. | |
| [17:06:47] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08. | |
| [17:06:47] Finished execution successfully, exiting .... | |
| real 0m31.592s | |
| user 0m18.279s | |
| sys 0m13.311s | |
| [17:06:47] ----- Submarine logging started ----- | |
| [17:06:47] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices .... | |
| [17:06:47] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit. | |
| [17:06:47] Using 22 threads for general operations. | |
| [17:06:47] Command line: smraiz -flfilename /mnt/disks/ssd3/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks | |
| [17:06:47] Loading FL matrix. | |
| [17:06:47] RNPHR: Reading numpy file v1.0 with header size 70. | |
| [17:06:47] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false. | |
| [17:06:47] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false. | |
| [17:06:47] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting. | |
| [17:06:47] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000. | |
| [17:06:50] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353. | |
| [17:06:53] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706. | |
| [17:06:56] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059. | |
| [17:06:58] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412. | |
| [17:07:01] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765. | |
| [17:07:04] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118. | |
| [17:07:07] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471. | |
| [17:07:10] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824. | |
| [17:07:13] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177. | |
| [17:07:16] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530. | |
| [17:07:19] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883. | |
| [17:07:22] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236. | |
| [17:07:25] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589. | |
| [17:07:28] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942. | |
| [17:07:31] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295. | |
| [17:07:33] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648. | |
| [17:07:36] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001. | |
| [17:07:39] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354. | |
| [17:07:41] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0. | |
| [17:07:41] RMNF: directly read 100000x100000 numpy matrix. | |
| [17:07:41] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7f205461c040. | |
| [17:07:41] Loaded FL 100000x100000 matrix. | |
| [17:07:41] No transform requested for loaded FL 100000x100000 matrix. | |
| [17:07:41] Finished loading FL 100000x100000 matrix. | |
| [17:07:41] Creating a Facility Location Function with a 100000x100000 matrix. | |
| [17:07:41] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7f205461c040. | |
| [17:07:44] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7f205461c040, 1/norm_const = 2.2285229856085104e-06. | |
| [17:07:44] Finished creating a Facility Location Function. | |
| [17:07:44] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1. | |
| [17:07:44] Created function mixture with 1 component. | |
| [17:07:44] Using 1 thread for summarization. | |
| [17:07:44] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1. | |
| [17:07:44] Gain permit type = 1, Gain threshold = 0. | |
| [17:07:44] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647. | |
| [17:07:44] ACGR: Computing 100000 singleton values. | |
| [17:07:59] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain. | |
| [17:07:59] ACGR: Building initial PQ. | |
| [17:07:59] ACGR: Finished building initial PQ. | |
| [17:07:59] ACGR: Finished running accelerated greedy, solution has 1 elements. | |
| [17:07:59] Summarization time: CPU 15.07693s (User: 15.07693s; System: 0s); Wall Clock 15.077365896s. | |
| [17:07:59] Computing final summary valuations. | |
| [17:07:59] Summary valuation: f(Solution) = 9.9988415035e-01 | |
| [17:07:59] Computing conditional curvature for 1 elements. | |
| [17:07:59] Computing conditional curvature. | |
| [17:07:59] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08. | |
| [17:07:59] Finished execution successfully, exiting .... | |
| real 1m12.893s | |
| user 0m18.488s | |
| sys 0m20.959s | |
| [17:08:00] ----- Submarine logging started ----- | |
| [17:08:00] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices .... | |
| [17:08:00] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit. | |
| [17:08:00] Using 22 threads for general operations. | |
| [17:08:00] Command line: smraiz -flfilename /mnt/disks/ssd3/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks | |
| [17:08:00] Loading FL matrix. | |
| [17:08:00] RNPHR: Reading numpy file v1.0 with header size 70. | |
| [17:08:00] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false. | |
| [17:08:00] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false. | |
| [17:08:00] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting. | |
| [17:08:00] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000. | |
| [17:08:03] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353. | |
| [17:08:06] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706. | |
| [17:08:08] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059. | |
| [17:08:11] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412. | |
| [17:08:14] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765. | |
| [17:08:17] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118. | |
| [17:08:20] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471. | |
| [17:08:23] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824. | |
| [17:08:26] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177. | |
| [17:08:29] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530. | |
| [17:08:32] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883. | |
| [17:08:35] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236. | |
| [17:08:38] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589. | |
| [17:08:40] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942. | |
| [17:08:43] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295. | |
| [17:08:46] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648. | |
| [17:08:49] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001. | |
| [17:08:52] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354. | |
| [17:08:54] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0. | |
| [17:08:54] RMNF: directly read 100000x100000 numpy matrix. | |
| [17:08:54] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7f54efad2040. | |
| [17:08:54] Loaded FL 100000x100000 matrix. | |
| [17:08:54] No transform requested for loaded FL 100000x100000 matrix. | |
| [17:08:54] Finished loading FL 100000x100000 matrix. | |
| [17:08:54] Creating a Facility Location Function with a 100000x100000 matrix. | |
| [17:08:54] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7f54efad2040. | |
| [17:08:57] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7f54efad2040, 1/norm_const = 2.2285229856085104e-06. | |
| [17:08:57] Finished creating a Facility Location Function. | |
| [17:08:57] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1. | |
| [17:08:57] Created function mixture with 1 component. | |
| [17:08:57] Using 1 thread for summarization. | |
| [17:08:57] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1. | |
| [17:08:57] Gain permit type = 1, Gain threshold = 0. | |
| [17:08:57] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647. | |
| [17:08:57] ACGR: Computing 100000 singleton values. | |
| [17:09:12] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain. | |
| [17:09:12] ACGR: Building initial PQ. | |
| [17:09:12] ACGR: Finished building initial PQ. | |
| [17:09:12] ACGR: Finished running accelerated greedy, solution has 1 elements. | |
| [17:09:12] Summarization time: CPU 15.029378s (User: 15.029378s; System: 0s); Wall Clock 15.030304303000001s. | |
| [17:09:12] Computing final summary valuations. | |
| [17:09:12] Summary valuation: f(Solution) = 9.9988415035e-01 | |
| [17:09:12] Computing conditional curvature for 1 elements. | |
| [17:09:12] Computing conditional curvature. | |
| [17:09:12] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08. | |
| [17:09:12] Finished execution successfully, exiting .... | |
| real 1m12.749s | |
| user 0m18.248s | |
| sys 0m21.672s | |
| [17:09:12] ----- Submarine logging started ----- | |
| [17:09:12] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices .... | |
| [17:09:12] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit. | |
| [17:09:12] Using 22 threads for general operations. | |
| [17:09:12] Command line: smraiz -flfilename /mnt/disks/ssd3/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks | |
| [17:09:12] Loading FL matrix. | |
| [17:09:12] RNPHR: Reading numpy file v1.0 with header size 70. | |
| [17:09:12] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false. | |
| [17:09:12] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false. | |
| [17:09:12] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting. | |
| [17:09:12] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000. | |
| [17:09:13] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353. | |
| [17:09:14] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706. | |
| [17:09:14] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059. | |
| [17:09:15] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412. | |
| [17:09:16] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765. | |
| [17:09:16] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118. | |
| [17:09:17] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471. | |
| [17:09:18] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824. | |
| [17:09:18] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177. | |
| [17:09:19] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530. | |
| [17:09:19] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883. | |
| [17:09:22] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236. | |
| [17:09:25] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589. | |
| [17:09:28] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942. | |
| [17:09:29] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295. | |
| [17:09:31] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648. | |
| [17:09:32] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001. | |
| [17:09:33] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354. | |
| [17:09:33] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0. | |
| [17:09:33] RMNF: directly read 100000x100000 numpy matrix. | |
| [17:09:33] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7f0728146040. | |
| [17:09:33] Loaded FL 100000x100000 matrix. | |
| [17:09:33] No transform requested for loaded FL 100000x100000 matrix. | |
| [17:09:33] Finished loading FL 100000x100000 matrix. | |
| [17:09:33] Creating a Facility Location Function with a 100000x100000 matrix. | |
| [17:09:33] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7f0728146040. | |
| [17:09:37] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7f0728146040, 1/norm_const = 2.2285229856085104e-06. | |
| [17:09:37] Finished creating a Facility Location Function. | |
| [17:09:37] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1. | |
| [17:09:37] Created function mixture with 1 component. | |
| [17:09:37] Using 1 thread for summarization. | |
| [17:09:37] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1. | |
| [17:09:37] Gain permit type = 1, Gain threshold = 0. | |
| [17:09:37] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647. | |
| [17:09:37] ACGR: Computing 100000 singleton values. | |
| [17:09:52] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain. | |
| [17:09:52] ACGR: Building initial PQ. | |
| [17:09:52] ACGR: Finished building initial PQ. | |
| [17:09:52] ACGR: Finished running accelerated greedy, solution has 1 elements. | |
| [17:09:52] Summarization time: CPU 15.025878s (User: 15.025878s; System: 0s); Wall Clock 15.026298205s. | |
| [17:09:52] Computing final summary valuations. | |
| [17:09:52] Summary valuation: f(Solution) = 9.9988415035e-01 | |
| [17:09:52] Computing conditional curvature for 1 elements. | |
| [17:09:52] Computing conditional curvature. | |
| [17:09:52] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08. | |
| [17:09:52] Finished execution successfully, exiting .... | |
| real 0m39.365s | |
| user 0m18.243s | |
| sys 0m14.838s | |
| [17:09:52] ----- Submarine logging started ----- | |
| [17:09:52] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices .... | |
| [17:09:52] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit. | |
| [17:09:52] Using 22 threads for general operations. | |
| [17:09:52] Command line: smraiz -flfilename /mnt/disks/ssd3/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks | |
| [17:09:52] Loading FL matrix. | |
| [17:09:52] RNPHR: Reading numpy file v1.0 with header size 70. | |
| [17:09:52] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false. | |
| [17:09:52] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false. | |
| [17:09:52] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting. | |
| [17:09:52] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000. | |
| [17:09:52] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353. | |
| [17:09:53] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706. | |
| [17:09:54] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059. | |
| [17:09:54] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412. | |
| [17:09:55] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765. | |
| [17:09:56] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118. | |
| [17:09:56] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471. | |
| [17:09:57] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824. | |
| [17:09:58] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177. | |
| [17:09:58] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530. | |
| [17:09:59] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883. | |
| [17:09:59] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236. | |
| [17:10:00] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589. | |
| [17:10:01] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942. | |
| [17:10:01] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295. | |
| [17:10:02] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648. | |
| [17:10:03] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001. | |
| [17:10:04] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354. | |
| [17:10:04] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0. | |
| [17:10:04] RMNF: directly read 100000x100000 numpy matrix. | |
| [17:10:04] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7fce5d592040. | |
| [17:10:04] Loaded FL 100000x100000 matrix. | |
| [17:10:04] No transform requested for loaded FL 100000x100000 matrix. | |
| [17:10:04] Finished loading FL 100000x100000 matrix. | |
| [17:10:04] Creating a Facility Location Function with a 100000x100000 matrix. | |
| [17:10:04] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7fce5d592040. | |
| [17:10:08] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7fce5d592040, 1/norm_const = 2.2285229856085104e-06. | |
| [17:10:08] Finished creating a Facility Location Function. | |
| [17:10:08] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1. | |
| [17:10:08] Created function mixture with 1 component. | |
| [17:10:08] Using 1 thread for summarization. | |
| [17:10:08] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1. | |
| [17:10:08] Gain permit type = 1, Gain threshold = 0. | |
| [17:10:08] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647. | |
| [17:10:08] ACGR: Computing 100000 singleton values. | |
| [17:10:23] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain. | |
| [17:10:23] ACGR: Building initial PQ. | |
| [17:10:23] ACGR: Finished building initial PQ. | |
| [17:10:23] ACGR: Finished running accelerated greedy, solution has 1 elements. | |
| [17:10:23] Summarization time: CPU 14.959245s (User: 14.957891s; System: 0.001354s); Wall Clock 14.959705832s. | |
| [17:10:23] Computing final summary valuations. | |
| [17:10:23] Summary valuation: f(Solution) = 9.9988415035e-01 | |
| [17:10:23] Computing conditional curvature for 1 elements. | |
| [17:10:23] Computing conditional curvature. | |
| [17:10:23] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08. | |
| [17:10:23] Finished execution successfully, exiting .... | |
| real 0m31.024s | |
| user 0m18.181s | |
| sys 0m12.837s | |
| [17:10:23] ----- Submarine logging started ----- | |
| [17:10:23] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices .... | |
| [17:10:23] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit. | |
| [17:10:23] Using 22 threads for general operations. | |
| [17:10:23] Command line: smraiz -flfilename /mnt/disks/ssd3/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks | |
| [17:10:23] Loading FL matrix. | |
| [17:10:23] RNPHR: Reading numpy file v1.0 with header size 70. | |
| [17:10:23] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false. | |
| [17:10:23] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false. | |
| [17:10:23] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting. | |
| [17:10:23] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000. | |
| [17:10:24] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353. | |
| [17:10:24] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706. | |
| [17:10:25] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059. | |
| [17:10:25] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412. | |
| [17:10:26] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765. | |
| [17:10:27] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118. | |
| [17:10:27] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471. | |
| [17:10:28] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824. | |
| [17:10:29] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177. | |
| [17:10:29] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530. | |
| [17:10:30] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883. | |
| [17:10:31] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236. | |
| [17:10:31] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589. | |
| [17:10:32] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942. | |
| [17:10:32] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295. | |
| [17:10:33] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648. | |
| [17:10:34] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001. | |
| [17:10:35] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354. | |
| [17:10:35] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0. | |
| [17:10:35] RMNF: directly read 100000x100000 numpy matrix. | |
| [17:10:35] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7fa216baf040. | |
| [17:10:35] Loaded FL 100000x100000 matrix. | |
| [17:10:35] No transform requested for loaded FL 100000x100000 matrix. | |
| [17:10:35] Finished loading FL 100000x100000 matrix. | |
| [17:10:35] Creating a Facility Location Function with a 100000x100000 matrix. | |
| [17:10:35] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7fa216baf040. | |
| [17:10:38] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7fa216baf040, 1/norm_const = 2.2285229856085104e-06. | |
| [17:10:38] Finished creating a Facility Location Function. | |
| [17:10:38] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1. | |
| [17:10:38] Created function mixture with 1 component. | |
| [17:10:38] Using 1 thread for summarization. | |
| [17:10:38] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1. | |
| [17:10:38] Gain permit type = 1, Gain threshold = 0. | |
| [17:10:38] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647. | |
| [17:10:38] ACGR: Computing 100000 singleton values. | |
| [17:10:53] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain. | |
| [17:10:53] ACGR: Building initial PQ. | |
| [17:10:53] ACGR: Finished building initial PQ. | |
| [17:10:53] ACGR: Finished running accelerated greedy, solution has 1 elements. | |
| [17:10:53] Summarization time: CPU 14.952793s (User: 14.944103s; System: 0.00869s); Wall Clock 14.953541663s. | |
| [17:10:53] Computing final summary valuations. | |
| [17:10:53] Summary valuation: f(Solution) = 9.9988415035e-01 | |
| [17:10:53] Computing conditional curvature for 1 elements. | |
| [17:10:53] Computing conditional curvature. | |
| [17:10:53] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08. | |
| [17:10:53] Finished execution successfully, exiting .... | |
| real 0m30.597s | |
| user 0m18.164s | |
| sys 0m12.431s | |
| [17:10:53] ----- Submarine logging started ----- | |
| [17:10:53] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices .... | |
| [17:10:53] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit. | |
| [17:10:53] Using 22 threads for general operations. | |
| [17:10:53] Command line: smraiz -flfilename /mnt/disks/ssd4/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks | |
| [17:10:53] Loading FL matrix. | |
| [17:10:53] RNPHR: Reading numpy file v1.0 with header size 70. | |
| [17:10:53] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false. | |
| [17:10:53] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false. | |
| [17:10:53] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting. | |
| [17:10:53] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000. | |
| [17:10:56] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353. | |
| [17:10:59] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706. | |
| [17:11:02] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059. | |
| [17:11:05] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412. | |
| [17:11:08] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765. | |
| [17:11:11] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118. | |
| [17:11:14] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471. | |
| [17:11:17] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824. | |
| [17:11:20] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177. | |
| [17:11:23] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530. | |
| [17:11:25] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883. | |
| [17:11:28] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236. | |
| [17:11:31] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589. | |
| [17:11:34] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942. | |
| [17:11:37] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295. | |
| [17:11:40] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648. | |
| [17:11:43] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001. | |
| [17:11:46] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354. | |
| [17:11:48] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0. | |
| [17:11:48] RMNF: directly read 100000x100000 numpy matrix. | |
| [17:11:48] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7f1fa1346040. | |
| [17:11:48] Loaded FL 100000x100000 matrix. | |
| [17:11:48] No transform requested for loaded FL 100000x100000 matrix. | |
| [17:11:48] Finished loading FL 100000x100000 matrix. | |
| [17:11:48] Creating a Facility Location Function with a 100000x100000 matrix. | |
| [17:11:48] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7f1fa1346040. | |
| [17:11:51] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7f1fa1346040, 1/norm_const = 2.2285229856085104e-06. | |
| [17:11:51] Finished creating a Facility Location Function. | |
| [17:11:51] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1. | |
| [17:11:51] Created function mixture with 1 component. | |
| [17:11:51] Using 1 thread for summarization. | |
| [17:11:51] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1. | |
| [17:11:51] Gain permit type = 1, Gain threshold = 0. | |
| [17:11:51] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647. | |
| [17:11:51] ACGR: Computing 100000 singleton values. | |
| [17:12:06] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain. | |
| [17:12:06] ACGR: Building initial PQ. | |
| [17:12:06] ACGR: Finished building initial PQ. | |
| [17:12:06] ACGR: Finished running accelerated greedy, solution has 1 elements. | |
| [17:12:06] Summarization time: CPU 15.036308s (User: 15.036308s; System: 0s); Wall Clock 15.036772725s. | |
| [17:12:06] Computing final summary valuations. | |
| [17:12:06] Summary valuation: f(Solution) = 9.9988415035e-01 | |
| [17:12:06] Computing conditional curvature for 1 elements. | |
| [17:12:06] Computing conditional curvature. | |
| [17:12:06] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08. | |
| [17:12:06] Finished execution successfully, exiting .... | |
| real 1m12.775s | |
| user 0m18.350s | |
| sys 0m21.262s | |
| [17:12:06] ----- Submarine logging started ----- | |
| [17:12:06] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices .... | |
| [17:12:06] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit. | |
| [17:12:06] Using 22 threads for general operations. | |
| [17:12:06] Command line: smraiz -flfilename /mnt/disks/ssd4/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks | |
| [17:12:06] Loading FL matrix. | |
| [17:12:06] RNPHR: Reading numpy file v1.0 with header size 70. | |
| [17:12:06] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false. | |
| [17:12:06] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false. | |
| [17:12:06] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting. | |
| [17:12:06] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000. | |
| [17:12:09] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353. | |
| [17:12:12] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706. | |
| [17:12:15] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059. | |
| [17:12:18] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412. | |
| [17:12:21] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765. | |
| [17:12:24] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118. | |
| [17:12:27] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471. | |
| [17:12:30] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824. | |
| [17:12:32] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177. | |
| [17:12:35] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530. | |
| [17:12:38] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883. | |
| [17:12:41] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236. | |
| [17:12:44] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589. | |
| [17:12:47] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942. | |
| [17:12:50] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295. | |
| [17:12:53] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648. | |
| [17:12:56] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001. | |
| [17:12:59] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354. | |
| [17:13:00] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0. | |
| [17:13:00] RMNF: directly read 100000x100000 numpy matrix. | |
| [17:13:00] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7fbafef1c040. | |
| [17:13:00] Loaded FL 100000x100000 matrix. | |
| [17:13:00] No transform requested for loaded FL 100000x100000 matrix. | |
| [17:13:00] Finished loading FL 100000x100000 matrix. | |
| [17:13:00] Creating a Facility Location Function with a 100000x100000 matrix. | |
| [17:13:00] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7fbafef1c040. | |
| [17:13:04] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7fbafef1c040, 1/norm_const = 2.2285229856085104e-06. | |
| [17:13:04] Finished creating a Facility Location Function. | |
| [17:13:04] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1. | |
| [17:13:04] Created function mixture with 1 component. | |
| [17:13:04] Using 1 thread for summarization. | |
| [17:13:04] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1. | |
| [17:13:04] Gain permit type = 1, Gain threshold = 0. | |
| [17:13:04] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647. | |
| [17:13:04] ACGR: Computing 100000 singleton values. | |
| [17:13:19] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain. | |
| [17:13:19] ACGR: Building initial PQ. | |
| [17:13:19] ACGR: Finished building initial PQ. | |
| [17:13:19] ACGR: Finished running accelerated greedy, solution has 1 elements. | |
| [17:13:19] Summarization time: CPU 15.276239s (User: 15.276239s; System: 0s); Wall Clock 15.278974932999999s. | |
| [17:13:19] Computing final summary valuations. | |
| [17:13:19] Summary valuation: f(Solution) = 9.9988415035e-01 | |
| [17:13:19] Computing conditional curvature for 1 elements. | |
| [17:13:19] Computing conditional curvature. | |
| [17:13:19] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08. | |
| [17:13:19] Finished execution successfully, exiting .... | |
| real 1m13.490s | |
| user 0m18.891s | |
| sys 0m22.446s | |
| [17:13:20] ----- Submarine logging started ----- | |
| [17:13:20] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices .... | |
| [17:13:20] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit. | |
| [17:13:20] Using 22 threads for general operations. | |
| [17:13:20] Command line: smraiz -flfilename /mnt/disks/ssd4/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks | |
| [17:13:20] Loading FL matrix. | |
| [17:13:20] RNPHR: Reading numpy file v1.0 with header size 70. | |
| [17:13:20] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false. | |
| [17:13:20] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false. | |
| [17:13:20] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting. | |
| [17:13:20] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000. | |
| [17:13:20] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353. | |
| [17:13:21] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706. | |
| [17:13:22] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059. | |
| [17:13:22] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412. | |
| [17:13:23] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765. | |
| [17:13:24] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118. | |
| [17:13:24] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471. | |
| [17:13:25] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824. | |
| [17:13:25] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177. | |
| [17:13:26] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530. | |
| [17:13:27] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883. | |
| [17:13:28] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236. | |
| [17:13:31] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589. | |
| [17:13:34] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942. | |
| [17:13:35] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295. | |
| [17:13:36] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648. | |
| [17:13:37] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001. | |
| [17:13:38] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354. | |
| [17:13:38] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0. | |
| [17:13:38] RMNF: directly read 100000x100000 numpy matrix. | |
| [17:13:38] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7f7030196040. | |
| [17:13:38] Loaded FL 100000x100000 matrix. | |
| [17:13:38] No transform requested for loaded FL 100000x100000 matrix. | |
| [17:13:38] Finished loading FL 100000x100000 matrix. | |
| [17:13:38] Creating a Facility Location Function with a 100000x100000 matrix. | |
| [17:13:38] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7f7030196040. | |
| [17:13:42] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7f7030196040, 1/norm_const = 2.2285229856085104e-06. | |
| [17:13:42] Finished creating a Facility Location Function. | |
| [17:13:42] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1. | |
| [17:13:42] Created function mixture with 1 component. | |
| [17:13:42] Using 1 thread for summarization. | |
| [17:13:42] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1. | |
| [17:13:42] Gain permit type = 1, Gain threshold = 0. | |
| [17:13:42] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647. | |
| [17:13:42] ACGR: Computing 100000 singleton values. | |
| [17:13:57] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain. | |
| [17:13:57] ACGR: Building initial PQ. | |
| [17:13:57] ACGR: Finished building initial PQ. | |
| [17:13:57] ACGR: Finished running accelerated greedy, solution has 1 elements. | |
| [17:13:57] Summarization time: CPU 15.064633s (User: 15.064633s; System: 0s); Wall Clock 15.065159453s. | |
| [17:13:57] Computing final summary valuations. | |
| [17:13:57] Summary valuation: f(Solution) = 9.9988415035e-01 | |
| [17:13:57] Computing conditional curvature for 1 elements. | |
| [17:13:57] Computing conditional curvature. | |
| [17:13:57] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08. | |
| [17:13:57] Finished execution successfully, exiting .... | |
| real 0m37.378s | |
| user 0m18.309s | |
| sys 0m14.997s | |
| [17:13:57] ----- Submarine logging started ----- | |
| [17:13:57] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices .... | |
| [17:13:57] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit. | |
| [17:13:57] Using 22 threads for general operations. | |
| [17:13:57] Command line: smraiz -flfilename /mnt/disks/ssd4/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks | |
| [17:13:57] Loading FL matrix. | |
| [17:13:57] RNPHR: Reading numpy file v1.0 with header size 70. | |
| [17:13:57] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false. | |
| [17:13:57] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false. | |
| [17:13:57] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting. | |
| [17:13:57] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000. | |
| [17:13:58] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353. | |
| [17:13:58] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706. | |
| [17:13:59] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059. | |
| [17:14:00] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412. | |
| [17:14:00] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765. | |
| [17:14:01] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118. | |
| [17:14:02] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471. | |
| [17:14:02] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824. | |
| [17:14:03] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177. | |
| [17:14:03] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530. | |
| [17:14:04] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883. | |
| [17:14:05] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236. | |
| [17:14:05] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589. | |
| [17:14:06] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942. | |
| [17:14:07] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295. | |
| [17:14:08] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648. | |
| [17:14:09] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001. | |
| [17:14:10] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354. | |
| [17:14:10] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0. | |
| [17:14:10] RMNF: directly read 100000x100000 numpy matrix. | |
| [17:14:10] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7f8c0e60b040. | |
| [17:14:10] Loaded FL 100000x100000 matrix. | |
| [17:14:10] No transform requested for loaded FL 100000x100000 matrix. | |
| [17:14:10] Finished loading FL 100000x100000 matrix. | |
| [17:14:10] Creating a Facility Location Function with a 100000x100000 matrix. | |
| [17:14:10] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7f8c0e60b040. | |
| [17:14:13] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7f8c0e60b040, 1/norm_const = 2.2285229856085104e-06. | |
| [17:14:13] Finished creating a Facility Location Function. | |
| [17:14:13] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1. | |
| [17:14:13] Created function mixture with 1 component. | |
| [17:14:13] Using 1 thread for summarization. | |
| [17:14:13] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1. | |
| [17:14:13] Gain permit type = 1, Gain threshold = 0. | |
| [17:14:13] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647. | |
| [17:14:13] ACGR: Computing 100000 singleton values. | |
| [17:14:28] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain. | |
| [17:14:28] ACGR: Building initial PQ. | |
| [17:14:28] ACGR: Finished building initial PQ. | |
| [17:14:28] ACGR: Finished running accelerated greedy, solution has 1 elements. | |
| [17:14:28] Summarization time: CPU 15.157068s (User: 15.157068s; System: 0s); Wall Clock 15.157636216999999s. | |
| [17:14:28] Computing final summary valuations. | |
| [17:14:28] Summary valuation: f(Solution) = 9.9988415035e-01 | |
| [17:14:28] Computing conditional curvature for 1 elements. | |
| [17:14:28] Computing conditional curvature. | |
| [17:14:28] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08. | |
| [17:14:28] Finished execution successfully, exiting .... | |
| real 0m31.757s | |
| user 0m18.383s | |
| sys 0m13.371s | |
| [17:14:29] ----- Submarine logging started ----- | |
| [17:14:29] Started new execution run, signed 32-bit element types, signed 64-bit matrix indices .... | |
| [17:14:29] Types: set elements signed 32-bit, set sizes signed 32-bit, set indices signed 32-bit, set iters unsigned 32-bit, matrix indices signed 64-bit. | |
| [17:14:29] Using 22 threads for general operations. | |
| [17:14:29] Command line: smraiz -flfilename /mnt/disks/ssd4/tinyimagenet_convnetd4_1_features_ffcv_False_simeuclid_sim_or_dist.npy -sumsize 1 -cloglevel trace -floglevel trace -loglevel trace -clogtimestamps T -nochecks | |
| [17:14:29] Loading FL matrix. | |
| [17:14:29] RNPHR: Reading numpy file v1.0 with header size 70. | |
| [17:14:29] RNPHR: Finished header of v1.0 numpy file, a 100000x100000 32-bit float (f4) matrix, element byte length 4, fortran false, endian little, endian N/A false. | |
| [17:14:29] RMNF: allocating and reading 100000x100000 numpy matrix, skip_type_cast=true, fortran_order = false, need_endian=false. | |
| [17:14:29] RMNF: direct reading of 100000x100000 numpy matrix, no typecasting. | |
| [17:14:29] RSIC: Reading 2147483647-byte chunk 1 (of 19), total to read 40000000000, chunk size 2147483647, total read 0, total remaining 40000000000. | |
| [17:14:30] RSIC: Reading 2147483647-byte chunk 2 (of 19), total to read 40000000000, chunk size 2147483647, total read 2147483647, total remaining 37852516353. | |
| [17:14:30] RSIC: Reading 2147483647-byte chunk 3 (of 19), total to read 40000000000, chunk size 2147483647, total read 4294967294, total remaining 35705032706. | |
| [17:14:31] RSIC: Reading 2147483647-byte chunk 4 (of 19), total to read 40000000000, chunk size 2147483647, total read 6442450941, total remaining 33557549059. | |
| [17:14:31] RSIC: Reading 2147483647-byte chunk 5 (of 19), total to read 40000000000, chunk size 2147483647, total read 8589934588, total remaining 31410065412. | |
| [17:14:32] RSIC: Reading 2147483647-byte chunk 6 (of 19), total to read 40000000000, chunk size 2147483647, total read 10737418235, total remaining 29262581765. | |
| [17:14:33] RSIC: Reading 2147483647-byte chunk 7 (of 19), total to read 40000000000, chunk size 2147483647, total read 12884901882, total remaining 27115098118. | |
| [17:14:33] RSIC: Reading 2147483647-byte chunk 8 (of 19), total to read 40000000000, chunk size 2147483647, total read 15032385529, total remaining 24967614471. | |
| [17:14:34] RSIC: Reading 2147483647-byte chunk 9 (of 19), total to read 40000000000, chunk size 2147483647, total read 17179869176, total remaining 22820130824. | |
| [17:14:35] RSIC: Reading 2147483647-byte chunk 10 (of 19), total to read 40000000000, chunk size 2147483647, total read 19327352823, total remaining 20672647177. | |
| [17:14:35] RSIC: Reading 2147483647-byte chunk 11 (of 19), total to read 40000000000, chunk size 2147483647, total read 21474836470, total remaining 18525163530. | |
| [17:14:36] RSIC: Reading 2147483647-byte chunk 12 (of 19), total to read 40000000000, chunk size 2147483647, total read 23622320117, total remaining 16377679883. | |
| [17:14:36] RSIC: Reading 2147483647-byte chunk 13 (of 19), total to read 40000000000, chunk size 2147483647, total read 25769803764, total remaining 14230196236. | |
| [17:14:37] RSIC: Reading 2147483647-byte chunk 14 (of 19), total to read 40000000000, chunk size 2147483647, total read 27917287411, total remaining 12082712589. | |
| [17:14:38] RSIC: Reading 2147483647-byte chunk 15 (of 19), total to read 40000000000, chunk size 2147483647, total read 30064771058, total remaining 9935228942. | |
| [17:14:39] RSIC: Reading 2147483647-byte chunk 16 (of 19), total to read 40000000000, chunk size 2147483647, total read 32212254705, total remaining 7787745295. | |
| [17:14:40] RSIC: Reading 2147483647-byte chunk 17 (of 19), total to read 40000000000, chunk size 2147483647, total read 34359738352, total remaining 5640261648. | |
| [17:14:40] RSIC: Reading 2147483647-byte chunk 18 (of 19), total to read 40000000000, chunk size 2147483647, total read 36507221999, total remaining 3492778001. | |
| [17:14:41] RSIC: Reading 1345294354-byte chunk 19 (of 19), total to read 40000000000, chunk size 2147483647, total read 38654705646, total remaining 1345294354. | |
| [17:14:42] RSIC: Finished reading 40000000000 bytes, chunk size 2147483647, total read 40000000000 in 19 chunks, total remaining 0. | |
| [17:14:42] RMNF: directly read 100000x100000 numpy matrix. | |
| [17:14:42] RMNF: finished reading 100000x100000 numpy matrix, dataptr = 0x7fdf13f47040. | |
| [17:14:42] Loaded FL 100000x100000 matrix. | |
| [17:14:42] No transform requested for loaded FL 100000x100000 matrix. | |
| [17:14:42] Finished loading FL 100000x100000 matrix. | |
| [17:14:42] Creating a Facility Location Function with a 100000x100000 matrix. | |
| [17:14:42] Creating 32-bit IEEE float facility location function with moved data, (rows,cols) = (100000,100000), own data ptr = 0x7fdf13f47040. | |
| [17:14:45] Done creating 32-bit IEEE float facility location function with (rows,cols) = (100000,100000), own data ptr = 0x7fdf13f47040, 1/norm_const = 2.2285229856085104e-06. | |
| [17:14:45] Finished creating a Facility Location Function. | |
| [17:14:45] Mixing in Dense FL, |V|=100000, 32-bit float type, #landmarks=100000 submodular set function, relative responsibility 1. | |
| [17:14:45] Created function mixture with 1 component. | |
| [17:14:45] Using 1 thread for summarization. | |
| [17:14:45] Summarizing function with ground set of size |V|=n=100000, relative ground set |R|=100000, down to summary of size k=1. | |
| [17:14:45] Gain permit type = 1, Gain threshold = 0. | |
| [17:14:45] ACGR: Starting accelerated greedy, cnstr has rank upper bound 1, additional card. cnstr 2147483647. | |
| [17:14:45] ACGR: Computing 100000 singleton values. | |
| [17:15:00] ACGR: Done computing 100000 singleton values, pruned 0 due to too small a gain. | |
| [17:15:00] ACGR: Building initial PQ. | |
| [17:15:00] ACGR: Finished building initial PQ. | |
| [17:15:00] ACGR: Finished running accelerated greedy, solution has 1 elements. | |
| [17:15:00] Summarization time: CPU 15.181177s (User: 15.178063s; System: 0.003114s); Wall Clock 15.18177117s. | |
| [17:15:00] Computing final summary valuations. | |
| [17:15:00] Summary valuation: f(Solution) = 9.9988415035e-01 | |
| [17:15:00] Computing conditional curvature for 1 elements. | |
| [17:15:00] Computing conditional curvature. | |
| [17:15:00] Done w. cond. curvature. Avg first 1 CC values = 2.17796e-08, (1st 0, 2nd 1) = (0,4.35591e-08), 2nd-1st = 4.35591e-08. | |
| [17:15:00] Finished execution successfully, exiting .... | |
| real 0m31.797s | |
| user 0m18.415s | |
| sys 0m13.379s |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment