Skip to content

Instantly share code, notes, and snippets.

@vmx

vmx/out001-12.log

Last active February 13, 2020 13:04
Show Gist options
  • Save vmx/efc1c3741b2884ddbfdaa139e3d8a8bc to your computer and use it in GitHub Desktop.
Save vmx/efc1c3741b2884ddbfdaa139e3d8a8bc to your computer and use it in GitHub Desktop.
Download ZIP
GPU/CPU testing related log
Raw
out001-12.log
Compiling storage-proofs v1.0.0-alpha.0 (/home/ubuntu/vmx/rust-fil-proofs/storage-proofs)
Compiling filecoin-proofs v1.0.0-alpha.0 (/home/ubuntu/vmx/rust-fil-proofs/filecoin-proofs)
Compiling fil-proofs-tooling v0.6.1 (/home/ubuntu/vmx/rust-fil-proofs/fil-proofs-tooling)
Finished release [optimized] target(s) in 45.23s
Running `target/release/gpu-cpu-test`
2020-02-13T12:21:10.499 12923 main INFO gpu_cpu_test > Running high and low priority proofs in parallel
2020-02-13T12:21:10.499 12923 main INFO gpu_cpu_test > Force low piority proofs to CPU
2020-02-13T12:21:10.499 12923 main INFO gpu_cpu_test > Using threads
2020-02-13T12:21:11.241 12923 main INFO filecoin_proofs::api::seal > seal_pre_commit_phase1: start
2020-02-13T12:21:11.257 12923 main INFO filecoin_proofs::api::seal > building merkle tree for the original data
SEAL PHASE 1: SECTOR_SIZE 16777216, TREE SIZE 1048575, TREE LEAFS 524288, CACHED ABOVE BASE 7
2020-02-13T12:21:11.445 12923 main INFO filecoin_proofs::api::seal > verifying pieces
2020-02-13T12:21:11.445 12923 main INFO filecoin_proofs::pieces > verifying 1 pieces
2020-02-13T12:21:11.445 12923 main INFO storage_proofs::stacked::proof > replicate_phase1
2020-02-13T12:21:11.445 12923 main INFO storage_proofs::stacked::proof > generate labels
2020-02-13T12:21:11.445 12923 main INFO storage_proofs::stacked::proof > generating layer: 1
2020-02-13T12:21:18.227 12923 main INFO storage_proofs::stacked::proof > setting exp parents
2020-02-13T12:21:18.239 12923 main INFO storage_proofs::stacked::proof > storing labels on disk
2020-02-13T12:21:18.248 12923 main INFO storage_proofs::stacked::proof > generated layer 1 store with id layer-1
2020-02-13T12:21:18.248 12923 main INFO storage_proofs::stacked::proof > generating layer: 2
2020-02-13T12:21:25.159 12923 main INFO storage_proofs::stacked::proof > setting exp parents
2020-02-13T12:21:25.162 12923 main INFO storage_proofs::stacked::proof > storing labels on disk
2020-02-13T12:21:25.171 12923 main INFO storage_proofs::stacked::proof > generated layer 2 store with id layer-2
2020-02-13T12:21:25.173 12923 main INFO filecoin_proofs::api::seal > seal_pre_commit_phase2: start
SEAL PHASE 2: TREE SIZE 1048575, TREE LEAFS 524288, CACHED ABOVE BASE 7
2020-02-13T12:21:25.173 12923 main INFO storage_proofs::stacked::proof > replicate_phase2
NODES COUNT 524288, DATA LEN 16777216
2020-02-13T12:21:25.173 12923 main INFO storage_proofs::stacked::proof > Building column hashes
2020-02-13T12:21:28.457 12923 main INFO storage_proofs::stacked::proof > building tree_c
2020-02-13T12:21:31.740 12923 main INFO storage_proofs::stacked::proof > tree_c done
2020-02-13T12:21:31.740 12923 main INFO storage_proofs::stacked::proof > building tree_r_last
2020-02-13T12:21:35.066 12923 main INFO storage_proofs::stacked::proof > tree_r_last done
2020-02-13T12:21:35.076 12923 main INFO storage_proofs::porep > dropping data /tmp/.tmp02yx6j
TREE D LEN 1048575
TREE C LEN 1048575
TREE R_LAST LEN 1048575
2020-02-13T12:21:35.082 12923 main INFO filecoin_proofs::api::seal > seal_commit_phase1:start
2020-02-13T12:21:35.082 12923 main INFO filecoin_proofs::pieces > verifying 1 pieces
Instantiating Tree D with size 1048575 and leafs 524288
Instantiating Tree C with size 1048575 and leafs 524288
Instantiating Tree R Last with size 1048575 and leafs 524288
2020-02-13T12:21:35.118 12923 main INFO filecoin_proofs::api::seal > seal_commit_phase1:end
2020-02-13T12:21:35.134 12923 main INFO filecoin_proofs::api::seal > seal_commit_phase2:start
2020-02-13T12:21:35.134 12923 main INFO filecoin_proofs::caches > trying parameters memory cache for: STACKED[16777216]
2020-02-13T12:21:35.134 12923 main INFO filecoin_proofs::caches > no params in memory cache for STACKED[16777216]
2020-02-13T12:21:38.498 12923 main INFO storage_proofs::parameter_cache > parameter set identifier for cache: layered_drgporep::PublicParams{ graph: stacked_graph::StackedGraph{expansion_degree: 8 base_graph: drgraph::BucketGraph{size: 524288; degree: 6; hasher: PoseidonHasher} }, challenges: LayerChallenges { layers: 2, max_count: 2 } }
2020-02-13T12:21:38.498 12923 main INFO storage_proofs::parameter_cache > ensuring that all ancestor directories for: "/var/tmp/filecoin-proof-parameters/v22-stacked-proof-of-replication-PoseidonHasher-Sha256Hasher-f4bdecc971c681000d2e56d2e8f40877710978727ff383550bdc6202cdcdd9cd.params" exist
2020-02-13T12:21:38.498 12923 main INFO storage_proofs::parameter_cache > checking cache_path: "/var/tmp/filecoin-proof-parameters/v22-stacked-proof-of-replication-PoseidonHasher-Sha256Hasher-f4bdecc971c681000d2e56d2e8f40877710978727ff383550bdc6202cdcdd9cd.params" for parameters
2020-02-13T12:21:38.770 12923 main INFO storage_proofs::parameter_cache > read parameters from cache "/var/tmp/filecoin-proof-parameters/v22-stacked-proof-of-replication-PoseidonHasher-Sha256Hasher-f4bdecc971c681000d2e56d2e8f40877710978727ff383550bdc6202cdcdd9cd.params"
2020-02-13T12:21:38.770 12923 main INFO filecoin_proofs::api::seal > got groth params (16777216) while sealing
2020-02-13T12:21:38.770 12923 main INFO filecoin_proofs::api::seal > snark_proof:start
2020-02-13T12:21:38.770 12923 main INFO bellperson::groth16::prover > Bellperson 0.6.0 is being used!
2020-02-13T12:21:43.330 12923 main INFO bellperson::gpu::locks > GPU is available!
2020-02-13T12:21:43.330 12923 main DEBUG bellperson::gpu::locks > Acquiring GPU lock...
2020-02-13T12:21:43.330 12923 main DEBUG bellperson::gpu::locks > GPU lock acquired!
2020-02-13T12:21:43.558 12923 main INFO bellperson::gpu::fft > FFT: 1 working device(s) selected.
2020-02-13T12:21:43.558 12923 main INFO bellperson::gpu::fft > FFT: Device 0: Tesla V100-SXM2-16GB
2020-02-13T12:21:43.558 12923 main INFO bellperson::domain > GPU FFT kernel instantiated!
2020-02-13T12:21:45.531 12923 main DEBUG bellperson::gpu::locks > GPU lock released!
2020-02-13T12:21:48.109 12923 main INFO bellperson::gpu::locks > GPU is available!
2020-02-13T12:21:48.109 12923 main DEBUG bellperson::gpu::locks > Acquiring GPU lock...
2020-02-13T12:21:48.109 12923 main DEBUG bellperson::gpu::locks > GPU lock acquired!
2020-02-13T12:21:48.249 12923 main INFO bellperson::gpu::utils > Adding "Tesla V100-SXM2-16GB" to GPU list with 5120 CUDA cores.
2020-02-13T12:21:48.251 12923 main INFO bellperson::gpu::multiexp > Multiexp: 1 working device(s) selected. (CPU utilization: 0)
2020-02-13T12:21:48.251 12923 main INFO bellperson::gpu::multiexp > Multiexp: Device 0: Tesla V100-SXM2-16GB (Chunk-size: 8810587)
2020-02-13T12:21:48.251 12923 main INFO bellperson::multiexp > GPU Multiexp kernel instantiated!
2020-02-13T12:22:03.717 12923 main DEBUG bellperson::gpu::locks > GPU lock released!
2020-02-13T12:22:03.731 12923 main INFO filecoin_proofs::api::seal > snark_proof:finish
2020-02-13T12:22:03.731 12923 main INFO filecoin_proofs::caches > trying parameters memory cache for: STACKED[16777216]-verifying-key
2020-02-13T12:22:03.731 12923 main INFO filecoin_proofs::caches > no params in memory cache for STACKED[16777216]-verifying-key
2020-02-13T12:22:03.731 12923 main INFO storage_proofs::parameter_cache > parameter set identifier for cache: layered_drgporep::PublicParams{ graph: stacked_graph::StackedGraph{expansion_degree: 8 base_graph: drgraph::BucketGraph{size: 524288; degree: 6; hasher: PoseidonHasher} }, challenges: LayerChallenges { layers: 2, max_count: 2 } }
2020-02-13T12:22:03.731 12923 main INFO storage_proofs::parameter_cache > ensuring that all ancestor directories for: "/var/tmp/filecoin-proof-parameters/v22-stacked-proof-of-replication-PoseidonHasher-Sha256Hasher-f4bdecc971c681000d2e56d2e8f40877710978727ff383550bdc6202cdcdd9cd.vk" exist
2020-02-13T12:22:03.731 12923 main INFO storage_proofs::parameter_cache > checking cache_path: "/var/tmp/filecoin-proof-parameters/v22-stacked-proof-of-replication-PoseidonHasher-Sha256Hasher-f4bdecc971c681000d2e56d2e8f40877710978727ff383550bdc6202cdcdd9cd.vk" for verifying key
2020-02-13T12:22:03.747 12923 main INFO storage_proofs::parameter_cache > read verifying key from cache "/var/tmp/filecoin-proof-parameters/v22-stacked-proof-of-replication-PoseidonHasher-Sha256Hasher-f4bdecc971c681000d2e56d2e8f40877710978727ff383550bdc6202cdcdd9cd.vk"
2020-02-13T12:22:03.747 12923 main INFO filecoin_proofs::api::seal > got verifying key (16777216) while verifying seal
2020-02-13T12:22:03.766 12923 main INFO filecoin_proofs::api::seal > seal_commit_phase2:end
2020-02-13T12:22:03.766 12923 main INFO filecoin_proofs::api::post > generate_candidates:start
POST: TREE SIZE 1048575, TREE LEAFS 524288, CACHED ABOVE BASE 7
2020-02-13T12:22:03.769 12923 main INFO filecoin_proofs::api::post > generate_candidates:finish
2020-02-13T12:22:03.770 12923 high INFO gpu_cpu_test > iter 0
2020-02-13T12:22:03.770 12923 low INFO gpu_cpu_test > iter 0
2020-02-13T12:22:03.770 12923 low INFO filecoin_proofs::api::post > generate_post:start
2020-02-13T12:22:03.770 12923 high INFO filecoin_proofs::api::post > generate_post:start
2020-02-13T12:22:03.770 12923 low INFO filecoin_proofs::caches > trying parameters memory cache for: POST[16777216]
2020-02-13T12:22:03.770 12923 high INFO filecoin_proofs::caches > trying parameters memory cache for: POST[16777216]
2020-02-13T12:22:03.770 12923 low INFO filecoin_proofs::caches > no params in memory cache for POST[16777216]
2020-02-13T12:22:03.770 12923 high INFO filecoin_proofs::caches > no params in memory cache for POST[16777216]
2020-02-13T12:22:03.770 12923 high INFO storage_proofs::parameter_cache > parameter set identifier for cache: ElectionPoSt::PublicParams{sector_size: 16777216, count: 65, nodes: 1}
2020-02-13T12:22:03.770 12923 low INFO storage_proofs::parameter_cache > parameter set identifier for cache: ElectionPoSt::PublicParams{sector_size: 16777216, count: 65, nodes: 1}
2020-02-13T12:22:03.770 12923 high INFO storage_proofs::parameter_cache > ensuring that all ancestor directories for: "/var/tmp/filecoin-proof-parameters/v22-proof-of-spacetime-election-PoseidonHasher-9b5673a5c0df861151c2b8087fe4f0d8657558d07ce768b7067dab2eea76dad4.params" exist
2020-02-13T12:22:03.770 12923 low INFO storage_proofs::parameter_cache > ensuring that all ancestor directories for: "/var/tmp/filecoin-proof-parameters/v22-proof-of-spacetime-election-PoseidonHasher-9b5673a5c0df861151c2b8087fe4f0d8657558d07ce768b7067dab2eea76dad4.params" exist
2020-02-13T12:22:03.770 12923 high INFO storage_proofs::parameter_cache > checking cache_path: "/var/tmp/filecoin-proof-parameters/v22-proof-of-spacetime-election-PoseidonHasher-9b5673a5c0df861151c2b8087fe4f0d8657558d07ce768b7067dab2eea76dad4.params" for parameters
2020-02-13T12:22:03.770 12923 low INFO storage_proofs::parameter_cache > checking cache_path: "/var/tmp/filecoin-proof-parameters/v22-proof-of-spacetime-election-PoseidonHasher-9b5673a5c0df861151c2b8087fe4f0d8657558d07ce768b7067dab2eea76dad4.params" for parameters
2020-02-13T12:22:03.827 12923 high INFO storage_proofs::parameter_cache > read parameters from cache "/var/tmp/filecoin-proof-parameters/v22-proof-of-spacetime-election-PoseidonHasher-9b5673a5c0df861151c2b8087fe4f0d8657558d07ce768b7067dab2eea76dad4.params"
POST: TREE SIZE 1048575, TREE LEAFS 524288, CACHED ABOVE BASE 7
2020-02-13T12:22:03.827 12923 high INFO storage_proofs::compound_proof > vanilla_proof:start
2020-02-13T12:22:03.827 12923 high INFO storage_proofs::proof > groth_proof_count: 1
2020-02-13T12:22:03.827 12923 high INFO storage_proofs::proof > generating 1 groth proofs.
2020-02-13T12:22:03.827 12923 high INFO storage_proofs::proof > generating groth proof 0.
2020-02-13T12:22:03.827 12923 ThreadId(9) DEBUG merkletree::merkle > leafs 524288, total size 1048575, total height 20, cache_size 262143, cached levels above base 2, partial_height 3, cached_leafs 131072, segment_width 4, segment range 384176-384180 for 384179
2020-02-13T12:22:03.827 12923 ThreadId(2) DEBUG merkletree::merkle > leafs 524288, total size 1048575, total height 20, cache_size 262143, cached levels above base 2, partial_height 3, cached_leafs 131072, segment_width 4, segment range 471900-471904 for 471903
2020-02-13T12:22:03.827 12923 ThreadId(6) DEBUG merkletree::merkle > leafs 524288, total size 1048575, total height 20, cache_size 262143, cached levels above base 2, partial_height 3, cached_leafs 131072, segment_width 4, segment range 199948-199952 for 199951
2020-02-13T12:22:03.827 12923 ThreadId(7) DEBUG merkletree::merkle > leafs 524288, total size 1048575, total height 20, cache_size 262143, cached levels above base 2, partial_height 3, cached_leafs 131072, segment_width 4, segment range 438292-438296 for 438295
2020-02-13T12:22:03.827 12923 ThreadId(5) DEBUG merkletree::merkle > leafs 524288, total size 1048575, total height 20, cache_size 262143, cached levels above base 2, partial_height 3, cached_leafs 131072, segment_width 4, segment range 447568-447572 for 447571
2020-02-13T12:22:03.827 12923 ThreadId(3) DEBUG merkletree::merkle > leafs 524288, total size 1048575, total height 20, cache_size 262143, cached levels above base 2, partial_height 3, cached_leafs 131072, segment_width 4, segment range 467028-467032 for 467029
2020-02-13T12:22:03.827 12923 ThreadId(4) DEBUG merkletree::merkle > leafs 524288, total size 1048575, total height 20, cache_size 262143, cached levels above base 2, partial_height 3, cached_leafs 131072, segment_width 4, segment range 231952-231956 for 231955
2020-02-13T12:22:03.827 12923 ThreadId(8) DEBUG merkletree::merkle > leafs 524288, total size 1048575, total height 20, cache_size 262143, cached levels above base 2, partial_height 3, cached_leafs 131072, segment_width 4, segment range 506360-506364 for 506362
2020-02-13T12:22:03.828 12923 high INFO storage_proofs::proof > groth_proof_time: 1.042859ms
2020-02-13T12:22:03.828 12923 high INFO storage_proofs::proof > total_groth_proof_time: 1.113877ms
thread 'high' panicked at 'failed to generate PoSt with high priority: out of bounds
Stack backtrace:
0: <merkletree::store::level_cache::LevelCacheStore<E,R> as merkletree::store::Store<E>>::read_at
1: merkletree::merkle::MerkleTree<T,A,K>::gen_proof_and_partial_tree
2: core::ops::function::impls::<impl core::ops::function::FnMut<A> for &F>::call_mut
3: <core::iter::adapters::Map<I,F> as core::iter::traits::iterator::Iterator>::try_fold
4: <rayon::iter::fold::FoldFolder<C,ID,F> as rayon::iter::plumbing::Folder<T>>::consume_iter
5: <rayon::iter::while_some::WhileSomeFolder<C> as rayon::iter::plumbing::Folder<core::option::Option<T>>>::consume_iter
6: rayon::iter::plumbing::bridge_producer_consumer::helper
7: <rayon::iter::plumbing::bridge::Callback<C> as rayon::iter::plumbing::ProducerCallback<I>>::callback
8: rayon::iter::plumbing::Folder::consume_iter
9: rayon::iter::plumbing::bridge_producer_consumer::helper
10: std::panicking::try::do_call
11: __rust_maybe_catch_panic
at src/libpanic_unwind/lib.rs:86
12: rayon_core::registry::in_worker
13: rayon::iter::plumbing::bridge_producer_consumer::helper
14: std::panicking::try::do_call
15: __rust_maybe_catch_panic
at src/libpanic_unwind/lib.rs:86
16: <rayon_core::job::StackJob<L,F,R> as rayon_core::job::Job>::execute
17: rayon_core::registry::WorkerThread::wait_until_cold
18: rayon_core::registry::ThreadBuilder::run
19: std::sys_common::backtrace::__rust_begin_short_backtrace
20: std::panicking::try::do_call
21: __rust_maybe_catch_panic
at src/libpanic_unwind/lib.rs:86
22: core::ops::function::FnOnce::call_once{{vtable.shim}}
23: <alloc::boxed::Box<F> as core::ops::function::FnOnce<A>>::call_once
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/liballoc/boxed.rs:1015
24: <alloc::boxed::Box<F> as core::ops::function::FnOnce<A>>::call_once
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/liballoc/boxed.rs:1015
std::sys_common::thread::start_thread
at src/libstd/sys_common/thread.rs:13
std::sys::unix::thread::Thread::new::thread_start
at src/libstd/sys/unix/thread.rs:80
25: start_thread
26: __clone', fil-proofs-tooling/src/bin/gpu-cpu-test/election_post.rs:207:5
stack backtrace:
0: backtrace::backtrace::libunwind::trace
at /cargo/registry/src/github.com-1ecc6299db9ec823/backtrace-0.3.40/src/backtrace/libunwind.rs:88
1: backtrace::backtrace::trace_unsynchronized
at /cargo/registry/src/github.com-1ecc6299db9ec823/backtrace-0.3.40/src/backtrace/mod.rs:66
2: std::sys_common::backtrace::_print_fmt
at src/libstd/sys_common/backtrace.rs:77
3: <std::sys_common::backtrace::_print::DisplayBacktrace as core::fmt::Display>::fmt
at src/libstd/sys_common/backtrace.rs:59
4: core::fmt::write
at src/libcore/fmt/mod.rs:1052
5: std::io::Write::write_fmt
at src/libstd/io/mod.rs:1426
6: std::sys_common::backtrace::_print
at src/libstd/sys_common/backtrace.rs:62
7: std::sys_common::backtrace::print
at src/libstd/sys_common/backtrace.rs:49
8: std::panicking::default_hook::{{closure}}
at src/libstd/panicking.rs:204
9: std::panicking::default_hook
at src/libstd/panicking.rs:224
10: std::panicking::rust_panic_with_hook
at src/libstd/panicking.rs:472
11: rust_begin_unwind
at src/libstd/panicking.rs:380
12: core::panicking::panic_fmt
at src/libcore/panicking.rs:85
13: core::option::expect_none_failed
at src/libcore/option.rs:1199
14: gpu_cpu_test::election_post::do_generate_post_in_priority
15: gpu_cpu_test::thread_fun
note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.
2020-02-13T12:22:03.922 12923 low INFO storage_proofs::parameter_cache > read parameters from cache "/var/tmp/filecoin-proof-parameters/v22-proof-of-spacetime-election-PoseidonHasher-9b5673a5c0df861151c2b8087fe4f0d8657558d07ce768b7067dab2eea76dad4.params"
POST: TREE SIZE 1048575, TREE LEAFS 524288, CACHED ABOVE BASE 7
2020-02-13T12:22:03.922 12923 low INFO storage_proofs::compound_proof > vanilla_proof:start
2020-02-13T12:22:03.922 12923 low INFO storage_proofs::proof > groth_proof_count: 1
2020-02-13T12:22:03.922 12923 low INFO storage_proofs::proof > generating 1 groth proofs.
2020-02-13T12:22:03.922 12923 low INFO storage_proofs::proof > generating groth proof 0.
2020-02-13T12:22:03.922 12923 ThreadId(8) DEBUG merkletree::merkle > leafs 524288, total size 1048575, total height 20, cache_size 262143, cached levels above base 2, partial_height 3, cached_leafs 131072, segment_width 4, segment range 438292-438296 for 438295
2020-02-13T12:22:03.922 12923 ThreadId(6) DEBUG merkletree::merkle > leafs 524288, total size 1048575, total height 20, cache_size 262143, cached levels above base 2, partial_height 3, cached_leafs 131072, segment_width 4, segment range 231952-231956 for 231955
2020-02-13T12:22:03.922 12923 ThreadId(4) DEBUG merkletree::merkle > leafs 524288, total size 1048575, total height 20, cache_size 262143, cached levels above base 2, partial_height 3, cached_leafs 131072, segment_width 4, segment range 506360-506364 for 506362
2020-02-13T12:22:03.922 12923 ThreadId(9) DEBUG merkletree::merkle > leafs 524288, total size 1048575, total height 20, cache_size 262143, cached levels above base 2, partial_height 3, cached_leafs 131072, segment_width 4, segment range 470172-470176 for 470174
2020-02-13T12:22:03.922 12923 ThreadId(7) DEBUG merkletree::merkle > leafs 524288, total size 1048575, total height 20, cache_size 262143, cached levels above base 2, partial_height 3, cached_leafs 131072, segment_width 4, segment range 366412-366416 for 366412
2020-02-13T12:22:03.922 12923 ThreadId(3) DEBUG merkletree::merkle > leafs 524288, total size 1048575, total height 20, cache_size 262143, cached levels above base 2, partial_height 3, cached_leafs 131072, segment_width 4, segment range 492904-492908 for 492904
2020-02-13T12:22:03.922 12923 ThreadId(5) DEBUG merkletree::merkle > leafs 524288, total size 1048575, total height 20, cache_size 262143, cached levels above base 2, partial_height 3, cached_leafs 131072, segment_width 4, segment range 120240-120244 for 120243
2020-02-13T12:22:03.922 12923 ThreadId(2) DEBUG merkletree::merkle > leafs 524288, total size 1048575, total height 20, cache_size 262143, cached levels above base 2, partial_height 3, cached_leafs 131072, segment_width 4, segment range 256612-256616 for 256612
2020-02-13T12:22:03.923 12923 low INFO storage_proofs::proof > groth_proof_time: 1.080652ms
2020-02-13T12:22:03.923 12923 low INFO storage_proofs::proof > total_groth_proof_time: 1.123868ms
thread 'low' panicked at 'failed to generate PoSt: out of bounds
Stack backtrace:
0: <merkletree::store::level_cache::LevelCacheStore<E,R> as merkletree::store::Store<E>>::read_at
1: merkletree::merkle::MerkleTree<T,A,K>::gen_proof_and_partial_tree
2: core::ops::function::impls::<impl core::ops::function::FnMut<A> for &F>::call_mut
3: <core::iter::adapters::Map<I,F> as core::iter::traits::iterator::Iterator>::try_fold
4: <rayon::iter::fold::FoldFolder<C,ID,F> as rayon::iter::plumbing::Folder<T>>::consume_iter
5: <rayon::iter::while_some::WhileSomeFolder<C> as rayon::iter::plumbing::Folder<core::option::Option<T>>>::consume_iter
6: rayon::iter::plumbing::bridge_producer_consumer::helper
7: <rayon::iter::plumbing::bridge::Callback<C> as rayon::iter::plumbing::ProducerCallback<I>>::callback
8: rayon::iter::plumbing::Folder::consume_iter
9: rayon::iter::plumbing::bridge_producer_consumer::helper
10: std::panicking::try::do_call
11: __rust_maybe_catch_panic
at src/libpanic_unwind/lib.rs:86
12: rayon_core::registry::in_worker
13: rayon::iter::plumbing::bridge_producer_consumer::helper
14: std::panicking::try::do_call
15: __rust_maybe_catch_panic
at src/libpanic_unwind/lib.rs:86
16: rayon_core::registry::in_worker
17: rayon::iter::plumbing::bridge_producer_consumer::helper
18: std::panicking::try::do_call
19: __rust_maybe_catch_panic
at src/libpanic_unwind/lib.rs:86
20: rayon_core::registry::in_worker
21: rayon::iter::plumbing::bridge_producer_consumer::helper
22: std::panicking::try::do_call
23: __rust_maybe_catch_panic
at src/libpanic_unwind/lib.rs:86
24: rayon_core::registry::in_worker
25: rayon::iter::plumbing::bridge_producer_consumer::helper
26: std::panicking::try::do_call
27: __rust_maybe_catch_panic
at src/libpanic_unwind/lib.rs:86
28: rayon_core::registry::in_worker
29: rayon::iter::plumbing::bridge_producer_consumer::helper
30: std::panicking::try::do_call
31: __rust_maybe_catch_panic
at src/libpanic_unwind/lib.rs:86
32: <std::panic::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once
33: std::panicking::try::do_call
34: __rust_maybe_catch_panic
at src/libpanic_unwind/lib.rs:86
35: <rayon_core::job::StackJob<L,F,R> as rayon_core::job::Job>::execute
36: rayon_core::registry::WorkerThread::wait_until_cold
37: rayon_core::registry::ThreadBuilder::run
38: std::sys_common::backtrace::__rust_begin_short_backtrace
39: std::panicking::try::do_call
40: __rust_maybe_catch_panic
at src/libpanic_unwind/lib.rs:86
41: core::ops::function::FnOnce::call_once{{vtable.shim}}
42: <alloc::boxed::Box<F> as core::ops::function::FnOnce<A>>::call_once
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/liballoc/boxed.rs:1015
43: <alloc::boxed::Box<F> as core::ops::function::FnOnce<A>>::call_once
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/liballoc/boxed.rs:1015
std::sys_common::thread::start_thread
at src/libstd/sys_common/thread.rs:13
std::sys::unix::thread::Thread::new::thread_start
at src/libstd/sys/unix/thread.rs:80
44: start_thread
45: __clone', fil-proofs-tooling/src/bin/gpu-cpu-test/election_post.rs:181:5
stack backtrace:
0: backtrace::backtrace::libunwind::trace
at /cargo/registry/src/github.com-1ecc6299db9ec823/backtrace-0.3.40/src/backtrace/libunwind.rs:88
1: backtrace::backtrace::trace_unsynchronized
at /cargo/registry/src/github.com-1ecc6299db9ec823/backtrace-0.3.40/src/backtrace/mod.rs:66
2: std::sys_common::backtrace::_print_fmt
at src/libstd/sys_common/backtrace.rs:77
3: <std::sys_common::backtrace::_print::DisplayBacktrace as core::fmt::Display>::fmt
at src/libstd/sys_common/backtrace.rs:59
4: core::fmt::write
at src/libcore/fmt/mod.rs:1052
5: std::io::Write::write_fmt
at src/libstd/io/mod.rs:1426
6: std::sys_common::backtrace::_print
at src/libstd/sys_common/backtrace.rs:62
7: std::sys_common::backtrace::print
at src/libstd/sys_common/backtrace.rs:49
8: std::panicking::default_hook::{{closure}}
at src/libstd/panicking.rs:204
9: std::panicking::default_hook
at src/libstd/panicking.rs:224
10: std::panicking::rust_panic_with_hook
at src/libstd/panicking.rs:472
11: rust_begin_unwind
at src/libstd/panicking.rs:380
12: core::panicking::panic_fmt
at src/libcore/panicking.rs:85
13: core::option::expect_none_failed
at src/libcore/option.rs:1199
14: gpu_cpu_test::election_post::do_generate_post
15: gpu_cpu_test::thread_fun
note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.
Raw
out001-13.log
Compiling libc v0.2.66
Compiling cfg-if v0.1.10
Compiling autocfg v1.0.0
Compiling spin v0.5.2
Compiling proc-macro2 v1.0.8
Compiling unicode-xid v0.2.0
Compiling syn v1.0.14
Compiling autocfg v0.1.7
Compiling semver-parser v0.7.0
Compiling byteorder v1.3.4
Compiling bitflags v1.2.1
Compiling slab v0.4.2
Compiling log v0.4.8
Compiling typenum v1.11.2
Compiling memchr v2.2.1
Compiling futures v0.1.29
Compiling serde v1.0.104
Compiling scopeguard v1.0.0
Compiling either v1.5.3
Compiling pkg-config v0.3.17
Compiling getrandom v0.1.14
Compiling pin-utils v0.1.0-alpha.4
Compiling itoa v0.4.5
Compiling void v1.0.2
Compiling proc-macro-nested v0.1.3
Compiling rustc-demangle v0.1.16
Compiling failure_derive v0.1.6
Compiling matches v0.1.8
Compiling futures-core v0.3.4
Compiling smallvec v1.2.0
Compiling nix v0.16.1
Compiling rustc-serialize v0.3.24
Compiling ppv-lite86 v0.2.6
Compiling rand_core v0.4.2
Compiling version_check v0.1.5
Compiling maybe-uninit v2.0.0
Compiling heim-common v0.0.9
Compiling futures-task v0.3.4
Compiling regex-syntax v0.6.14
Compiling fnv v1.0.6
Compiling semver v0.1.20
Compiling ryu v1.0.2
Compiling cl-sys v0.4.2
Compiling arrayref v0.3.6
Compiling rayon-core v1.7.0
Compiling arrayvec v0.5.1
Compiling version_check v0.9.1
Compiling constant_time_eq v0.1.5
Compiling percent-encoding v1.0.1
Compiling foreign-types-shared v0.1.1
Compiling httparse v1.3.4
Compiling nodrop v0.1.14
Compiling percent-encoding v2.1.0
Compiling openssl v0.10.28
Compiling byte-tools v0.3.1
Compiling serde v0.8.23
Compiling anyhow v1.0.26
Compiling unicode-width v0.1.7
Compiling remove_dir_all v0.5.2
Compiling hex v0.4.1
Compiling crc32fast v1.2.0
Compiling bit-vec v0.6.1
Compiling openssl-probe v0.1.2
Compiling native-tls v0.2.3
Compiling opaque-debug v0.2.3
Compiling try-lock v0.2.2
Compiling futures-core-preview v0.3.0-alpha.19
Compiling byteorder v0.5.3
Compiling linked-hash-map v0.5.2
Compiling lazy_static v0.2.11
Compiling ansi_term v0.11.0
Compiling futures-sink-preview v0.3.0-alpha.19
Compiling heim-host v0.0.9
Compiling encoding_rs v0.8.22
Compiling adler32 v1.0.4
Compiling platforms v0.2.1
Compiling dtoa v0.4.5
Compiling macaddr v0.1.2
Compiling futures-io-preview v0.3.0-alpha.19
Compiling yansi v0.5.0
Compiling storage-proofs v1.0.0-alpha.0 (/home/ubuntu/vmx/rust-fil-proofs/storage-proofs)
Compiling vec_map v0.8.1
Compiling rust-ini v0.13.0
Compiling nix v0.11.1
Compiling mime v0.3.16
Compiling glob v0.3.0
Compiling strsim v0.8.0
Compiling fake-simd v0.1.2
Compiling difference v2.0.0
Compiling base64 v0.11.0
Compiling bitvec v0.5.0
Compiling half v1.4.1
Compiling tee v0.1.0
Compiling encode_unicode v0.3.6
Compiling shlex v0.1.1
Compiling human-size v0.4.0
Compiling permutate v0.3.2
Compiling try_from v0.3.2
Compiling lazy_static v1.4.0
Compiling semver v0.9.0
Compiling crossbeam-utils v0.7.0
Compiling crossbeam-epoch v0.8.0
Compiling rand_chacha v0.1.1
Compiling rand_pcg v0.1.2
Compiling rand v0.6.5
Compiling num-traits v0.2.11
Compiling num-integer v0.1.42
Compiling num-rational v0.2.3
Compiling num-bigint v0.2.6
Compiling num-iter v0.1.40
Compiling indexmap v1.3.2
Compiling lock_api v0.3.3
Compiling itertools v0.8.2
Compiling unicode-bidi v0.3.4
Compiling futures-channel v0.3.4
Compiling unicode-normalization v0.1.12
Compiling rand_core v0.3.1
Compiling rand_jitter v0.1.4
Compiling c2-chacha v0.2.3
Compiling tokio-sync v0.1.8
Compiling error-chain v0.12.1
Compiling nom v4.2.3
Compiling rustc_version v0.1.7
Compiling blake2b_simd v0.5.10
Compiling blake2s_simd v0.5.10
Compiling foreign-types v0.3.2
Compiling block-padding v0.1.5
Compiling unicase v2.6.0
Compiling textwrap v0.11.0
Compiling yaml-rust v0.4.3
Compiling serde_test v0.8.23
Compiling futures-channel-preview v0.3.0-alpha.19
Compiling miniz_oxide v0.3.6
Compiling pretty_assertions v0.6.1
Compiling thread_local v1.0.1
Compiling crossbeam-utils v0.6.6
Compiling rustc_version v0.2.3
Compiling rand_hc v0.1.0
Compiling rand_isaac v0.1.1
Compiling rand_xorshift v0.1.1
Compiling idna v0.1.5
Compiling idna v0.2.0
Compiling fil-ocl-core v0.11.3
Compiling linked-hash-map v0.3.0
Compiling quote v1.0.2
Compiling memoffset v0.5.3
Compiling parking_lot_core v0.6.2
Compiling parking_lot v0.9.0
Compiling hyper v0.12.35
Compiling jobserver v0.1.21
Compiling num_cpus v1.12.0
Compiling iovec v0.1.4
Compiling rand v0.4.6
Compiling time v0.1.42
Compiling net2 v0.2.33
Compiling memmap v0.7.0
Compiling atty v0.2.14
Compiling fs2 v0.4.3
Compiling rand_os v0.1.3
Compiling positioned-io v0.2.2
Compiling dirs v1.0.5
Compiling filetime v0.2.8
Compiling cpu-time v1.0.0
Compiling xattr v0.2.2
Compiling os_pipe v0.9.1
Compiling regex-automata v0.1.8
Compiling base64 v0.10.1
Compiling want v0.2.0
Compiling generic-array v0.12.3
Compiling generic-array v0.13.2
Compiling smallvec v0.6.13
Compiling url v1.7.2
Compiling url v2.1.1
Compiling flate2 v1.0.13
Compiling crossbeam-queue v0.2.1
Compiling tokio-executor v0.1.10
Compiling crossbeam-channel v0.4.0
Compiling cc v1.0.50
Compiling threadpool v1.7.1
Compiling futures-cpupool v0.1.8
Compiling bytes v0.4.12
Compiling rand_core v0.5.1
Compiling aho-corasick v0.7.8
Compiling csv-core v0.1.6
Compiling futures-util-preview v0.3.0-alpha.19
Compiling tempdir v0.3.7
Compiling pbr v1.0.2
Compiling colored v1.9.2
Compiling clap v2.33.0
Compiling mio v0.6.21
Compiling term v0.5.2
Compiling tar v0.4.26
Compiling block-cipher-trait v0.6.2
Compiling digest v0.8.1
Compiling block-buffer v0.7.3
Compiling cookie v0.12.0
Compiling env_proxy v0.3.1
Compiling num-traits v0.1.43
Compiling num-complex v0.1.43
Compiling ordered-float v1.0.2
Compiling mime_guess v2.0.1
Compiling tokio-current-thread v0.1.7
Compiling tokio-timer v0.2.13
Compiling openssl-src v111.6.1+1.1.1d
Compiling rand_chacha v0.2.1
Compiling rand_xorshift v0.2.0
Compiling tokio-io v0.1.13
Compiling http v0.1.21
Compiling string v0.2.1
Compiling tokio-buf v0.1.1
Compiling regex v1.3.4
Compiling backtrace-sys v0.1.32
Compiling fff v0.2.1
Compiling libz-sys v1.0.25
Compiling libssh2-sys v0.2.14
Compiling raw-cpuid v7.0.3
Compiling fil-sapling-crypto v0.4.0
Compiling libgit2-sys v0.9.2
Compiling futures-executor-preview v0.3.0-alpha.19
Compiling aes-soft v0.3.3
Compiling block-modes v0.3.3
Compiling uuid v0.7.4
Compiling synstructure v0.12.3
Compiling sha2 v0.8.1 (https://github.com/dignifiedquire/hashes?branch=sha2-intrinsics#cdcbc41d)
Compiling enum_primitive v0.1.1
Compiling num-bigint v0.1.44
Compiling rand v0.7.3
Compiling openssl-sys v0.9.54
Compiling serde-hjson v0.8.2
Compiling os_type v2.2.0
Compiling bytefmt v0.1.7
Compiling h2 v0.1.26
Compiling http-body v0.1.0
Compiling futures-preview v0.3.0-alpha.19
Compiling aes v0.3.2
Compiling uom v0.26.0
Compiling serde_derive v1.0.104
Compiling proc-macro-hack v0.5.11
Compiling heim-derive v0.0.9
Compiling thiserror-impl v1.0.10
Compiling crossbeam-deque v0.7.2
Compiling tokio-reactor v0.1.12
Compiling num-rational v0.1.42
Compiling tempfile v3.1.0
Compiling fff_derive v0.2.1
Compiling crossbeam v0.7.3
Compiling tokio-threadpool v0.1.18
Compiling tokio-tcp v0.1.4
Compiling num v0.1.42
Compiling futures-macro v0.3.4
Compiling thiserror v1.0.10
Compiling qutex v0.2.3
Compiling rayon v1.3.0
Compiling tokio v0.1.22
Compiling ocl-core-vector v0.1.0
Compiling groupy v0.3.0
Compiling futures-util v0.3.4
Compiling backtrace v0.3.44
Compiling failure v0.1.6
Compiling commandspec v0.12.2
Compiling publicsuffix v1.5.4
Compiling fil-ocl v0.19.4
Compiling serde_json v1.0.47
Compiling paired v0.17.0
Compiling chrono v0.4.10
Compiling toml v0.4.10
Compiling bstr v0.2.11
Compiling serde_urlencoded v0.5.5
Compiling toml v0.5.6
Compiling merkletree v0.15.2
Compiling bincode v1.2.1
Compiling serde_cbor v0.10.2
Compiling flexi_logger v0.14.8
Compiling cookie_store v0.7.0
Compiling bellperson v0.6.0
Compiling config v0.9.3
Compiling csv v1.1.3
Compiling fil_logger v0.1.0
Compiling prettytable-rs v0.8.0
Compiling neptune v0.4.0
Compiling heim-runtime v0.0.5
Compiling heim-net v0.0.9
Compiling heim-cpu v0.0.9
Compiling heim-disk v0.0.9
Compiling heim-sensors v0.0.4
Compiling heim-memory v0.0.9
Compiling heim-virt v0.0.9
Compiling heim-process v0.0.9
Compiling heim v0.0.9
Compiling hyper-tls v0.3.2
Compiling reqwest v0.9.24
Compiling git2 v0.10.2
Compiling filecoin-proofs v1.0.0-alpha.0 (/home/ubuntu/vmx/rust-fil-proofs/filecoin-proofs)
Compiling fil-proofs-tooling v0.6.1 (/home/ubuntu/vmx/rust-fil-proofs/fil-proofs-tooling)
Finished dev [unoptimized + debuginfo] target(s) in 2m 46s
Running `target/debug/gpu-cpu-test`
2020-02-13T12:34:25.392 13322 main INFO gpu_cpu_test > Running high and low priority proofs in parallel
2020-02-13T12:34:25.393 13322 main INFO gpu_cpu_test > Force low piority proofs to CPU
2020-02-13T12:34:25.393 13322 main INFO gpu_cpu_test > Using threads
2020-02-13T12:34:50.074 13322 main INFO filecoin_proofs::api::seal > seal_pre_commit_phase1: start
2020-02-13T12:34:50.090 13322 main INFO filecoin_proofs::api::seal > building merkle tree for the original data
SEAL PHASE 1: SECTOR_SIZE 16777216, TREE SIZE 1048575, TREE LEAFS 524288, CACHED ABOVE BASE 7
2020-02-13T12:34:53.517 13322 main INFO filecoin_proofs::api::seal > verifying pieces
2020-02-13T12:34:53.517 13322 main INFO filecoin_proofs::pieces > verifying 1 pieces
2020-02-13T12:34:53.517 13322 main INFO storage_proofs::stacked::proof > replicate_phase1
2020-02-13T12:34:53.517 13322 main INFO storage_proofs::stacked::proof > generate labels
2020-02-13T12:34:53.517 13322 main INFO storage_proofs::stacked::proof > generating layer: 1
2020-02-13T12:44:33.473 13322 main INFO storage_proofs::stacked::proof > setting exp parents
2020-02-13T12:44:33.484 13322 main INFO storage_proofs::stacked::proof > storing labels on disk
2020-02-13T12:44:33.494 13322 main INFO storage_proofs::stacked::proof > generated layer 1 store with id layer-1
2020-02-13T12:44:33.494 13322 main INFO storage_proofs::stacked::proof > generating layer: 2
2020-02-13T12:54:14.959 13322 main INFO storage_proofs::stacked::proof > setting exp parents
2020-02-13T12:54:14.963 13322 main INFO storage_proofs::stacked::proof > storing labels on disk
2020-02-13T12:54:14.972 13322 main INFO storage_proofs::stacked::proof > generated layer 2 store with id layer-2
2020-02-13T12:54:14.974 13322 main INFO filecoin_proofs::api::seal > seal_pre_commit_phase2: start
SEAL PHASE 2: TREE SIZE 1048575, TREE LEAFS 524288, CACHED ABOVE BASE 7
2020-02-13T12:54:14.974 13322 main INFO storage_proofs::stacked::proof > replicate_phase2
NODES COUNT 524288, DATA LEN 16777216
2020-02-13T12:54:14.974 13322 main INFO storage_proofs::stacked::proof > Building column hashes
2020-02-13T12:54:42.308 13322 main INFO storage_proofs::stacked::proof > building tree_c
2020-02-13T12:55:10.127 13322 main INFO storage_proofs::stacked::proof > tree_c done
2020-02-13T12:55:10.127 13322 main INFO storage_proofs::stacked::proof > building tree_r_last
2020-02-13T12:55:38.719 13322 main INFO storage_proofs::stacked::proof > tree_r_last done
2020-02-13T12:55:38.730 13322 main INFO storage_proofs::porep > dropping data /tmp/.tmpMXuLqG
TREE D LEN 1048575
TREE C LEN 1048575
TREE R_LAST LEN 1048575
2020-02-13T12:55:38.737 13322 main INFO filecoin_proofs::api::seal > seal_commit_phase1:start
2020-02-13T12:55:38.737 13322 main INFO filecoin_proofs::pieces > verifying 1 pieces
Instantiating Tree D with size 1048575 and leafs 524288
Instantiating Tree C with size 1048575 and leafs 524288
Instantiating Tree R Last with size 1048575 and leafs 524288
2020-02-13T12:55:38.910 13322 main INFO filecoin_proofs::api::seal > seal_commit_phase1:end
2020-02-13T12:55:38.924 13322 main INFO filecoin_proofs::api::seal > seal_commit_phase2:start
2020-02-13T12:55:38.924 13322 main INFO filecoin_proofs::caches > trying parameters memory cache for: STACKED[16777216]
2020-02-13T12:55:38.925 13322 main INFO filecoin_proofs::caches > no params in memory cache for STACKED[16777216]
2020-02-13T12:56:00.369 13322 main INFO storage_proofs::parameter_cache > parameter set identifier for cache: layered_drgporep::PublicParams{ graph: stacked_graph::StackedGraph{expansion_degree: 8 base_graph: drgraph::BucketGraph{size: 524288; degree: 6; hasher: PoseidonHasher} }, challenges: LayerChallenges { layers: 2, max_count: 2 } }
2020-02-13T12:56:00.369 13322 main INFO storage_proofs::parameter_cache > ensuring that all ancestor directories for: "/var/tmp/filecoin-proof-parameters/v22-stacked-proof-of-replication-PoseidonHasher-Sha256Hasher-f4bdecc971c681000d2e56d2e8f40877710978727ff383550bdc6202cdcdd9cd.params" exist
2020-02-13T12:56:00.369 13322 main INFO storage_proofs::parameter_cache > checking cache_path: "/var/tmp/filecoin-proof-parameters/v22-stacked-proof-of-replication-PoseidonHasher-Sha256Hasher-f4bdecc971c681000d2e56d2e8f40877710978727ff383550bdc6202cdcdd9cd.params" for parameters
2020-02-13T12:56:03.036 13322 main INFO storage_proofs::parameter_cache > read parameters from cache "/var/tmp/filecoin-proof-parameters/v22-stacked-proof-of-replication-PoseidonHasher-Sha256Hasher-f4bdecc971c681000d2e56d2e8f40877710978727ff383550bdc6202cdcdd9cd.params"
2020-02-13T12:56:03.037 13322 main INFO filecoin_proofs::api::seal > got groth params (16777216) while sealing
2020-02-13T12:56:03.037 13322 main INFO filecoin_proofs::api::seal > snark_proof:start
2020-02-13T12:56:03.038 13322 main INFO bellperson::groth16::prover > Bellperson 0.6.0 is being used!
2020-02-13T12:56:58.311 13322 main INFO bellperson::gpu::locks > GPU is available!
2020-02-13T12:56:58.311 13322 main DEBUG bellperson::gpu::locks > Acquiring GPU lock...
2020-02-13T12:56:58.311 13322 main DEBUG bellperson::gpu::locks > GPU lock acquired!
2020-02-13T12:56:58.557 13322 main INFO bellperson::gpu::fft > FFT: 1 working device(s) selected.
2020-02-13T12:56:58.558 13322 main INFO bellperson::gpu::fft > FFT: Device 0: Tesla V100-SXM2-16GB
2020-02-13T12:56:58.558 13322 main INFO bellperson::domain > GPU FFT kernel instantiated!
2020-02-13T12:57:10.038 13322 main DEBUG bellperson::gpu::locks > GPU lock released!
2020-02-13T12:58:07.555 13322 main INFO bellperson::gpu::locks > GPU is available!
2020-02-13T12:58:07.556 13322 main DEBUG bellperson::gpu::locks > Acquiring GPU lock...
2020-02-13T12:58:07.556 13322 main DEBUG bellperson::gpu::locks > GPU lock acquired!
2020-02-13T12:58:07.699 13322 main INFO bellperson::gpu::utils > Adding "Tesla V100-SXM2-16GB" to GPU list with 5120 CUDA cores.
2020-02-13T12:58:07.700 13322 main INFO bellperson::gpu::multiexp > Multiexp: 1 working device(s) selected. (CPU utilization: 0)
2020-02-13T12:58:07.700 13322 main INFO bellperson::gpu::multiexp > Multiexp: Device 0: Tesla V100-SXM2-16GB (Chunk-size: 8810587)
2020-02-13T12:58:07.701 13322 main INFO bellperson::multiexp > GPU Multiexp kernel instantiated!
2020-02-13T13:00:11.149 13322 main DEBUG bellperson::gpu::locks > GPU lock released!
2020-02-13T13:00:11.331 13322 main INFO filecoin_proofs::api::seal > snark_proof:finish
2020-02-13T13:00:11.331 13322 main INFO filecoin_proofs::caches > trying parameters memory cache for: STACKED[16777216]-verifying-key
2020-02-13T13:00:11.331 13322 main INFO filecoin_proofs::caches > no params in memory cache for STACKED[16777216]-verifying-key
2020-02-13T13:00:11.331 13322 main INFO storage_proofs::parameter_cache > parameter set identifier for cache: layered_drgporep::PublicParams{ graph: stacked_graph::StackedGraph{expansion_degree: 8 base_graph: drgraph::BucketGraph{size: 524288; degree: 6; hasher: PoseidonHasher} }, challenges: LayerChallenges { layers: 2, max_count: 2 } }
2020-02-13T13:00:11.332 13322 main INFO storage_proofs::parameter_cache > ensuring that all ancestor directories for: "/var/tmp/filecoin-proof-parameters/v22-stacked-proof-of-replication-PoseidonHasher-Sha256Hasher-f4bdecc971c681000d2e56d2e8f40877710978727ff383550bdc6202cdcdd9cd.vk" exist
2020-02-13T13:00:11.332 13322 main INFO storage_proofs::parameter_cache > checking cache_path: "/var/tmp/filecoin-proof-parameters/v22-stacked-proof-of-replication-PoseidonHasher-Sha256Hasher-f4bdecc971c681000d2e56d2e8f40877710978727ff383550bdc6202cdcdd9cd.vk" for verifying key
2020-02-13T13:00:11.845 13322 main INFO storage_proofs::parameter_cache > read verifying key from cache "/var/tmp/filecoin-proof-parameters/v22-stacked-proof-of-replication-PoseidonHasher-Sha256Hasher-f4bdecc971c681000d2e56d2e8f40877710978727ff383550bdc6202cdcdd9cd.vk"
2020-02-13T13:00:11.845 13322 main INFO filecoin_proofs::api::seal > got verifying key (16777216) while verifying seal
2020-02-13T13:00:12.524 13322 main INFO filecoin_proofs::api::seal > seal_commit_phase2:end
2020-02-13T13:00:12.524 13322 main INFO filecoin_proofs::api::post > generate_candidates:start
POST: TREE SIZE 1048575, TREE LEAFS 524288, CACHED ABOVE BASE 7
2020-02-13T13:00:12.594 13322 main INFO filecoin_proofs::api::post > generate_candidates:finish
2020-02-13T13:00:12.595 13322 high INFO gpu_cpu_test > iter 0
2020-02-13T13:00:12.595 13322 low INFO gpu_cpu_test > iter 0
2020-02-13T13:00:12.595 13322 high INFO filecoin_proofs::api::post > generate_post:start
2020-02-13T13:00:12.595 13322 low INFO filecoin_proofs::api::post > generate_post:start
2020-02-13T13:00:12.595 13322 high INFO filecoin_proofs::caches > trying parameters memory cache for: POST[16777216]
2020-02-13T13:00:12.595 13322 low INFO filecoin_proofs::caches > trying parameters memory cache for: POST[16777216]
2020-02-13T13:00:12.595 13322 high INFO filecoin_proofs::caches > no params in memory cache for POST[16777216]
2020-02-13T13:00:12.595 13322 low INFO filecoin_proofs::caches > no params in memory cache for POST[16777216]
2020-02-13T13:00:12.595 13322 high INFO storage_proofs::parameter_cache > parameter set identifier for cache: ElectionPoSt::PublicParams{sector_size: 16777216, count: 65, nodes: 1}
2020-02-13T13:00:12.595 13322 low INFO storage_proofs::parameter_cache > parameter set identifier for cache: ElectionPoSt::PublicParams{sector_size: 16777216, count: 65, nodes: 1}
2020-02-13T13:00:12.595 13322 high INFO storage_proofs::parameter_cache > ensuring that all ancestor directories for: "/var/tmp/filecoin-proof-parameters/v22-proof-of-spacetime-election-PoseidonHasher-9b5673a5c0df861151c2b8087fe4f0d8657558d07ce768b7067dab2eea76dad4.params" exist
2020-02-13T13:00:12.595 13322 low INFO storage_proofs::parameter_cache > ensuring that all ancestor directories for: "/var/tmp/filecoin-proof-parameters/v22-proof-of-spacetime-election-PoseidonHasher-9b5673a5c0df861151c2b8087fe4f0d8657558d07ce768b7067dab2eea76dad4.params" exist
2020-02-13T13:00:12.595 13322 high INFO storage_proofs::parameter_cache > checking cache_path: "/var/tmp/filecoin-proof-parameters/v22-proof-of-spacetime-election-PoseidonHasher-9b5673a5c0df861151c2b8087fe4f0d8657558d07ce768b7067dab2eea76dad4.params" for parameters
2020-02-13T13:00:12.595 13322 low INFO storage_proofs::parameter_cache > checking cache_path: "/var/tmp/filecoin-proof-parameters/v22-proof-of-spacetime-election-PoseidonHasher-9b5673a5c0df861151c2b8087fe4f0d8657558d07ce768b7067dab2eea76dad4.params" for parameters
2020-02-13T13:00:13.689 13322 low INFO storage_proofs::parameter_cache > read parameters from cache "/var/tmp/filecoin-proof-parameters/v22-proof-of-spacetime-election-PoseidonHasher-9b5673a5c0df861151c2b8087fe4f0d8657558d07ce768b7067dab2eea76dad4.params"
POST: TREE SIZE 1048575, TREE LEAFS 524288, CACHED ABOVE BASE 7
2020-02-13T13:00:13.689 13322 low INFO storage_proofs::compound_proof > vanilla_proof:start
2020-02-13T13:00:13.690 13322 low INFO storage_proofs::proof > groth_proof_count: 1
2020-02-13T13:00:13.690 13322 low INFO storage_proofs::proof > generating 1 groth proofs.
2020-02-13T13:00:13.690 13322 low INFO storage_proofs::proof > generating groth proof 0.
2020-02-13T13:00:13.690 13322 ThreadId(6) DEBUG merkletree::merkle > leafs 524288, total size 1048575, total height 20, cache_size 262143, cached levels above base 2, partial_height 3, cached_leafs 131072, segment_width 4, segment range 438292-438296 for 438295
2020-02-13T13:00:13.690 13322 ThreadId(8) DEBUG merkletree::merkle > leafs 524288, total size 1048575, total height 20, cache_size 262143, cached levels above base 2, partial_height 3, cached_leafs 131072, segment_width 4, segment range 384176-384180 for 384179
2020-02-13T13:00:13.690 13322 ThreadId(5) DEBUG merkletree::merkle > leafs 524288, total size 1048575, total height 20, cache_size 262143, cached levels above base 2, partial_height 3, cached_leafs 131072, segment_width 4, segment range 447568-447572 for 447571
2020-02-13T13:00:13.690 13322 ThreadId(2) DEBUG merkletree::merkle > leafs 524288, total size 1048575, total height 20, cache_size 262143, cached levels above base 2, partial_height 3, cached_leafs 131072, segment_width 4, segment range 467028-467032 for 467029
2020-02-13T13:00:13.690 13322 ThreadId(3) DEBUG merkletree::merkle > leafs 524288, total size 1048575, total height 20, cache_size 262143, cached levels above base 2, partial_height 3, cached_leafs 131072, segment_width 4, segment range 471900-471904 for 471903
2020-02-13T13:00:13.690 13322 ThreadId(7) DEBUG merkletree::merkle > leafs 524288, total size 1048575, total height 20, cache_size 262143, cached levels above base 2, partial_height 3, cached_leafs 131072, segment_width 4, segment range 199948-199952 for 199951
2020-02-13T13:00:13.690 13322 ThreadId(4) DEBUG merkletree::merkle > leafs 524288, total size 1048575, total height 20, cache_size 262143, cached levels above base 2, partial_height 3, cached_leafs 131072, segment_width 4, segment range 125764-125768 for 125767
2020-02-13T13:00:13.690 13322 ThreadId(9) DEBUG merkletree::merkle > leafs 524288, total size 1048575, total height 20, cache_size 262143, cached levels above base 2, partial_height 3, cached_leafs 131072, segment_width 4, segment range 231952-231956 for 231955
2020-02-13T13:00:13.693 13322 low INFO storage_proofs::proof > groth_proof_time: 3.51002ms
2020-02-13T13:00:13.693 13322 low INFO storage_proofs::proof > total_groth_proof_time: 3.729527ms
thread 'low' panicked at 'failed to generate PoSt: out of bounds
Stack backtrace:
0: anyhow::private::new_adhoc
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/anyhow-1.0.26/src/backtrace.rs:10
1: <merkletree::store::level_cache::LevelCacheStore<E,R> as merkletree::store::Store<E>>::read_at
at ./<::anyhow::macros::anyhow macros>:1
2: merkletree::merkle::MerkleTree<T,A,K>::read_at
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/merkletree-0.15.2/src/merkle.rs:496
3: merkletree::merkle::MerkleTree<T,A,K>::gen_proof_with_partial_tree
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/merkletree-0.15.2/src/merkle.rs:391
4: merkletree::merkle::MerkleTree<T,A,K>::gen_proof_and_partial_tree
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/merkletree-0.15.2/src/merkle.rs:314
5: <storage_proofs::election_post::ElectionPoSt<H> as storage_proofs::proof::ProofScheme>::prove::{{closure}}::{{closure}}::{{closure}}
at ./storage-proofs/src/election_post.rs:347
6: core::ops::function::impls::<impl core::ops::function::FnMut<A> for &F>::call_mut
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libcore/ops/function.rs:252
7: core::iter::adapters::map_try_fold::{{closure}}
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libcore/iter/adapters/mod.rs:779
8: core::iter::traits::iterator::Iterator::try_fold
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libcore/iter/traits/iterator.rs:1776
9: <core::iter::adapters::Map<I,F> as core::iter::traits::iterator::Iterator>::try_fold
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libcore/iter/adapters/mod.rs:805
10: <core::iter::adapters::Map<I,F> as core::iter::traits::iterator::Iterator>::try_fold
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libcore/iter/adapters/mod.rs:805
11: <core::iter::adapters::TakeWhile<I,P> as core::iter::traits::iterator::Iterator>::try_fold
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libcore/iter/adapters/mod.rs:1750
12: <core::iter::adapters::Map<I,F> as core::iter::traits::iterator::Iterator>::try_fold
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libcore/iter/adapters/mod.rs:805
13: <core::iter::adapters::TakeWhile<I,P> as core::iter::traits::iterator::Iterator>::try_fold
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libcore/iter/adapters/mod.rs:1750
14: core::iter::traits::iterator::Iterator::fold
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libcore/iter/traits/iterator.rs:1903
15: <rayon::iter::fold::FoldFolder<C,ID,F> as rayon::iter::plumbing::Folder<T>>::consume_iter
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/iter/fold.rs:158
16: <rayon::iter::while_some::WhileSomeFolder<C> as rayon::iter::plumbing::Folder<core::option::Option<T>>>::consume_iter
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/iter/while_some.rs:139
17: <rayon::iter::map::MapFolder<C,F> as rayon::iter::plumbing::Folder<T>>::consume_iter
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/iter/map.rs:248
18: <rayon::iter::map::MapFolder<C,F> as rayon::iter::plumbing::Folder<T>>::consume_iter
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/iter/map.rs:248
19: rayon::iter::plumbing::Producer::fold_with
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/iter/plumbing/mod.rs:110
20: rayon::iter::plumbing::bridge_producer_consumer::helper
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/iter/plumbing/mod.rs:438
21: rayon::iter::plumbing::bridge_producer_consumer
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/iter/plumbing/mod.rs:397
22: <rayon::iter::plumbing::bridge::Callback<C> as rayon::iter::plumbing::ProducerCallback<I>>::callback
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/iter/plumbing/mod.rs:373
23: <rayon::range::Iter<usize> as rayon::iter::IndexedParallelIterator>::with_producer
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/range.rs:111
24: rayon::iter::plumbing::bridge
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/iter/plumbing/mod.rs:357
25: <rayon::range::Iter<usize> as rayon::iter::ParallelIterator>::drive_unindexed
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/range.rs:87
26: <rayon::iter::map::Map<I,F> as rayon::iter::ParallelIterator>::drive_unindexed
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/iter/map.rs:49
27: <rayon::iter::flat_map::FlatMapFolder<C,F,<C as rayon::iter::plumbing::Consumer<<U as rayon::iter::IntoParallelIterator>::Item>>::Result> as rayon::iter::plumbing::Folder<T>>::consume
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/iter/flat_map.rs:129
28: rayon::iter::plumbing::Folder::consume_iter
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/iter/plumbing/mod.rs:179
29: rayon::iter::plumbing::Producer::fold_with
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/iter/plumbing/mod.rs:110
30: rayon::iter::plumbing::bridge_producer_consumer::helper
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/iter/plumbing/mod.rs:438
31: rayon::iter::plumbing::bridge_producer_consumer::helper::{{closure}}
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/iter/plumbing/mod.rs:418
32: rayon_core::join::join_context::call_a::{{closure}}
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/join/mod.rs:125
33: <std::panic::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panic.rs:318
34: std::panicking::try::do_call
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panicking.rs:305
35: __rust_maybe_catch_panic
at src/libpanic_unwind/lib.rs:86
36: std::panicking::try
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panicking.rs:281
37: std::panic::catch_unwind
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panic.rs:394
38: rayon_core::unwind::halt_unwinding
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/unwind.rs:17
39: rayon_core::join::join_context::{{closure}}
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/join/mod.rs:146
40: rayon_core::registry::in_worker
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/registry.rs:799
41: rayon_core::join::join_context
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/join/mod.rs:133
42: rayon::iter::plumbing::bridge_producer_consumer::helper
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/iter/plumbing/mod.rs:416
43: rayon::iter::plumbing::bridge_producer_consumer::helper::{{closure}}
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/iter/plumbing/mod.rs:418
44: rayon_core::join::join_context::call_a::{{closure}}
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/join/mod.rs:125
45: <std::panic::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panic.rs:318
46: std::panicking::try::do_call
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panicking.rs:305
47: __rust_maybe_catch_panic
at src/libpanic_unwind/lib.rs:86
48: std::panicking::try
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panicking.rs:281
49: std::panic::catch_unwind
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panic.rs:394
50: rayon_core::unwind::halt_unwinding
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/unwind.rs:17
51: rayon_core::join::join_context::{{closure}}
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/join/mod.rs:146
52: rayon_core::registry::in_worker
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/registry.rs:799
53: rayon_core::join::join_context
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/join/mod.rs:133
54: rayon::iter::plumbing::bridge_producer_consumer::helper
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/iter/plumbing/mod.rs:416
55: rayon::iter::plumbing::bridge_producer_consumer::helper::{{closure}}
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/iter/plumbing/mod.rs:427
56: rayon_core::join::join_context::call_b::{{closure}}
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/join/mod.rs:130
57: <rayon_core::job::StackJob<L,F,R> as rayon_core::job::Job>::execute::call::{{closure}}
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/job.rs:113
58: <std::panic::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panic.rs:318
59: std::panicking::try::do_call
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panicking.rs:305
60: __rust_maybe_catch_panic
at src/libpanic_unwind/lib.rs:86
61: std::panicking::try
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panicking.rs:281
62: std::panic::catch_unwind
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panic.rs:394
63: rayon_core::unwind::halt_unwinding
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/unwind.rs:17
64: <rayon_core::job::StackJob<L,F,R> as rayon_core::job::Job>::execute
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/job.rs:119
65: rayon_core::job::JobRef::execute
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/job.rs:59
66: rayon_core::registry::WorkerThread::execute
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/registry.rs:681
67: rayon_core::registry::WorkerThread::wait_until_cold
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/registry.rs:665
68: rayon_core::registry::WorkerThread::wait_until
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/registry.rs:639
69: rayon_core::registry::main_loop
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/registry.rs:759
70: rayon_core::registry::ThreadBuilder::run
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/registry.rs:56
71: <rayon_core::registry::DefaultSpawn as rayon_core::registry::ThreadSpawn>::spawn::{{closure}}
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/registry.rs:101
72: std::sys_common::backtrace::__rust_begin_short_backtrace
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/sys_common/backtrace.rs:129
73: std::thread::Builder::spawn_unchecked::{{closure}}::{{closure}}
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/thread/mod.rs:475
74: <std::panic::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panic.rs:318
75: std::panicking::try::do_call
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panicking.rs:305
76: __rust_maybe_catch_panic
at src/libpanic_unwind/lib.rs:86
77: std::panicking::try
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panicking.rs:281
78: std::panic::catch_unwind
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panic.rs:394
79: std::thread::Builder::spawn_unchecked::{{closure}}
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/thread/mod.rs:474
80: core::ops::function::FnOnce::call_once{{vtable.shim}}
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libcore/ops/function.rs:232
81: <alloc::boxed::Box<F> as core::ops::function::FnOnce<A>>::call_once
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/liballoc/boxed.rs:1015
82: <alloc::boxed::Box<F> as core::ops::function::FnOnce<A>>::call_once
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/liballoc/boxed.rs:1015
std::sys_common::thread::start_thread
at src/libstd/sys_common/thread.rs:13
std::sys::unix::thread::Thread::new::thread_start
at src/libstd/sys/unix/thread.rs:80
83: start_thread
84: __clone', fil-proofs-tooling/src/bin/gpu-cpu-test/election_post.rs:181:5
stack backtrace:
0: backtrace::backtrace::libunwind::trace
at /cargo/registry/src/github.com-1ecc6299db9ec823/backtrace-0.3.40/src/backtrace/libunwind.rs:88
1: backtrace::backtrace::trace_unsynchronized
at /cargo/registry/src/github.com-1ecc6299db9ec823/backtrace-0.3.40/src/backtrace/mod.rs:66
2: std::sys_common::backtrace::_print_fmt
at src/libstd/sys_common/backtrace.rs:77
3: <std::sys_common::backtrace::_print::DisplayBacktrace as core::fmt::Display>::fmt
at src/libstd/sys_common/backtrace.rs:59
4: core::fmt::write
at src/libcore/fmt/mod.rs:1052
5: std::io::Write::write_fmt
at src/libstd/io/mod.rs:1426
6: std::sys_common::backtrace::_print
at src/libstd/sys_common/backtrace.rs:62
7: std::sys_common::backtrace::print
at src/libstd/sys_common/backtrace.rs:49
8: std::panicking::default_hook::{{closure}}
at src/libstd/panicking.rs:204
9: std::panicking::default_hook
at src/libstd/panicking.rs:224
10: std::panicking::rust_panic_with_hook
at src/libstd/panicking.rs:472
11: rust_begin_unwind
at src/libstd/panicking.rs:380
12: core::panicking::panic_fmt
at src/libcore/panicking.rs:85
13: core::option::expect_none_failed
at src/libcore/option.rs:1199
14: core::result::Result<T,E>::expect
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libcore/result.rs:991
15: gpu_cpu_test::election_post::do_generate_post
at fil-proofs-tooling/src/bin/gpu-cpu-test/election_post.rs:181
16: gpu_cpu_test::thread_fun
at fil-proofs-tooling/src/bin/gpu-cpu-test/main.rs:69
17: gpu_cpu_test::spawn_thread::{{closure}}
at fil-proofs-tooling/src/bin/gpu-cpu-test/main.rs:99
note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.
2020-02-13T13:00:14.786 13322 high INFO storage_proofs::parameter_cache > read parameters from cache "/var/tmp/filecoin-proof-parameters/v22-proof-of-spacetime-election-PoseidonHasher-9b5673a5c0df861151c2b8087fe4f0d8657558d07ce768b7067dab2eea76dad4.params"
POST: TREE SIZE 1048575, TREE LEAFS 524288, CACHED ABOVE BASE 7
2020-02-13T13:00:14.787 13322 high INFO storage_proofs::compound_proof > vanilla_proof:start
2020-02-13T13:00:14.787 13322 high INFO storage_proofs::proof > groth_proof_count: 1
2020-02-13T13:00:14.787 13322 high INFO storage_proofs::proof > generating 1 groth proofs.
2020-02-13T13:00:14.787 13322 high INFO storage_proofs::proof > generating groth proof 0.
2020-02-13T13:00:14.787 13322 ThreadId(9) DEBUG merkletree::merkle > leafs 524288, total size 1048575, total height 20, cache_size 262143, cached levels above base 2, partial_height 3, cached_leafs 131072, segment_width 4, segment range 438292-438296 for 438295
2020-02-13T13:00:14.787 13322 ThreadId(8) DEBUG merkletree::merkle > leafs 524288, total size 1048575, total height 20, cache_size 262143, cached levels above base 2, partial_height 3, cached_leafs 131072, segment_width 4, segment range 383848-383852 for 383848
2020-02-13T13:00:14.787 13322 ThreadId(4) DEBUG merkletree::merkle > leafs 524288, total size 1048575, total height 20, cache_size 262143, cached levels above base 2, partial_height 3, cached_leafs 131072, segment_width 4, segment range 380884-380888 for 380886
2020-02-13T13:00:14.787 13322 ThreadId(3) DEBUG merkletree::merkle > leafs 524288, total size 1048575, total height 20, cache_size 262143, cached levels above base 2, partial_height 3, cached_leafs 131072, segment_width 4, segment range 471900-471904 for 471903
2020-02-13T13:00:14.787 13322 ThreadId(7) DEBUG merkletree::merkle > leafs 524288, total size 1048575, total height 20, cache_size 262143, cached levels above base 2, partial_height 3, cached_leafs 131072, segment_width 4, segment range 467028-467032 for 467029
2020-02-13T13:00:14.787 13322 ThreadId(5) DEBUG merkletree::merkle > leafs 524288, total size 1048575, total height 20, cache_size 262143, cached levels above base 2, partial_height 3, cached_leafs 131072, segment_width 4, segment range 447568-447572 for 447571
2020-02-13T13:00:14.787 13322 ThreadId(6) DEBUG merkletree::merkle > leafs 524288, total size 1048575, total height 20, cache_size 262143, cached levels above base 2, partial_height 3, cached_leafs 131072, segment_width 4, segment range 231952-231956 for 231955
2020-02-13T13:00:14.787 13322 ThreadId(2) DEBUG merkletree::merkle > leafs 524288, total size 1048575, total height 20, cache_size 262143, cached levels above base 2, partial_height 3, cached_leafs 131072, segment_width 4, segment range 199948-199952 for 199951
2020-02-13T13:00:14.790 13322 high INFO storage_proofs::proof > groth_proof_time: 3.332235ms
2020-02-13T13:00:14.790 13322 high INFO storage_proofs::proof > total_groth_proof_time: 3.556154ms
thread 'high' panicked at 'failed to generate PoSt with high priority: out of bounds
Stack backtrace:
0: anyhow::private::new_adhoc
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/anyhow-1.0.26/src/backtrace.rs:10
1: <merkletree::store::level_cache::LevelCacheStore<E,R> as merkletree::store::Store<E>>::read_at
at ./<::anyhow::macros::anyhow macros>:1
2: merkletree::merkle::MerkleTree<T,A,K>::read_at
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/merkletree-0.15.2/src/merkle.rs:496
3: merkletree::merkle::MerkleTree<T,A,K>::gen_proof_with_partial_tree
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/merkletree-0.15.2/src/merkle.rs:406
4: merkletree::merkle::MerkleTree<T,A,K>::gen_proof_and_partial_tree
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/merkletree-0.15.2/src/merkle.rs:314
5: <storage_proofs::election_post::ElectionPoSt<H> as storage_proofs::proof::ProofScheme>::prove::{{closure}}::{{closure}}::{{closure}}
at ./storage-proofs/src/election_post.rs:347
6: core::ops::function::impls::<impl core::ops::function::FnMut<A> for &F>::call_mut
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libcore/ops/function.rs:252
7: core::iter::adapters::map_try_fold::{{closure}}
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libcore/iter/adapters/mod.rs:779
8: core::iter::traits::iterator::Iterator::try_fold
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libcore/iter/traits/iterator.rs:1776
9: <core::iter::adapters::Map<I,F> as core::iter::traits::iterator::Iterator>::try_fold
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libcore/iter/adapters/mod.rs:805
10: <core::iter::adapters::Map<I,F> as core::iter::traits::iterator::Iterator>::try_fold
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libcore/iter/adapters/mod.rs:805
11: <core::iter::adapters::TakeWhile<I,P> as core::iter::traits::iterator::Iterator>::try_fold
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libcore/iter/adapters/mod.rs:1750
12: <core::iter::adapters::Map<I,F> as core::iter::traits::iterator::Iterator>::try_fold
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libcore/iter/adapters/mod.rs:805
13: <core::iter::adapters::TakeWhile<I,P> as core::iter::traits::iterator::Iterator>::try_fold
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libcore/iter/adapters/mod.rs:1750
14: core::iter::traits::iterator::Iterator::fold
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libcore/iter/traits/iterator.rs:1903
15: <rayon::iter::fold::FoldFolder<C,ID,F> as rayon::iter::plumbing::Folder<T>>::consume_iter
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/iter/fold.rs:158
16: <rayon::iter::while_some::WhileSomeFolder<C> as rayon::iter::plumbing::Folder<core::option::Option<T>>>::consume_iter
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/iter/while_some.rs:139
17: <rayon::iter::map::MapFolder<C,F> as rayon::iter::plumbing::Folder<T>>::consume_iter
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/iter/map.rs:248
18: <rayon::iter::map::MapFolder<C,F> as rayon::iter::plumbing::Folder<T>>::consume_iter
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/iter/map.rs:248
19: rayon::iter::plumbing::Producer::fold_with
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/iter/plumbing/mod.rs:110
20: rayon::iter::plumbing::bridge_producer_consumer::helper
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/iter/plumbing/mod.rs:438
21: rayon::iter::plumbing::bridge_producer_consumer
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/iter/plumbing/mod.rs:397
22: <rayon::iter::plumbing::bridge::Callback<C> as rayon::iter::plumbing::ProducerCallback<I>>::callback
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/iter/plumbing/mod.rs:373
23: <rayon::range::Iter<usize> as rayon::iter::IndexedParallelIterator>::with_producer
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/range.rs:111
24: rayon::iter::plumbing::bridge
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/iter/plumbing/mod.rs:357
25: <rayon::range::Iter<usize> as rayon::iter::ParallelIterator>::drive_unindexed
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/range.rs:87
26: <rayon::iter::map::Map<I,F> as rayon::iter::ParallelIterator>::drive_unindexed
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/iter/map.rs:49
27: <rayon::iter::flat_map::FlatMapFolder<C,F,<C as rayon::iter::plumbing::Consumer<<U as rayon::iter::IntoParallelIterator>::Item>>::Result> as rayon::iter::plumbing::Folder<T>>::consume
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/iter/flat_map.rs:129
28: rayon::iter::plumbing::Folder::consume_iter
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/iter/plumbing/mod.rs:179
29: rayon::iter::plumbing::Producer::fold_with
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/iter/plumbing/mod.rs:110
30: rayon::iter::plumbing::bridge_producer_consumer::helper
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/iter/plumbing/mod.rs:438
31: rayon::iter::plumbing::bridge_producer_consumer::helper::{{closure}}
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/iter/plumbing/mod.rs:418
32: rayon_core::join::join_context::call_a::{{closure}}
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/join/mod.rs:125
33: <std::panic::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panic.rs:318
34: std::panicking::try::do_call
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panicking.rs:305
35: __rust_maybe_catch_panic
at src/libpanic_unwind/lib.rs:86
36: std::panicking::try
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panicking.rs:281
37: std::panic::catch_unwind
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panic.rs:394
38: rayon_core::unwind::halt_unwinding
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/unwind.rs:17
39: rayon_core::join::join_context::{{closure}}
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/join/mod.rs:146
40: rayon_core::registry::in_worker
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/registry.rs:799
41: rayon_core::join::join_context
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/join/mod.rs:133
42: rayon::iter::plumbing::bridge_producer_consumer::helper
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/iter/plumbing/mod.rs:416
43: rayon::iter::plumbing::bridge_producer_consumer::helper::{{closure}}
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/iter/plumbing/mod.rs:418
44: rayon_core::join::join_context::call_a::{{closure}}
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/join/mod.rs:125
45: <std::panic::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panic.rs:318
46: std::panicking::try::do_call
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panicking.rs:305
47: __rust_maybe_catch_panic
at src/libpanic_unwind/lib.rs:86
48: std::panicking::try
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panicking.rs:281
49: std::panic::catch_unwind
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panic.rs:394
50: rayon_core::unwind::halt_unwinding
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/unwind.rs:17
51: rayon_core::join::join_context::{{closure}}
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/join/mod.rs:146
52: rayon_core::registry::in_worker
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/registry.rs:799
53: rayon_core::join::join_context
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/join/mod.rs:133
54: rayon::iter::plumbing::bridge_producer_consumer::helper
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/iter/plumbing/mod.rs:416
55: rayon::iter::plumbing::bridge_producer_consumer::helper::{{closure}}
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/iter/plumbing/mod.rs:418
56: rayon_core::join::join_context::call_a::{{closure}}
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/join/mod.rs:125
57: <std::panic::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panic.rs:318
58: std::panicking::try::do_call
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panicking.rs:305
59: __rust_maybe_catch_panic
at src/libpanic_unwind/lib.rs:86
60: std::panicking::try
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panicking.rs:281
61: std::panic::catch_unwind
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panic.rs:394
62: rayon_core::unwind::halt_unwinding
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/unwind.rs:17
63: rayon_core::join::join_context::{{closure}}
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/join/mod.rs:146
64: rayon_core::registry::in_worker
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/registry.rs:799
65: rayon_core::join::join_context
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/join/mod.rs:133
66: rayon::iter::plumbing::bridge_producer_consumer::helper
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/iter/plumbing/mod.rs:416
67: rayon::iter::plumbing::bridge_producer_consumer::helper::{{closure}}
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/iter/plumbing/mod.rs:418
68: rayon_core::join::join_context::call_a::{{closure}}
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/join/mod.rs:125
69: <std::panic::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panic.rs:318
70: std::panicking::try::do_call
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panicking.rs:305
71: __rust_maybe_catch_panic
at src/libpanic_unwind/lib.rs:86
72: std::panicking::try
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panicking.rs:281
73: std::panic::catch_unwind
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panic.rs:394
74: rayon_core::unwind::halt_unwinding
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/unwind.rs:17
75: rayon_core::join::join_context::{{closure}}
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/join/mod.rs:146
76: rayon_core::registry::in_worker
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/registry.rs:799
77: rayon_core::join::join_context
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/join/mod.rs:133
78: rayon::iter::plumbing::bridge_producer_consumer::helper
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/iter/plumbing/mod.rs:416
79: rayon::iter::plumbing::bridge_producer_consumer::helper::{{closure}}
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/iter/plumbing/mod.rs:418
80: rayon_core::join::join_context::call_a::{{closure}}
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/join/mod.rs:125
81: <std::panic::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panic.rs:318
82: std::panicking::try::do_call
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panicking.rs:305
83: __rust_maybe_catch_panic
at src/libpanic_unwind/lib.rs:86
84: std::panicking::try
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panicking.rs:281
85: std::panic::catch_unwind
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panic.rs:394
86: rayon_core::unwind::halt_unwinding
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/unwind.rs:17
87: rayon_core::join::join_context::{{closure}}
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/join/mod.rs:146
88: rayon_core::registry::in_worker
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/registry.rs:799
89: rayon_core::join::join_context
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/join/mod.rs:133
90: rayon::iter::plumbing::bridge_producer_consumer::helper
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/iter/plumbing/mod.rs:416
91: rayon::iter::plumbing::bridge_producer_consumer::helper::{{closure}}
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.3.0/src/iter/plumbing/mod.rs:418
92: rayon_core::join::join_context::call_a::{{closure}}
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/join/mod.rs:125
93: <std::panic::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panic.rs:318
94: std::panicking::try::do_call
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panicking.rs:305
95: __rust_maybe_catch_panic
at src/libpanic_unwind/lib.rs:86
96: std::panicking::try
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panicking.rs:281
97: std::panic::catch_unwind
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panic.rs:394
98: rayon_core::unwind::halt_unwinding
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/unwind.rs:17
99: rayon_core::join::join_context::{{closure}}
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/join/mod.rs:146
100: rayon_core::registry::Registry::in_worker_cold::{{closure}}::{{closure}}
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/registry.rs:447
101: <rayon_core::job::StackJob<L,F,R> as rayon_core::job::Job>::execute::call::{{closure}}
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/job.rs:113
102: <std::panic::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panic.rs:318
103: std::panicking::try::do_call
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panicking.rs:305
104: __rust_maybe_catch_panic
at src/libpanic_unwind/lib.rs:86
105: std::panicking::try
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panicking.rs:281
106: std::panic::catch_unwind
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panic.rs:394
107: rayon_core::unwind::halt_unwinding
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/unwind.rs:17
108: <rayon_core::job::StackJob<L,F,R> as rayon_core::job::Job>::execute
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/job.rs:119
109: rayon_core::job::JobRef::execute
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/job.rs:59
110: rayon_core::registry::WorkerThread::execute
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/registry.rs:681
111: rayon_core::registry::WorkerThread::wait_until_cold
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/registry.rs:665
112: rayon_core::registry::WorkerThread::wait_until
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/registry.rs:639
113: rayon_core::registry::main_loop
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/registry.rs:759
114: rayon_core::registry::ThreadBuilder::run
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/registry.rs:56
115: <rayon_core::registry::DefaultSpawn as rayon_core::registry::ThreadSpawn>::spawn::{{closure}}
at /home/ubuntu/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.7.0/src/registry.rs:101
116: std::sys_common::backtrace::__rust_begin_short_backtrace
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/sys_common/backtrace.rs:129
117: std::thread::Builder::spawn_unchecked::{{closure}}::{{closure}}
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/thread/mod.rs:475
118: <std::panic::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panic.rs:318
119: std::panicking::try::do_call
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panicking.rs:305
120: __rust_maybe_catch_panic
at src/libpanic_unwind/lib.rs:86
121: std::panicking::try
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panicking.rs:281
122: std::panic::catch_unwind
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/panic.rs:394
123: std::thread::Builder::spawn_unchecked::{{closure}}
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libstd/thread/mod.rs:474
124: core::ops::function::FnOnce::call_once{{vtable.shim}}
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libcore/ops/function.rs:232
125: <alloc::boxed::Box<F> as core::ops::function::FnOnce<A>>::call_once
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/liballoc/boxed.rs:1015
126: <alloc::boxed::Box<F> as core::ops::function::FnOnce<A>>::call_once
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/liballoc/boxed.rs:1015
std::sys_common::thread::start_thread
at src/libstd/sys_common/thread.rs:13
std::sys::unix::thread::Thread::new::thread_start
at src/libstd/sys/unix/thread.rs:80
127: start_thread
128: __clone', fil-proofs-tooling/src/bin/gpu-cpu-test/election_post.rs:207:5
stack backtrace:
0: backtrace::backtrace::libunwind::trace
at /cargo/registry/src/github.com-1ecc6299db9ec823/backtrace-0.3.40/src/backtrace/libunwind.rs:88
1: backtrace::backtrace::trace_unsynchronized
at /cargo/registry/src/github.com-1ecc6299db9ec823/backtrace-0.3.40/src/backtrace/mod.rs:66
2: std::sys_common::backtrace::_print_fmt
at src/libstd/sys_common/backtrace.rs:77
3: <std::sys_common::backtrace::_print::DisplayBacktrace as core::fmt::Display>::fmt
at src/libstd/sys_common/backtrace.rs:59
4: core::fmt::write
at src/libcore/fmt/mod.rs:1052
5: std::io::Write::write_fmt
at src/libstd/io/mod.rs:1426
6: std::sys_common::backtrace::_print
at src/libstd/sys_common/backtrace.rs:62
7: std::sys_common::backtrace::print
at src/libstd/sys_common/backtrace.rs:49
8: std::panicking::default_hook::{{closure}}
at src/libstd/panicking.rs:204
9: std::panicking::default_hook
at src/libstd/panicking.rs:224
10: std::panicking::rust_panic_with_hook
at src/libstd/panicking.rs:472
11: rust_begin_unwind
at src/libstd/panicking.rs:380
12: core::panicking::panic_fmt
at src/libcore/panicking.rs:85
13: core::option::expect_none_failed
at src/libcore/option.rs:1199
14: core::result::Result<T,E>::expect
at /rustc/6d3f4e0aab3e36ceb8b83d1e9467514685f6b751/src/libcore/result.rs:991
15: gpu_cpu_test::election_post::do_generate_post_in_priority
at fil-proofs-tooling/src/bin/gpu-cpu-test/election_post.rs:207
16: gpu_cpu_test::thread_fun
at fil-proofs-tooling/src/bin/gpu-cpu-test/main.rs:66
17: gpu_cpu_test::spawn_thread::{{closure}}
at fil-proofs-tooling/src/bin/gpu-cpu-test/main.rs:99
note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment