Skip to content

Instantly share code, notes, and snippets.

@vtjeng

vtjeng/MIPVerify_with_gurobi

Last active November 25, 2019 06:31
Show Gist options
  • Save vtjeng/bcb61a88fdb41137dbc2e01f0be12dfb to your computer and use it in GitHub Desktop.
Save vtjeng/bcb61a88fdb41137dbc2e01f0be12dfb to your computer and use it in GitHub Desktop.
Download ZIP
Test runtime for MIPVerify package with Gurobi solver
Raw
MIPVerify_with_gurobi
────────────────────────────────────────────────────────────────────────────────────
Time Allocations
────────────────────── ───────────────────────
Tot / % measured: 273s / 98.7% 22.0GiB / 98.9%
Section ncalls time %tot avg alloc %tot avg
────────────────────────────────────────────────────────────────────────────────────
integration/ 1 130s 48.1% 130s 9.01GiB 41.4% 9.01GiB
sequential/ 1 130s 48.0% 130s 9.01GiB 41.4% 9.01GiB
trained_weights/ 1 84.6s 31.4% 84.6s 5.41GiB 24.9% 5.41GiB
generated_weights/ 1 44.8s 16.6% 44.8s 3.59GiB 16.5% 3.59GiB
mfc+mfc+softmax.jl 1 24.9s 9.22% 24.9s 2.75GiB 12.6% 2.75GiB
conv+fc+softmax.jl 1 19.6s 7.28% 19.6s 865MiB 3.88% 865MiB
UnrestrictedPert... 1 12.6s 4.67% 12.6s 160MiB 0.72% 160MiB
Minimizing lIn... 1 4.47s 1.66% 4.47s 15.4MiB 0.07% 15.4MiB
With multiple ... 1 3.95s 1.47% 3.95s 46.2MiB 0.21% 46.2MiB
Minimizing l1 ... 1 2.90s 1.08% 2.90s 57.9MiB 0.26% 57.9MiB
Increasing mar... 1 1.25s 0.47% 1.25s 40.2MiB 0.18% 40.2MiB
BlurringPerturba... 1 5.77s 2.14% 5.77s 664MiB 2.98% 664MiB
LInfNormBoundedP... 1 1.17s 0.43% 1.17s 34.0MiB 0.15% 34.0MiB
utils/ 1 92.5s 34.3% 92.5s 6.08GiB 27.9% 6.08GiB
import_example_nets.jl 1 87.8s 32.5% 87.8s 3.08GiB 14.2% 3.08GiB
get_example_network_... 1 87.8s 32.5% 87.8s 3.08GiB 14.2% 3.08GiB
MNIST.WK17a_linf0.... 1 81.2s 30.1% 81.2s 1.55GiB 7.11% 1.55GiB
MNIST.RSL18a_linf0... 1 5.46s 2.02% 5.46s 830MiB 3.73% 830MiB
MNIST.n1 1 1.15s 0.42% 1.15s 740MiB 3.32% 740MiB
import_datasets.jl 1 4.21s 1.56% 4.21s 3.00GiB 13.8% 3.00GiB
net_components/ 1 26.4s 9.79% 26.4s 1.63GiB 7.50% 1.63GiB
core_ops.jl 1 9.34s 3.47% 9.34s 0.94GiB 4.32% 0.94GiB
layers/ 1 6.82s 2.53% 6.82s 547MiB 2.46% 547MiB
nets/ 1 128ms 0.05% 128ms 6.96MiB 0.03% 6.96MiB
batch_processing_helpers/ 1 21.1s 7.82% 21.1s 5.03GiB 23.1% 5.03GiB
integration.jl 1 17.3s 6.40% 17.3s 4.30GiB 19.8% 4.30GiB
unit.jl 1 3.34s 1.24% 3.34s 748MiB 3.36% 748MiB
models.jl 1 11.2ms 0.00% 11.2ms 169KiB 0.00% 169KiB
────────────────────────────────────────────────────────────────────────────────────
Test Summary: | Pass Error Total
MIPVerify | 209 1 210
net_components/ | 179 1 180
core_ops.jl | 126 1 127
is_constant | 4 4
getmodel | 2 2
get_tightening_algorithm | 11 11
maximum(xs) | 12 12
maximum(xs, ls, us) | 4 4
maximum_ge | 1 1
multiple variables to maximize over, all constant | 1 1
@vtjeng
Copy link
Author

vtjeng commented Nov 25, 2019 

  MethodError: Cannot `convert` an object of type JuMP.GenericAffExpr{Float64,Variable} to an object of type Variable
  Closest candidates are:
    convert(::Type{S}, !Matched::T<:(Union{CategoricalString{R}, CategoricalValue{T,R} where T} where R)) where {S, T<:(Union{CategoricalString{R}, CategoricalValue{T,R} whe
re T} where R)} at /home/vtjeng/.julia/packages/CategoricalArrays/xjesC/src/value.jl:91
    convert(::Type{T}, !Matched::T) where T at essentials.jl:154
    Variable(::Any, !Matched::Any) at /home/vtjeng/.julia/packages/JuMP/I7whV/src/JuMP.jl:371
  Stacktrace:
   [1] maximum_ge(::Array{JuMP.GenericAffExpr{Float64,Variable},1}) at /home/vtjeng/.julia/packages/MIPVerify/2slfm/src/net_components/core_ops.jl:386
   [2] macro expansion at /home/vtjeng/.julia/environments/v1.0-MIPVerify/dev/MIPVerify/test/net_components/core_ops.jl:201 [inlined]
   [3] macro expansion at /buildworker/worker/package_linux64/build/usr/share/julia/stdlib/v1.0/Test/src/Test.jl:1083 [inlined]
   [4] macro expansion at /home/vtjeng/.julia/environments/v1.0-MIPVerify/dev/MIPVerify/test/net_components/core_ops.jl:198 [inlined]
   [5] macro expansion at /buildworker/worker/package_linux64/build/usr/share/julia/stdlib/v1.0/Test/src/Test.jl:1083 [inlined]
   [6] macro expansion at /home/vtjeng/.julia/environments/v1.0-MIPVerify/dev/MIPVerify/test/net_components/core_ops.jl:197 [inlined]
   [7] macro expansion at /home/vtjeng/.julia/environments/v1.0-MIPVerify/dev/MIPVerify/test/runtests.jl:15 [inlined]
   [8] macro expansion at /buildworker/worker/package_linux64/build/usr/share/julia/stdlib/v1.0/Test/src/Test.jl:1083 [inlined]
   [9] macro expansion at /home/vtjeng/.julia/environments/v1.0-MIPVerify/dev/MIPVerify/test/runtests.jl:15 [inlined]
   [10] macro expansion at /home/vtjeng/.julia/packages/TimerOutputs/7Id5J/src/TimerOutput.jl:214 [inlined]
   [11] top-level scope at /home/vtjeng/.julia/environments/v1.0-MIPVerify/dev/MIPVerify/test/runtests.jl:13 [inlined]
   [12] top-level scope at ./none:0
   [13] include at ./boot.jl:317 [inlined]
   [14] include_relative(::Module, ::String) at ./loading.jl:1044
   [15] include(::Module, ::String) at ./sysimg.jl:29
   [16] include(::String) at ./client.jl:392
   [17] macro expansion at /home/vtjeng/.julia/environments/v1.0-MIPVerify/dev/MIPVerify/test/net_components.jl:4 [inlined]
   [18] macro expansion at /home/vtjeng/.julia/environments/v1.0-MIPVerify/dev/MIPVerify/test/runtests.jl:15 [inlined]
   [19] macro expansion at /buildworker/worker/package_linux64/build/usr/share/julia/stdlib/v1.0/Test/src/Test.jl:1083 [inlined]
   [20] macro expansion at /home/vtjeng/.julia/environments/v1.0-MIPVerify/dev/MIPVerify/test/runtests.jl:15 [inlined]
   [21] macro expansion at /home/vtjeng/.julia/packages/TimerOutputs/7Id5J/src/TimerOutput.jl:214 [inlined]
   [22] top-level scope at /home/vtjeng/.julia/environments/v1.0-MIPVerify/dev/MIPVerify/test/runtests.jl:13 [inlined]
   [23] top-level scope at ./none:0
   [24] include at ./boot.jl:317 [inlined]
   [25] include_relative(::Module, ::String) at ./loading.jl:1044
   [26] include(::Module, ::String) at ./sysimg.jl:29
   [27] include(::String) at ./client.jl:392
   [28] macro expansion at /home/vtjeng/.julia/environments/v1.0-MIPVerify/dev/MIPVerify/test/runtests.jl:27 [inlined]
   [29] macro expansion at /buildworker/worker/package_linux64/build/usr/share/julia/stdlib/v1.0/Test/src/Test.jl:1083 [inlined]
   [30] top-level scope at /home/vtjeng/.julia/environments/v1.0-MIPVerify/dev/MIPVerify/test/runtests.jl:22
   [31] include at ./boot.jl:317 [inlined]
   [32] include_relative(::Module, ::String) at ./loading.jl:1044
   [33] include(::Module, ::String) at ./sysimg.jl:29
   [34] exec_options(::Base.JLOptions) at ./client.jl:266
   [35] _start() at ./client.jl:425

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment