Reactivity benchmark (using reactors)

react-mark-noview.red

Red [title: "reactivity benchmark"]           ;) run as `red --cli ...` to eliminate GUI console influence!

do https://gitlab.com/hiiamboris/red-mezz-warehouse/-/raw/master/clock.red

recycle/off

print-count: does [
    attempt [print ["relations count:" (length? system/reactivity/relations) / 4]]
    attempt [print ["relations count:" system/reactivity/relations-count]]
]

attempt [system/reactivity/metrics?: yes]     ;) uncomment to obtain metrics
; attempt [system/reactivity/debug?: yes] 
num: 1000 rep: 5
whole-run: [

    total: [
        print ""
        print "=== ONLY REACTIVITY (NO VIEW) ==="
        print ""
        print ["CREATING" num "REACTORS x" rep]
        b: [[][][][][]]
        repeat i rep [clock compose/deep [clear pick b (i) loop num [append pick b (i) reactor [x: 10 y: 2 t: 0 re: copy/deep [self/t: s/s * self/x + self/y]]]]]
        print ["CREATING" 3 * rep * num "REACTIONS"]
        s: reactor [s: 1]
        repeat i rep [clock compose [foreach r pick b (i) [react/later r/re]]]
        print-count
        ?? b/1/1/t ?? b/2/2/t
        print ["FIRING" 3 * rep * num "REACTIONS (SINGLE SOURCE) x5"]
        clock [s/s: 2  s/s: 3  s/s: 4  s/s: 5  s/s: 6]
        ?? b/1/1/t ?? b/2/2/t
        print ["DESTROYING" 3 * rep * num "REACTIONS"]
        repeat i rep [
            clock compose [foreach r pick b (i) [react/unlink r/re 'all]]
            print-count
        ]
        clock [clear-reactions]
    ]
    clock [do total]
    clock [recycle]

    total: [
        print ""
        print "=== ONLY REACTIVITY AND OBJECTS MAINLY UNIQUE ==="
        print ""
        print ["CREATING" num "REACTORS x" rep]
        b: [[][][][][]]
        s: reactor [x: 10 y: 2 t: 0 re: [this/t: that/x + that/y + that/t / 10]]
        repeat i rep [clock compose/deep [clear pick b (i) loop num [append pick b (i) make s [re: copy/deep re]]]]
        print ["CREATING" 3 * rep * num "REACTIONS"]
        prev: s
        repeat i rep [clock compose [foreach r pick b (i) [react/link/later r/re: func [this that] r/re [r prev] prev: r]]]
        print-count
        ?? b/1/1/t ?? b/2/2/t
        print ["FIRING" 3 * rep * num "REACTIONS (SINGLE CHAIN) x5"]
        clock [s/t: 1  s/t: 2  s/t: 3  s/t: 4  s/t: 5]
        ?? b/1/1/t ?? b/2/2/t
        print ["DESTROYING" 3 * rep * num "REACTIONS"]
        repeat i rep [
            clock compose [foreach r pick b (i) [react/unlink :r/re 'all]]
            print-count
        ]
        clock [clear-reactions]
    ]
    clock [do total]
    ; clock [recycle]         ;@@ CRASHES - #4514
    print-count
]

clock [do whole-run]

attempt [
    if system/reactivity/metrics? [
        system/reactivity/metrics/show
    ]
]

Using modified reactivity:

=== ONLY REACTIVITY (NO VIEW) ===

CREATING 1000 REACTORS x 5
18.0 ms	[clear pick b 1 loop num [append pick b 1 reactor [x: 10 y: 2 t: 0 re:
15.5 ms	[clear pick b 2 loop num [append pick b 2 reactor [x: 10 y: 2 t: 0 re:
16.9 ms	[clear pick b 3 loop num [append pick b 3 reactor [x: 10 y: 2 t: 0 re:
18.0 ms	[clear pick b 4 loop num [append pick b 4 reactor [x: 10 y: 2 t: 0 re:
19.0 ms	[clear pick b 5 loop num [append pick b 5 reactor [x: 10 y: 2 t: 0 re:
CREATING 15000 REACTIONS
129 ms	[foreach r pick b 1 [react/later r/re]]
247 ms	[foreach r pick b 2 [react/later r/re]]
321 ms	[foreach r pick b 3 [react/later r/re]]
414 ms	[foreach r pick b 4 [react/later r/re]]
484 ms	[foreach r pick b 5 [react/later r/re]]
relations count: 15000
b/1/1/t: 0
b/2/2/t: 0
FIRING 15000 REACTIONS (SINGLE SOURCE) x5
180 ms	[s/s: 2 s/s: 3 s/s: 4 s/s: 5 s/s: 6]
b/1/1/t: 62
b/2/2/t: 62
DESTROYING 15000 REACTIONS
144 ms	[foreach r pick b 1 [react/unlink r/re 'all]]
relations count: 12000
167 ms	[foreach r pick b 2 [react/unlink r/re 'all]]
relations count: 9000
194 ms	[foreach r pick b 3 [react/unlink r/re 'all]]
relations count: 6000
131 ms	[foreach r pick b 4 [react/unlink r/re 'all]]
relations count: 3000
53.1 ms	[foreach r pick b 5 [react/unlink r/re 'all]]
relations count: 0
0.0 μs	[clear-reactions]
2589 ms	[do total]
49.0 ms	[recycle]

=== ONLY REACTIVITY AND OBJECTS MAINLY UNIQUE ===

CREATING 1000 REACTORS x 5
11.0 ms	[clear pick b 1 loop num [append pick b 1 make s [re: copy/deep re]]]
10.0 ms	[clear pick b 2 loop num [append pick b 2 make s [re: copy/deep re]]]
12.0 ms	[clear pick b 3 loop num [append pick b 3 make s [re: copy/deep re]]]
17.9 ms	[clear pick b 4 loop num [append pick b 4 make s [re: copy/deep re]]]
20.5 ms	[clear pick b 5 loop num [append pick b 5 make s [re: copy/deep re]]]
CREATING 15000 REACTIONS
102 ms	[foreach r pick b 1 [react/link/later r/re: func [this that] r/re [r p
116 ms	[foreach r pick b 2 [react/link/later r/re: func [this that] r/re [r p
119 ms	[foreach r pick b 3 [react/link/later r/re: func [this that] r/re [r p
121 ms	[foreach r pick b 4 [react/link/later r/re: func [this that] r/re [r p
128 ms	[foreach r pick b 5 [react/link/later r/re: func [this that] r/re [r p
relations count: 15000
b/1/1/t: 0
b/2/2/t: 0
FIRING 15000 REACTIONS (SINGLE CHAIN) x5
1282 ms	[s/t: 1 s/t: 2 s/t: 3 s/t: 4 s/t: 5]
b/1/1/t: 1.7
b/2/2/t: 1.3333333333333335
DESTROYING 15000 REACTIONS
42.1 ms	[foreach r pick b 1 [react/unlink :r/re 'all]]
relations count: 12000
35.1 ms	[foreach r pick b 2 [react/unlink :r/re 'all]]
relations count: 9000
35.3 ms	[foreach r pick b 3 [react/unlink :r/re 'all]]
relations count: 6000
31.0 ms	[foreach r pick b 4 [react/unlink :r/re 'all]]
relations count: 3000
31.9 ms	[foreach r pick b 5 [react/unlink :r/re 'all]]
relations count: 0
0.0 μs	[clear-reactions]
2159 ms	[do total]
relations count: 0
4798 ms	[do whole-run]

Using modified reactivity with metrics collection turned on:

=== ONLY REACTIVITY (NO VIEW) ===

CREATING 1000 REACTORS x 5
20.9 ms	[clear pick b 1 loop num [append pick b 1 reactor [x: 10 y: 2 t: 0 re:
19.0 ms	[clear pick b 2 loop num [append pick b 2 reactor [x: 10 y: 2 t: 0 re:
20.4 ms	[clear pick b 3 loop num [append pick b 3 reactor [x: 10 y: 2 t: 0 re:
19.5 ms	[clear pick b 4 loop num [append pick b 4 reactor [x: 10 y: 2 t: 0 re:
23.0 ms	[clear pick b 5 loop num [append pick b 5 reactor [x: 10 y: 2 t: 0 re:
CREATING 15000 REACTIONS
181 ms	[foreach r pick b 1 [react/later r/re]]
294 ms	[foreach r pick b 2 [react/later r/re]]
425 ms	[foreach r pick b 3 [react/later r/re]]
490 ms	[foreach r pick b 4 [react/later r/re]]
523 ms	[foreach r pick b 5 [react/later r/re]]
relations count: 15000
b/1/1/t: 0
b/2/2/t: 0
FIRING 15000 REACTIONS (SINGLE SOURCE) x5
469 ms	[s/s: 2 s/s: 3 s/s: 4 s/s: 5 s/s: 6]
b/1/1/t: 62
b/2/2/t: 62
DESTROYING 15000 REACTIONS
136 ms	[foreach r pick b 1 [react/unlink r/re 'all]]
relations count: 12000
168 ms	[foreach r pick b 2 [react/unlink r/re 'all]]
relations count: 9000
193 ms	[foreach r pick b 3 [react/unlink r/re 'all]]
relations count: 6000
130 ms	[foreach r pick b 4 [react/unlink r/re 'all]]
relations count: 3000
56.0 ms	[foreach r pick b 5 [react/unlink r/re 'all]]
relations count: 0
0.0 μs	[clear-reactions]
3195 ms	[do total]
297 ms	[recycle]

=== ONLY REACTIVITY AND OBJECTS MAINLY UNIQUE ===

CREATING 1000 REACTORS x 5
11.0 ms	[clear pick b 1 loop num [append pick b 1 make s [re: copy/deep re]]]
11.1 ms	[clear pick b 2 loop num [append pick b 2 make s [re: copy/deep re]]]
11.8 ms	[clear pick b 3 loop num [append pick b 3 make s [re: copy/deep re]]]
18.1 ms	[clear pick b 4 loop num [append pick b 4 make s [re: copy/deep re]]]
22.0 ms	[clear pick b 5 loop num [append pick b 5 make s [re: copy/deep re]]]
CREATING 15000 REACTIONS
165 ms	[foreach r pick b 1 [react/link/later r/re: func [this that] r/re [r p
172 ms	[foreach r pick b 2 [react/link/later r/re: func [this that] r/re [r p
170 ms	[foreach r pick b 3 [react/link/later r/re: func [this that] r/re [r p
178 ms	[foreach r pick b 4 [react/link/later r/re: func [this that] r/re [r p
178 ms	[foreach r pick b 5 [react/link/later r/re: func [this that] r/re [r p
relations count: 15000
b/1/1/t: 0
b/2/2/t: 0
FIRING 15000 REACTIONS (SINGLE CHAIN) x5
1776 ms	[s/t: 1 s/t: 2 s/t: 3 s/t: 4 s/t: 5]
b/1/1/t: 1.7
b/2/2/t: 1.3333333333333335
DESTROYING 15000 REACTIONS
45.2 ms	[foreach r pick b 1 [react/unlink :r/re 'all]]
relations count: 12000
50.2 ms	[foreach r pick b 2 [react/unlink :r/re 'all]]
relations count: 9000
45.9 ms	[foreach r pick b 3 [react/unlink :r/re 'all]]
relations count: 6000
47.6 ms	[foreach r pick b 4 [react/unlink :r/re 'all]]
relations count: 3000
40.1 ms	[foreach r pick b 5 [react/unlink :r/re 'all]]
relations count: 0
0.0 μs	[clear-reactions]
2991 ms	[do total]
relations count: 0
6483 ms	[do whole-run]

***** REACTIVITY METRICS REPORT *****
Metrics collection enabled?: true
Statistical counts:
    events triggered:    80015
    reactions fired:     50000 (immediately: 25005 , queued: 24995 )
    reactions skipped:   0
Time spent in reactions: 0:00:00
Time spent in reactivity:
    total:               0:00:06.43748
    adding relations:    0:00:02.62727 (preparations: 0:00:00.731315 )
    removing relations:  0:00:00.876593
    dispatching:         0:00:02.93362
    longest queue flush: 0:00:00.0042213
Peak values:
    max queue size:      5000
    max reactors count:  5001
    max reactions count: 5000
    biggest relation:    2 reactors
    biggest reactor:     5000 relations

I love numbers. I love even more when the loop counts are broken out, to play at various sizes. Something to think about for a profiling dialect.

The speedup is impressive. 👍

when the loop counts are broken out, to play at various sizes

:D Yeah I should have overcome my laziness. I'll do that and update the script.

This is perfect. Will this improvement become part of Red? :-)