Skip to content

Instantly share code, notes, and snippets.

@gkossakowski
Created May 23, 2012 15:13
Show Gist options
  • Save gkossakowski/2775822 to your computer and use it in GitHub Desktop.
Save gkossakowski/2775822 to your computer and use it in GitHub Desktop.
mac-grek:codwh grek (master)$ ./network_test.sh 10 7 queries/q7.ascii
RUNNING:./src/worker 1 2001 localhost:2000 localhost:2001 localhost:2002 localhost:2003 localhost:2004 localhost:2005 localhost:2006 localhost:2007 localhost:2008 localhost:2009 7 &
WARNING: New server, query id = 7
Awaiting for a job
RUNNING:./src/worker 2 2002 localhost:2000 localhost:2001 localhost:2002 localhost:2003 localhost:2004 localhost:2005 localhost:2006 localhost:2007 localhost:2008 localhost:2009 7 &
RUNNING:./src/worker 3 2003 localhost:2000 localhost:2001 localhost:2002 localhost:2003 localhost:2004 localhost:2005 localhost:2006 localhost:2007 localhost:2008 localhost:2009 7 &
WARNING: New server, query id = 7
Awaiting for a job
RUNNING:./src/worker 4 2004 localhost:2000 localhost:2001 localhost:2002 localhost:2003 localhost:2004 localhost:2005 localhost:2006 localhost:2007 localhost:2008 localhost:2009 7 &
WARNING: New server, query id = 7
Awaiting for a job
RUNNING:./src/worker 5 2005 localhost:2000 localhost:2001 localhost:2002 localhost:2003 localhost:2004 localhost:2005 localhost:2006 localhost:2007 localhost:2008 localhost:2009 7 &
WARNING: New server, query id = 7
Awaiting for a job
RUNNING:./src/worker 6 2006 localhost:2000 localhost:2001 localhost:2002 localhost:2003 localhost:2004 localhost:2005 localhost:2006 localhost:2007 localhost:2008 localhost:2009 7 &
WARNING: New server, query id = 7
Awaiting for a job
RUNNING:./src/worker 7 2007 localhost:2000 localhost:2001 localhost:2002 localhost:2003 localhost:2004 localhost:2005 localhost:2006 localhost:2007 localhost:2008 localhost:2009 7 &
WARNING: New server, query id = 7
Awaiting for a job
WARNING: New server, query id = 7
Awaiting for a job
RUNNING:./src/worker 8 2008 localhost:2000 localhost:2001 localhost:2002 localhost:2003 localhost:2004 localhost:2005 localhost:2006 localhost:2007 localhost:2008 localhost:2009 7 &
WARNING: New server, query id = 7
Awaiting for a job
RUNNING:./src/worker 9 2009 localhost:2000 localhost:2001 localhost:2002 localhost:2003 localhost:2004 localhost:2005 localhost:2006 localhost:2007 localhost:2008 localhost:2009 7 &
RUNNING:./src/scheduler 1 queries/q1.ascii 0 2000 localhost:2000 localhost:2001 localhost:2002 localhost:2003 localhost:2004 localhost:2005 localhost:2006 localhost:2007 localhost:2008 localhost:2009 &
WARNING: New server, query id = 7
Awaiting for a job
43778 43780 43782 43784 43786 43788 43790 43792 43794 43796
Scheduling proto: compute {
source {
group_by {
source {
scan {
column: 0
column: 1
type: DOUBLE
type: INT
number_of_files: 3
}
}
group_by_column: 1
aggregations {
type: SUM
aggregated_column: 0
}
}
}
expressions {
operator: COLUMN
column_id: 1
}
}
number of input files: 3
after striping:
STRIPE 0
shuffle {
source {
scan_own {
column: 0
column: 1
type: DOUBLE
type: INT
}
}
column: 0
column: 1
type: DOUBLE
type: INT
}
STRIPE 1
shuffle {
source {
compute {
source {
group_by {
source {
union {
column: 0
column: 1
type: DOUBLE
type: INT
}
}
group_by_column: 1
aggregations {
type: SUM
aggregated_column: 0
}
}
}
expressions {
operator: COLUMN
column_id: 1
}
}
}
column: 0
type: DOUBLE
}
STRIPE 2
final {
source {
union {
column: 0
type: DOUBLE
}
}
}
nodeIds: 1, 2, 3, 4,
nodeIdsNext: 5, 6, 7, 8, 9,
Send stripe[0] to worker[1]
shuffle {
source {
scan_own {
column: 0
column: 1
type: DOUBLE
type: INT
source: 0
}
}
receiversCount: 5
column: 0
column: 1
type: DOUBLE
type: INT
}
Send stripe[1] to worker[2]
shuffle {
source {
scan_own {
column: 0
column: 1
type: DOUBLE
type: INT
source: 1
}
}
receiversCount: 5
column: 0
column: 1
type: DOUBLE
type: INT
}
Worker[1] job proto tree:
shuffle {
source {
scan_own {
column: 0
column: 1
type: DOUBLE
type: INT
source: 0
}
}
receiversCount: 5
column: 0
column: 1
type: DOUBLE
type: INT
}
ERROR: unknown operationscan_own {
column: 0
column: 1
type: DOUBLE
type: INT
source: 0
}
Assertion failed: (false), function createOperation, file operators/factory.cc, line 34.
Send stripe[2] to worker[3]
shuffle {
source {
scan_own {
column: 0
column: 1
type: DOUBLE
type: INT
source: 2
}
}
receiversCount: 5
column: 0
column: 1
type: DOUBLE
type: INT
}
Worker[2] job proto tree:
Send stripe[3] to worker[5]
shuffle {
source {
compute {
source {
group_by {
source {
union {
column: 0
column: 1
type: DOUBLE
type: INT
source {
node: 1
stripe: 0
}
source {
node: 2
stripe: 1
}
source {
node: 3
stripe: 2
}
}
}
group_by_column: 1
aggregations {
type: SUM
aggregated_column: 0
}
}
}
expressions {
operator: COLUMN
column_id: 1
}
}
}
receiversCount: 4
column: 0
type: DOUBLE
}
shuffle {
source {
scan_own {
column: 0
Worker[3] job proto tree:
column: 1
type: DOUBLE
shuffle {
source {
scan_own {
column: 0
column: 1
type: DOUBLE
type: INT
source: 2
}
}
receiversCount: 5
column: 0
column: 1
type: DOUBLE
type: INT
}
ERROR: unknown operationscan_own {
column: 0
column: 1
type: DOUBLE
type: INT
source: 2
}
Assertion failed: (false), function createOperation, file operators/factory.cc, line 34.
type: INT
Send stripe[4] to worker[6]
source: 1
}
}
receiversCount: 5
column: 0
column: 1
type: DOUBLE
type: INT
}
ERROR: unknown operationscan_own {
column: 0
column: 1
type: DOUBLE
type: INT
source: 1
}
Assertion failed: (false), function createOperation, file operators/factory.cc, line 34.
Send stripe[5] to worker[7]
Worker[5] job proto tree:
shuffle {
source {
compute {
source {
group_by {
source {
union {
column: 0
column: 1
type: DOUBLE
type: INT
source {
node: 1
stripe: 0
}
source {
node: 2
stripe: 1
}
source {
node: 3
stripe: 2
}
}
}
group_by_column: 1
aggregations {
type: SUM
aggregated_column: 0
}
}
}
expressions {
operator: COLUMN
column_id: 1
}
}
}
receiversCount: 4
column: 0
type: DOUBLE
}
Worker[6] job proto tree:
ERROR: unknown operation
Assertion failed: (false), function createOperation, file operators/factory.cc, line 34.
Send stripe[6] to worker[8]
Worker[7] job proto tree:
ERROR: unknown operation
Assertion failed: (false), function createOperation, file operators/factory.cc, line 34.
Send stripe[7] to worker[9]
Send stripe[8] to worker[0]
final {
source {
union {
column: 0
type: DOUBLE
source {
node: 5
stripe: 3
}
source {
node: 6
stripe: 4
}
source {
node: 7
stripe: 5
}
source {
node: 8
stripe: 6
}
source {
node: 9
stripe: 7
}
}
}
}
Worker[8] job proto tree:
ERROR: unknown operation
Assertion failed: (false), function createOperation, file operators/factory.cc, line 34.
Worker[9] job proto tree:
ERROR: unknown operation
Assertion failed: (false), function createOperation, file operators/factory.cc, line 34.
./network_test.sh: line 37: 43782 Abort trap: 6 ./src/worker $i $PORT $HOSTS $2
./network_test.sh: line 37: 43788 Abort trap: 6 ./src/worker $i $PORT $HOSTS $2
./network_test.sh: line 37: 43790 Abort trap: 6 ./src/worker $i $PORT $HOSTS $2
./network_test.sh: line 37: 43792 Abort trap: 6 ./src/worker $i $PORT $HOSTS $2
./network_test.sh: line 37: 43794 Abort trap: 6 ./src/worker $i $PORT $HOSTS $2
./network_test.sh: line 40: 43778 Abort trap: 6 ./src/worker $i $PORT $HOSTS $2
./network_test.sh: line 40: 43780 Abort trap: 6 ./src/worker $i $PORT $HOSTS $2
./network_test.sh: line 40: 43784 Terminated: 15 ./src/worker $i $PORT $HOSTS $2
./network_test.sh: line 40: 43786 Segmentation fault: 11 ./src/worker $i $PORT $HOSTS $2
mac-grek:codwh grek (master)$
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment