Skip to content

Instantly share code, notes, and snippets.

@higebu
Last active August 29, 2015 14:22
Show Gist options
  • Select an option

  • Save higebu/b10f99e997bd8e793a33 to your computer and use it in GitHub Desktop.

Select an option

Save higebu/b10f99e997bd8e793a33 to your computer and use it in GitHub Desktop.
Embulk outside valid range for the datatype BIGINT error.
2015-06-04 17:40:01.925 +0900: Embulk v0.6.11
2015-06-04 17:40:03.415 +0900: Loaded plugin embulk-input-mysql (0.4.0)
2015-06-04 17:40:03.452 +0900 [INFO] (transaction): Fetch size is 10000. Using server-side prepared statement.
2015-06-04 17:40:03.796 +0900 [INFO] (transaction): {done: 0 / 1, running: 0}
2015-06-04 17:40:03.832 +0900 [INFO] (task-0000): Writing local file 'zabbix_trends_uint_.000.00csv'
2015-06-04 17:40:03.847 +0900 [INFO] (task-0000): Fetch size is 10000. Using server-side prepared statement.
2015-06-04 17:40:03.853 +0900 [INFO] (task-0000): SQL: SELECT i_h.itemid, i_h.key_, i_h.type, i_h.units, item_name, host_name, FROM_UNIXTIME(t.clock) as timestamp, t.num, t.value_min, t.value_avg, t.value_max fr
om trends_uint as t INNER JOIN (SELECT i.itemid, i.key_, i.type, i.name as item_name, i.units, h.name as host_name FROM items as i INNER JOIN hosts as h ON i.hostid = h.hostid) as i_h ON i_h.itemid = t.itemid WH
ERE clock = UNIX_TIMESTAMP(FROM_UNIXTIME(UNIX_TIMESTAMP(DATE_ADD(NOW(), INTERVAL -1 HOUR)),'%Y-%m-%d %H:00:00'))
2015-06-04 17:40:09.223 +0900 [INFO] (task-0000): > 5.36 seconds
2015-06-04 17:40:09.448 +0900 [INFO] (task-0000): Fetched 500 rows.
2015-06-04 17:40:09.554 +0900 [INFO] (task-0000): Fetched 1,000 rows.
2015-06-04 17:40:09.697 +0900 [INFO] (task-0000): Fetched 2,000 rows.
2015-06-04 17:40:09.819 +0900 [INFO] (task-0000): Fetched 4,000 rows.
2015-06-04 17:40:09.988 +0900 [INFO] (task-0000): Fetched 8,000 rows.
2015-06-04 17:40:10.055 +0900 [INFO] (transaction): {done: 1 / 1, running: 0}
2015-06-04 17:40:10.068 +0900 [INFO] (main): Transaction partially failed. Cleaning up the intermediate data. Use -r option to make it resumable.
org.embulk.exec.PartialExecutionException: java.lang.RuntimeException: com.mysql.jdbc.exceptions.jdbc4.MySQLDataException: '18446743968218275840' in column '9' is outside valid range for the datatype BIGINT.
at org.embulk.exec.BulkLoader$LoaderState.buildPartialExecuteException(org/embulk/exec/BulkLoader.java:331)
at org.embulk.exec.BulkLoader.doRun(org/embulk/exec/BulkLoader.java:526)
at org.embulk.exec.BulkLoader.access$100(org/embulk/exec/BulkLoader.java:36)
at org.embulk.exec.BulkLoader$1.run(org/embulk/exec/BulkLoader.java:342)
at org.embulk.exec.BulkLoader$1.run(org/embulk/exec/BulkLoader.java:338)
at org.embulk.spi.Exec.doWith(org/embulk/spi/Exec.java:24)
at org.embulk.exec.BulkLoader.run(org/embulk/exec/BulkLoader.java:338)
at org.embulk.command.Runner.run(org/embulk/command/Runner.java:148)
at org.embulk.command.Runner.main(org/embulk/command/Runner.java:101)
at java.lang.reflect.Method.invoke(java/lang/reflect/Method.java:606)
at RUBY.run(file:/usr/local/bin/embulk!/embulk/command/embulk_run.rb:339)
at classpath_3a_embulk.command.embulk.(root)(classpath:embulk/command/embulk.rb:43)
at classpath_3a_embulk.command.embulk.(root)(classpath_3a_embulk/command/classpath:embulk/command/embulk.rb:43)
at org.embulk.cli.Main.main(org/embulk/cli/Main.java:11)
Caused by: java.lang.RuntimeException: com.mysql.jdbc.exceptions.jdbc4.MySQLDataException: '18446743968218275840' in column '9' is outside valid range for the datatype BIGINT.
at com.google.common.base.Throwables.propagate(Throwables.java:160)
at org.embulk.input.jdbc.AbstractJdbcInputPlugin.run(AbstractJdbcInputPlugin.java:239)
at org.embulk.spi.util.Executors.process(Executors.java:59)
at org.embulk.spi.util.Executors.process(Executors.java:39)
at org.embulk.exec.LocalExecutorPlugin$2.call(LocalExecutorPlugin.java:105)
at org.embulk.exec.LocalExecutorPlugin$2.call(LocalExecutorPlugin.java:101)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLDataException: '18446743968218275840' in column '9' is outside valid range for the datatype BIGINT.
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
at com.mysql.jdbc.Util.handleNewInstance(Util.java:377)
at com.mysql.jdbc.Util.getInstance(Util.java:360)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:963)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:935)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:924)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:870)
at com.mysql.jdbc.ResultSetImpl.throwRangeException(ResultSetImpl.java:7090)
at com.mysql.jdbc.ResultSetImpl.getNativeLong(ResultSetImpl.java:4008)
at com.mysql.jdbc.ResultSetImpl.getLong(ResultSetImpl.java:2734)
at com.mysql.jdbc.ResultSetImpl.getLong(ResultSetImpl.java:2650)
at org.embulk.input.jdbc.getter.ColumnGetters$LongColumnGetter.getAndSet(ColumnGetters.java:46)
at org.embulk.input.jdbc.AbstractJdbcInputPlugin.fetch(AbstractJdbcInputPlugin.java:275)
at org.embulk.input.jdbc.AbstractJdbcInputPlugin.run(AbstractJdbcInputPlugin.java:230)
... 8 more
Error: java.lang.RuntimeException: com.mysql.jdbc.exceptions.jdbc4.MySQLDataException: '18446743968218275840' in column '9' is outside valid range for the datatype BIGINT.
@higebu

higebu commented Jun 4, 2015

Copy link
Copy Markdown
Author

CAST(xxx as char) で回避

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment