Skip to content

Instantly share code, notes, and snippets.

@daynebatten
Created March 21, 2016 18:18
Show Gist options
  • Save daynebatten/647110450203046652aa to your computer and use it in GitHub Desktop.
Save daynebatten/647110450203046652aa to your computer and use it in GitHub Desktop.
while (getFilePosition() <= end || in.needAdditionalRecordAfterSplit()) {
if (pos == 0) {
newSize = skipUtfByteOrderMark();
} else {
newSize = in.readLine(value, maxLineLength, maxBytesToConsume(pos));
pos += newSize;
}
if ((newSize == 0) || (newSize < maxLineLength)) {
break;
}
// line too long. try again
LOG.info("Skipped line of size " + newSize + " at pos " +
(pos - newSize));
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment