Sample log lines from my code

marc2solr_sample_log.txt

# Not saying this is optimal, just what I currently do.

# Start out by logging what the hell we're doing: what config files are loaded, where we're sending documents, etc.

INFO    08:48:20         1252   ROOT                            Loading files in /l/solr-vufind/apps/marc2solr_example/umich/lib
INFO    08:48:23         4113   MARC2Solr.Conf                  Set suss url to http://localhost:8024/solr/biblio
INFO    08:48:23         4114   MARC2Solr.Conf                  Using 3 threads for the suss
INFO    08:48:24         4334   ROOT                            Using 4 threads; activiating threach
INFO    08:48:24         4335   ROOT                            Indexing file /l/solr-vufind/data/vufind_full_20130715.seq.gz
INFO    08:48:24         4335   MARC2Solr.Conf                  Sniffed marc file type as seq
INFO    08:48:24         5168   ROOT                            0 indexed (overall pace: 0 rec/sec)
INFO    08:49:01        42195   ROOT                            25000 indexed (overall pace: 660 rec/sec)

# ...this goes on for some time

# Get an error for a bad indicator. "2907805" is the line number in the file (alephsequential is line-based; you should
# probably pass on the record sequence number). 
# The ID (001996051) is also included. At the tail end, we see the field which threw the error

# The long class name is the class that did the logging (so I can tell where the log message is coming from).

WARN    09:36:47        2907805 Java.OrgMarc4j.MarcReader.MarcReader.LoggingNextRecord.Java.OrgMarc4j.MarcAlephSequentialReader 001996051 -- Minor Error  : (64957784) Illegal first indicator 'O' changed to space --- [ 852 : -- ]


# Here's a more severe one (unique to alephsequential -- the string for the data doesn't start with a '$'). Again, I can
# see where in the file it happened 
ERROR   12:41:04        13965171        Java.OrgMarc4j.MarcReader.MarcReader.LoggingNextRecord.Java.OrgMarc4j.MarcAlephSequentialReader 011486217 -- Major Error  : (319920602) Malformed variable field data: HC107.A195$$bH37 2012 --- [ XXX : -- ]

# And another all-too-common one
ERROR   12:44:52        14193121        MARC2Solr.Custom.UMich          No valid 245 title for record 011691701


# ...and finish it up
INFO    13:00:03        15104043        ROOT                            10850000 indexed (overall pace: 719 rec/sec)
INFO    13:00:59        15159881        ROOT                            Sending final commit
INFO    13:01:56        15216321        ROOT                            Final commit finished
INFO    13:01:56        15216321        ROOT                            Done indexing
INFO    13:01:56        15216321        ROOT                            10895551 indexed (overall pace: 716 rec/sec)