Rsyslog Conf

rsyslog.conf

# rsyslog configuration file
# note that most of this config file uses old-style format,
# because it is well-known AND quite suitable for simple cases
# like we have with the default config. For more advanced
# things, RainerScript configuration is suggested.

# For more information see /usr/share/doc/rsyslog-*/rsyslog_conf.html
# If you experience problems, see http://www.rsyslog.com/doc/troubleshoot.html

#### MODULES ####

# Load Modules
module(load="imfile")
module(load="omfwd")
module(load="imuxsock")
module(load="imklog")   # provides kernel logging support (previously done by rklogd)
#module(load"immark")  # provides --MARK-- message capability

# rsyslog Templates

# rsyslog Input Modules
input(type="imfile"
	 File="/tmp/automation/gateway-1.0.0/data/logs/system.log"
	 Tag=""
	 StateFile=""
	 Severity="debug"
	 Facility="kern")

# rsyslog Output Module. - Not Using it. Using Fwd rule below.
# action(type="omfwd"
#	 Target="logs.test.com"
#	 Port="5000"
#	 Protocol="tcp")

#### GLOBAL DIRECTIVES ####

# Use default timestamp format
#$ActionFileDefaultTemplate RSYSLOG_TraditionalFileFormat
#$ActionFileDefaultTemplate RSYSLOG_FileFormat
$klogParseKernelTimestamp off
$klogKeepKernelTimestamp off

$template MICROLOGS,"%msg%\n"
$ActionForwardDefaultTemplateName MICROLOGS

# File syncing capability is disabled by default. This feature is usually not required,
# not useful and an extreme performance hit
#$ActionFileEnableSync on

# Include all config files in /etc/rsyslog.d/
$IncludeConfig /etc/rsyslog.d/*.conf


#### RULES ####

# Log all kernel messages to the console.
# Logging much else clutters up the screen.
#kern.*                                                 /dev/console

# Log anything (except mail) of level info or higher.
# Don't log private authentication messages!
*.info;mail.none;authpriv.none;cron.none                /var/log/messages

# The authpriv file has restricted access.
authpriv.*                                              /var/log/secure

# Log all the mail messages in one place.
mail.*                                                  /var/log/maillog


# Log cron stuff
cron.*                                                  /var/log/cron

# Everybody gets emergency messages
*.emerg                                                 :omusrmsg:*

# Save news errors of level crit and higher in a special file.
uucp,news.crit                                          /var/log/spooler

# Save boot messages also to boot.log
local7.*                                                /var/log/boot.log


# ### begin forwarding rule ###
# The statement between the begin ... end define a SINGLE forwarding
# rule. They belong together, do NOT split them. If you create multiple
# forwarding rules, duplicate the whole block!
# Remote Logging (we use TCP for reliable delivery)
#
# An on-disk queue is created for this action. If the remote host is
# down, messages are spooled to disk and sent when it is up again.
$WorkDirectory /var/lib/rsyslog # where to place spool files
$ActionQueueFileName fwdRule1 # unique name prefix for spool files
$ActionQueueMaxDiskSpace 1g   # 1gb space limit (use as much as possible)
$ActionQueueSaveOnShutdown on # save messages to disk on shutdown
$ActionQueueType LinkedList   # run asynchronously
$ActionResumeRetryCount -1    # infinite retries if host is down
# remote host is: name/ip:port, e.g. 192.168.0.1:514, port optional
*.* @@logs.test.com:5000;MICROLOGS
# ### end of the forwarding rule ###

Input Format: (And Expected Output Format)

2014-10-23 23:30:35,810 10.141.10.115 management-server  Thread-13 TRACE FILE_LOGGER - BufferedWriter.notifyWriteResult() : notifyOnWrite ? [true] Notification [true]  running size  1

Output Format sent to remote server:

<7>Oct 23 23:58:54 CIAgent10115  2014-10-23 23:30:35,810 10.141.10.115 management-server  Thread-13 TRACE FILE_LOGGER - BufferedWriter.notifyWriteResult() : notifyOnWrite ? [true] Notification [true]  running size  1

Extra Element:

<7>Oct 23 23:58:54 CIAgent10115  

Requirement:

Need to Remove the extra Element

Didn't work:

$template MICROLOGS,"%msg%\n"
$ActionFileDefaultTemplate MICROLOGS
$ActionForwardDefaultTemplateName MICROLOGS

$template MICROLOGS,"%rawmsg%\n"
$ActionFileDefaultTemplate MICROLOGS
$ActionForwardDefaultTemplateName MICROLOGS

Fixed:

*.* @@logs.apigeng.com:5000;MICROLOGS

Updated the config.

Reference: http://www.rsyslog.com/using-a-different-log-format-for-all-files/