Hi All,
I am starting a service which will redirect its out put into 2 logs say A and B.
Now for succesful startup of the service i need to search pattern1 in log A and pattern2 in log B which are writen continuosly.
Now my requirement is to find the patterns in the increasing logs A and B parallely.
Need an advice on above requirement
To search two logs simultaneously, run two programs.
What have you tried?
I tried to get the last lines of each log and search for the pattern using sed inside while condition.
Below is the code.
server_lno --> last line no of server log
jboss_lno --> last line of jboss log
while [ `$SED -n "$server_lno,$ p" $SERVER_LOG | $GREP -E "Shutdown.*complete" | wc -l` -eq 0 -o `$SED -n "$jboss_lno,$ p" $JBOSS_LOG | $GREP -E "shutdown.*finished" | wc -l` -eq 0 ]
do
sleep 10
count=`expr $count + 1`
if [ $count -eq $max_count ]; then
echo "Error"
exit 1
fi
done
Here i am having an itteration of required condition is not met.
Itteration will have a tollerance limit of on max_count
I would like to know whether is there any way to check the in a single script only.
What do you mean by 'single script only'? Do you mean not looping, waiting for the log instead?
I'm sure this can be simplified a lot, please show us the relevant parts of your logfiles.
Below is the sample output of server logs ::
2013-12-11 11:14:22,893 INFO [org.jboss.jms.server.destination.QueueService] (JBoss Shutdown Hook) Queue[/queue/CarnotSystemQueue] stopped
2013-12-11 11:14:22,900 INFO [org.jboss.jms.server.destination.QueueService] (JBoss Shutdown Hook) Queue[/queue/CarnotApplicationQueue] stopped
2013-12-11 11:14:22,905 INFO [org.jboss.jms.server.destination.QueueService] (JBoss Shutdown Hook) Queue[/queue/CarnotDaemonQueue] stopped
2013-12-11 11:14:22,912 INFO [org.jboss.jms.server.destination.QueueService] (JBoss Shutdown Hook) Queue[/queue/DLQ] stopped
2013-12-11 11:14:22,918 INFO [org.jboss.jms.server.destination.QueueService] (JBoss Shutdown Hook) Queue[/queue/ExpiryQueue] stopped
2013-12-11 11:14:22,926 INFO [org.jboss.jms.server.connectionfactory.ConnectionFactory] (JBoss Shutdown Hook) org.jboss.jms.server.connectionfactory.ConnectionFactory@14079543 undeployed
2013-12-11 11:14:22,932 INFO [org.jboss.jms.server.connectionfactory.ConnectionFactory] (JBoss Shutdown Hook) org.jboss.jms.server.connectionfactory.ConnectionFactory@285c5e36 undeployed
2013-12-11 11:14:22,940 INFO [org.jboss.jms.server.connectionfactory.ConnectionFactory] (JBoss Shutdown Hook) org.jboss.jms.server.connectionfactory.ConnectionFactory@5f37fd4b undeployed
2013-12-11 11:14:23,357 INFO [org.jboss.jms.server.ServerPeer] (JBoss Shutdown Hook) JMS ServerPeer[0] stopped
2013-12-11 11:14:23,378 INFO [org.jboss.resource.connectionmanager.ConnectionFactoryBindingService] (JBoss Shutdown Hook) Unbound ConnectionManager 'jboss.jca:service=DataSourceBinding,name=Defaul
tDS' from JNDI name 'java:DefaultDS'
2013-12-11 11:14:23,707 INFO [org.jboss.jdbc.HypersonicDatabase] (JBoss Shutdown Hook) Database standalone closed clean
2013-12-11 11:14:23,734 INFO [org.jboss.resource.connectionmanager.ConnectionFactoryBindingService] (JBoss Shutdown Hook) Unbound ConnectionManager 'jboss.jca:service=ConnectionFactoryBinding,name
=CarnotConnectionFactory' from JNDI name 'java:CarnotConnectionFactory'
2013-12-11 11:14:23,785 INFO [org.quartz.core.QuartzScheduler] (JBoss Shutdown Hook) Scheduler DefaultQuartzScheduler_$_NON_CLUSTERED shutting down.
2013-12-11 11:14:23,785 INFO [org.quartz.core.QuartzScheduler] (JBoss Shutdown Hook) Scheduler DefaultQuartzScheduler_$_NON_CLUSTERED paused.
2013-12-11 11:14:23,862 INFO [org.quartz.simpl.SimpleThreadPool] (JBoss Shutdown Hook) There are still 54 worker threads active. See javadoc runInThread(Runnable) for a possible explanation
2013-12-11 11:14:23,868 INFO [org.quartz.core.QuartzScheduler] (JBoss Shutdown Hook) Scheduler DefaultQuartzScheduler_$_NON_CLUSTERED shutdown complete.
2013-12-11 11:14:24,076 INFO [org.jboss.web.tomcat.service.deployers.TomcatDeployment] (JBoss Shutdown Hook) undeploy, ctxPath=/invoker
2013-12-11 11:14:24,116 INFO [org.jboss.web.tomcat.service.deployers.TomcatDeployment] (JBoss Shutdown Hook) undeploy, ctxPath=/web-console
2013-12-11 11:14:24,172 INFO [org.apache.catalina.core.StandardService] (JBoss Shutdown Hook) Stopping service jboss.web
2013-12-11 11:14:24,302 INFO [com.arjuna.ats.jbossatx.jta.TransactionManagerService] (JBoss Shutdown Hook) Stopping transaction recovery manager
2013-12-11 11:14:24,323 INFO [com.arjuna.ats.jbossatx.jta.TransactionManagerService] (JBoss Shutdown Hook) Destroying TransactionManagerService
2013-12-11 11:14:26,434 INFO [org.jboss.mail.MailService] (JBoss Shutdown Hook) Mail service 'java:/Mail' removed from JNDI
2013-12-11 11:14:43,760 INFO [org.jboss.bootstrap.microcontainer.ServerImpl] (JBoss Shutdown Hook) Shutdown complete
Below is the sample output of jboss logs::
2014-01-06 07:13:57,074 [TaskController_28] INFO service.TaskController - executeTask "Stop WorkflowModelViewManager" params={physicalNode=PN1, taskCode=Set PN Shutdown} with user system, timeout=
-1s
2014-01-06 07:13:57,112 [TaskController_28] INFO service.TaskController - executeTask Stop WorkflowModelViewManager success = Service.ServiceTask[Stop WorkflowModelViewManagerv0, type: Shutdown, s
tartup: Automatic, ruleSequence: WorkflowModelViewManager-stop]
2014-01-06 07:13:57,155 [JBoss Shutdown Hook] INFO impl.SessionFactoryImpl - closing
2014-01-06 07:13:57,172 [JBoss Shutdown Hook] INFO applicationlog.ApplicationLogHelper - Stopping workers...
2014-01-06 07:13:57,173 [ApplicationLogWorker] INFO applicationlog.ApplicationLogWorker - Told to stop, quitting...
2014-01-06 07:13:57,173 [JBoss Shutdown Hook] INFO applicationlog.ApplicationLogHelper - All workers were stopped.
2014-01-06 07:13:57,173 [JBoss Shutdown Hook] INFO service.AMHServerControl - AMH shutdown
2014-01-06 07:13:57,173 [JBoss Shutdown Hook] INFO server.ServerControlManager - End stopping the server
2014-01-06 07:13:57,173 [JBoss Shutdown Hook] INFO server.ServerControlManager - shutdown finished
We can use loops. But i want to check for patterns in both logs to happen in a single script that too simultaneously..
I don't think you can guarantee both logs get checked at precisely the same time.
The rest of your statement did not cross the language barrier, could you try explaining another way?
If checking logs is not possible means ok not a problem.
Is there any way to compare the date and time available in the log with a variable having date value say "dt=2014-01-06 07:00:57".
Since i want to find the lines only after 2014-01-06 07:00:57
Is there any easy way for this??
I see what you mean now.
Yes, that should be straightforward actually. YYYY-MM-DD HH:MM:SS,SSS timestamps are very convenient, you can compare entire lines with < > =. Later times are guaranteed to compare > than earlier times.
You can rewrite that huge pipe chain with the awk utility, including the time comparison.
TIME="2014-01-06 07:00:57,000"
# If the line is later than T, and contains "shutdown complete", quit with success, else quit with error.
# Then the same on the second file, chained with && to check for the success of both.
if awk -v T="$TIME" '($0 >= T) && /Shutdown.*complete/ { SC=1 } END { EXIT !SC }' $SERVER_LOG &&
awk -v T="$TIME" '($0 >= T) && /Shutdown.*complete/ { SC=1 } END { EXIT !SC }' $JBOSS_LOG
then
echo "Shutdown Complete found in both logs after $TIME"
else
echo "Shutdown Complete missing from one or both"
fi
That may have been too complex an example. You can filter all the lines greater than a date in your logs like this:
TIME="2014-01-06 07:00:57,000"
# Print all lines at or later than TIME from filename
awk -v T="$TIME" '$0 >= T' filename
grep or sed do not have these forms of comparison.
This only works because your logs begin with YYYY-MM-DD HH:MM:SS.SSS, which means they sort and compare alphabetically (which is why YYYY-MM-DD dates are standard -- they're just so handy.)
Couldn't you convert TIME to epoch?
TIME="2014-01-06 07:00:57,000"
EPOCH=`date --date="${TIME}" +%s`
The above didn't work on my FreeBSD server as I don't have gnu date installed, I don't think getting to the same point would be too difficult (or just install gnu date and use that). probably more work than its worth though, if you're just trying to retrieve out of a log.
I am sorry i was not able to view the output
---------- Post updated at 11:39 PM ---------- Previous update was at 11:37 PM ----------
$ EPOCH=`date --date="${TIME}" +%s`
date: illegal option -- date=2014-01-06 07:00:57,000
usage: date [-u] mmddHHMM[[cc]yy][.SS]
date [-u] [+format]
date -a [-]sss[.fff]
Have you tried any of the solutions I suggested yet?
To repeat:
TIME="2014-01-06 07:00:57,000"
# Print all lines at or later than TIME from filename
awk -v T="$TIME" '$0 >= T' filename
Or else can you please let me know how to compare 2 dates say
dt1=2014-01-06 06:59:57 and dt2=2014-01-06 07:00:57 and know which one is greater
---------- Post updated at 11:45 PM ---------- Previous update was at 11:44 PM ----------
@corona I have tried your solution but output was not displayed
Thanks for letting me know. But it works perfectly with the data you posted:
$ cat log
2013-12-11 11:14:22,893 INFO [org.jboss.jms.server.destination.QueueService] (JBoss Shutdown Hook) Queue[/queue/CarnotSystemQueue] stopped
2013-12-11 11:14:22,900 INFO [org.jboss.jms.server.destination.QueueService] (JBoss Shutdown Hook) Queue[/queue/CarnotApplicationQueue] stopped
2013-12-11 11:14:22,905 INFO [org.jboss.jms.server.destination.QueueService] (JBoss Shutdown Hook) Queue[/queue/CarnotDaemonQueue] stopped
2013-12-11 11:14:22,912 INFO [org.jboss.jms.server.destination.QueueService] (JBoss Shutdown Hook) Queue[/queue/DLQ] stopped
2013-12-11 11:14:22,918 INFO [org.jboss.jms.server.destination.QueueService] (JBoss Shutdown Hook) Queue[/queue/ExpiryQueue] stopped
2013-12-11 11:14:22,926 INFO [org.jboss.jms.server.connectionfactory.ConnectionFactory] (JBoss Shutdown Hook) org.jboss.jms.server.connectionfactory.ConnectionFactory@14079543 undeployed
2013-12-11 11:14:22,932 INFO [org.jboss.jms.server.connectionfactory.ConnectionFactory] (JBoss Shutdown Hook) org.jboss.jms.server.connectionfactory.ConnectionFactory@285c5e36 undeployed
2013-12-11 11:14:22,940 INFO [org.jboss.jms.server.connectionfactory.ConnectionFactory] (JBoss Shutdown Hook) org.jboss.jms.server.connectionfactory.ConnectionFactory@5f37fd4b undeployed
2013-12-11 11:14:23,357 INFO [org.jboss.jms.server.ServerPeer] (JBoss Shutdown Hook) JMS ServerPeer[0] stopped
2013-12-11 11:14:23,378 INFO [org.jboss.resource.connectionmanager.ConnectionFactoryBindingService] (JBoss Shutdown Hook) Unbound ConnectionManager 'jboss.jca:service=DataSourceBinding,name=DefaultDS' from JNDI name 'java:DefaultDS'
2013-12-11 11:14:23,707 INFO [org.jboss.jdbc.HypersonicDatabase] (JBoss Shutdown Hook) Database standalone closed clean
2013-12-11 11:14:23,734 INFO [org.jboss.resource.connectionmanager.ConnectionFactoryBindingService] (JBoss Shutdown Hook) Unbound ConnectionManager 'jboss.jca:service=ConnectionFactoryBinding,name=CarnotConnectionFactory' from JNDI name 'java:CarnotConnectionFactory'
2013-12-11 11:14:23,785 INFO [org.quartz.core.QuartzScheduler] (JBoss Shutdown Hook) Scheduler DefaultQuartzScheduler_$_NON_CLUSTERED shutting down.
2013-12-11 11:14:23,785 INFO [org.quartz.core.QuartzScheduler] (JBoss Shutdown Hook) Scheduler DefaultQuartzScheduler_$_NON_CLUSTERED paused.
2013-12-11 11:14:23,862 INFO [org.quartz.simpl.SimpleThreadPool] (JBoss Shutdown Hook) There are still 54 worker threads active. See javadoc runInThread(Runnable) for a possible explanation
2013-12-11 11:14:23,868 INFO [org.quartz.core.QuartzScheduler] (JBoss Shutdown Hook) Scheduler DefaultQuartzScheduler_$_NON_CLUSTERED shutdown complete.
2013-12-11 11:14:24,076 INFO [org.jboss.web.tomcat.service.deployers.TomcatDeployment] (JBoss Shutdown Hook) undeploy, ctxPath=/invoker
2013-12-11 11:14:24,116 INFO [org.jboss.web.tomcat.service.deployers.TomcatDeployment] (JBoss Shutdown Hook) undeploy, ctxPath=/web-console
2013-12-11 11:14:24,172 INFO [org.apache.catalina.core.StandardService] (JBoss Shutdown Hook) Stopping service jboss.web
2013-12-11 11:14:24,302 INFO [com.arjuna.ats.jbossatx.jta.TransactionManagerService] (JBoss Shutdown Hook) Stopping transaction recovery manager
2013-12-11 11:14:24,323 INFO [com.arjuna.ats.jbossatx.jta.TransactionManagerService] (JBoss Shutdown Hook) Destroying TransactionManagerService
2013-12-11 11:14:26,434 INFO [org.jboss.mail.MailService] (JBoss Shutdown Hook) Mail service 'java:/Mail' removed from JNDI
2013-12-11 11:14:43,760 INFO [org.jboss.bootstrap.microcontainer.ServerImpl] (JBoss Shutdown Hook) Shutdown complete
$ TIME="2013-12-11 11:14:24,323"
$ awk -v T="$TIME" '$0 >= T' log
2013-12-11 11:14:24,323 INFO [com.arjuna.ats.jbossatx.jta.TransactionManagerService] (JBoss Shutdown Hook) Destroying TransactionManagerService
2013-12-11 11:14:26,434 INFO [org.jboss.mail.MailService] (JBoss Shutdown Hook) Mail service 'java:/Mail' removed from JNDI
2013-12-11 11:14:43,760 INFO [org.jboss.bootstrap.microcontainer.ServerImpl] (JBoss Shutdown Hook) Shutdown complete
$
Please show exactly what you did when you tried my code -- word for word, letter for letter, keystroke for keystroke. If it doesn't work, probably nothing else will either until we figure out what's changed.
$ tail log4j.log
2014-01-21 12:31:08,051 [http-wspsa99a0036.wellsfargo.com%2F167.138.101.48-6443-3] INFO resourcing.DoubleResourceBundle - No resource bundle found for 'StringTable'
2014-01-21 12:31:08,063 [http-wspsa99a0036.wellsfargo.com%2F167.138.101.48-6443-3] INFO resourcing.DoubleResourceBundle - No resource bundle found for 'StringTable'
2014-01-21 12:31:08,077 [http-wspsa99a0036.wellsfargo.com%2F167.138.101.48-6443-3] INFO resourcing.DoubleResourceBundle - No resource bundle found for 'StringTable'
2014-01-21 12:31:08,085 [http-wspsa99a0036.wellsfargo.com%2F167.138.101.48-6443-3] INFO resourcing.DoubleResourceBundle - No resource bundle found for 'StringTable'
2014-01-21 12:31:12,769 [http-wspsa99a0036.wellsfargo.com%2F167.138.101.48-6443-2] INFO xpath.XPathOptimizer - registerInterceptor com.trax.gateway.util.StatusGranularityOptimizer (1)
2014-01-21 12:31:12,774 [http-wspsa99a0036.wellsfargo.com%2F167.138.101.48-6443-2] INFO xpath.XPathOptimizer - registerInterceptor com.trax.gateway.util.CreationDateToIDMapper (2)
2014-01-21 12:31:13,053 [http-wspsa99a0036.wellsfargo.com%2F167.138.101.48-6443-6] INFO gui.NavigationCachingHelper - Creating instance of NavigationCachingHelper for language 'en'
2014-01-21 12:31:13,087 [http-wspsa99a0036.wellsfargo.com%2F167.138.101.48-6443-2] INFO session.CountFromViewStrategy - Initializing MATERIALIZED VIEW (Synchronous) [GTW_TX ==> TMP_GTW_TX_COUNT_MVE]
2014-01-21 12:31:13,097 [http-wspsa99a0036.wellsfargo.com%2F167.138.101.48-6443-2] INFO session.CountFromViewStrategy - Initializing MATERIALIZED VIEW (Synchronous) [GTW_WFL_EX ==> TMP_GTW_WFL_EX_COUNT_MVE]
2014-01-21 12:31:25,702 [http-wspsa99a0036.wellsfargo.com%2F167.138.101.48-6443-4] WARN impl.CacheManagerImpl - Cache: test.anonymiser.delay not configured, using defaults.
$
$
$ TIME="2014-01-21 12:31:08,087"
$ $AWK -v T="TIME" '{ $0 >= T }' log4j.log
$
$ echo $AWK
/usr/xpg4/bin/awk
$
$ ls -lrt log4j.log
-rw-r--r-- 1 mwjbs mwjbs 1691009 Jan 21 12:31 log4j.log
---------- Post updated at 12:03 AM ---------- Previous update was at 12:02 AM ----------
Whether the problem would be with the permissions of the file??
The permissions are not a problem, the file is world-readable. It would complain 'permission denied' if it couldn't open the file, anyway.
But, you made a typo. Try this:
$AWK -v T="$TIME" '$0 >= T' log4j.log
To be specific: You forgot the $, and you added extra { } which changed the meaning of the program. It must be exactly as shown.
sorry for the mistake
But even after correcting the code there was no o/p
$ tail log4j.log
2014-01-21 12:31:08,051 [http-wspsa99a0036.wellsfargo.com%2F167.138.101.48-6443-3] INFO resourcing.DoubleResourceBundle - No resource bundle found for 'StringTable'
2014-01-21 12:31:08,063 [http-wspsa99a0036.wellsfargo.com%2F167.138.101.48-6443-3] INFO resourcing.DoubleResourceBundle - No resource bundle found for 'StringTable'
2014-01-21 12:31:08,077 [http-wspsa99a0036.wellsfargo.com%2F167.138.101.48-6443-3] INFO resourcing.DoubleResourceBundle - No resource bundle found for 'StringTable'
2014-01-21 12:31:08,085 [http-wspsa99a0036.wellsfargo.com%2F167.138.101.48-6443-3] INFO resourcing.DoubleResourceBundle - No resource bundle found for 'StringTable'
2014-01-21 12:31:12,769 [http-wspsa99a0036.wellsfargo.com%2F167.138.101.48-6443-2] INFO xpath.XPathOptimizer - registerInterceptor com.trax.gateway.util.StatusGranularityOptimizer (1)
2014-01-21 12:31:12,774 [http-wspsa99a0036.wellsfargo.com%2F167.138.101.48-6443-2] INFO xpath.XPathOptimizer - registerInterceptor com.trax.gateway.util.CreationDateToIDMapper (2)
2014-01-21 12:31:13,053 [http-wspsa99a0036.wellsfargo.com%2F167.138.101.48-6443-6] INFO gui.NavigationCachingHelper - Creating instance of NavigationCachingHelper for language 'en'
2014-01-21 12:31:13,087 [http-wspsa99a0036.wellsfargo.com%2F167.138.101.48-6443-2] INFO session.CountFromViewStrategy - Initializing MATERIALIZED VIEW (Synchronous) [GTW_TX ==> TMP_GTW_TX_COUNT_MVE]
2014-01-21 12:31:13,097 [http-wspsa99a0036.wellsfargo.com%2F167.138.101.48-6443-2] INFO session.CountFromViewStrategy - Initializing MATERIALIZED VIEW (Synchronous) [GTW_WFL_EX ==> TMP_GTW_WFL_EX_COUNT_MVE]
2014-01-21 12:31:25,702 [http-wspsa99a0036.wellsfargo.com%2F167.138.101.48-6443-4] WARN impl.CacheManagerImpl - Cache: test.anonymiser.delay not configured, using defaults.
$
$ TIME="2014-01-21 12:31:08,087"
$
$ echo $TIME
2014-01-21 12:31:08,087
$ $AWK -v T="$TIME" '{ $0 >= T }' log4j.log
$
$
You still changed it. You added extra { } which completely altered the meaning of the program. That could have been my fault -- I tend to edit my posts 3 or 4 times after posting, you might have seen a less-than-final version.
Copy and paste this, letter-for-letter:
$AWK -v T="$TIME" '$0 >= T' log4j.log
yes it is working but along with the required output some extra output is also comming. can you please advide on that
env: LD_LIBRARY_PATH=/apps/java/jdk1.6.0_31/jre/lib/sparcv9/server:/apps/java/jdk1.6.0_31/jre/lib/sparcv9:/apps/java/jdk1.6.0_31/jre/../lib/sparcv9:/opt/CA/SharedComponents/ETPKI/../lib:/opt/CA/SharedComponents/lib:/opt/CA/CAlib:/usr/lib:/opt/CA/SharedComponents/Csam/SockAdapter/lib
env: SHELL=/bin/bash
env: PATH=/opt/boksm/bin:/bin:/sbin:/usr/sbin:/usr/ucb:/usr/openwin/bin:/opt/CA/SharedComponents/bin
env: JBOSS_HOME=/apps/jboss/jboss-eap-5.1/jboss-as
env: CABIN=/opt/CA/SharedComponents/bin
env: HOME=/opt/home/mwjbs
env: CSAM_SOCKADAPTER=/opt/CA/SharedComponents/Csam/SockAdapter
env: CASHCOMP=/opt/CA/SharedComponents
env: CSAM_LOGGER_CONF=/opt/CA/SharedComponents/Csam/SockAdapter/cfg/logger.cfg
env: A__z="*TMOUT
env: CA_CAILANGUAGE=enu
env: TZ=EST5EDT
===============================
javax.ejb.EJBException: RuntimeException
Caused by: com.trax.framework.exceptions.GeneralFailureException: com.trax.framework.license.LicenseCheckException: Invalid subsystem MODEL-RMAManagement defined
Caused by: com.trax.framework.license.LicenseCheckException: Invalid subsystem MODEL-RMAManagement defined
javax.ejb.EJBException: RuntimeException
Caused by: com.trax.framework.exceptions.GeneralFailureException: com.trax.framework.license.LicenseCheckException: Invalid subsystem MODEL-RMAManagement defined
Caused by: com.trax.framework.license.LicenseCheckException: Invalid subsystem MODEL-RMAManagement defined
com.trax.framework.exceptions.GeneralFailureException: com.trax.framework.license.LicenseCheckException: Invalid subsystem MODEL-RMAManagement defined
Caused by: com.trax.framework.license.LicenseCheckException: Invalid subsystem MODEL-RMAManagement defined
com.trax.framework.exceptions.RuleEngineException: com.trax.framework.license.LicenseCheckException: Invalid subsystem MODEL-RMAManagement defined, in rule: 'logical-node-recover'[6/6]/'recover-authorizations' (160:com.trax.rma.management.rules.RecoverAuthorizationsRule)
com.trax.framework.thread.ExecutionException: javax.ejb.EJBException: java.rmi.RemoteException: exception wile executing command; nested exception is:
Caused by: javax.ejb.EJBException: java.rmi.RemoteException: exception wile executing command; nested exception is:
Caused by: java.rmi.RemoteException: exception wile executing command; nested exception is:
Caused by: com.trax.framework.thread.ExecutionException: com.trax.framework.exceptions.RuleEngineException: com.trax.framework.license.LicenseCheckException: Invalid subsystem MODEL-RMAManagement defined, in rule: 'logical-node-recover'[6/6]/'recover-authorizations' (160:com.trax.rma.management.rules.RecoverAuthorizationsRule)
Caused by: com.trax.framework.exceptions.RuleEngineException: com.trax.framework.license.LicenseCheckException: Invalid subsystem MODEL-RMAManagement defined, in rule: 'logical-node-recover'[6/6]/'recover-authorizations' (160:com.trax.rma.management.rules.RecoverAuthorizationsRule)
2014-01-21 12:31:12,769 [http-wspsa99a0036.wellsfargo.com%2F167.138.101.48-6443-2] INFO xpath.XPathOptimizer - registerInterceptor com.trax.gateway.util.StatusGranularityOptimizer (1)
2014-01-21 12:31:12,774 [http-wspsa99a0036.wellsfargo.com%2F167.138.101.48-6443-2] INFO xpath.XPathOptimizer - registerInterceptor com.trax.gateway.util.CreationDateToIDMapper (2)
2014-01-21 12:31:13,053 [http-wspsa99a0036.wellsfargo.com%2F167.138.101.48-6443-6] INFO gui.NavigationCachingHelper - Creating instance of NavigationCachingHelper for language 'en'
2014-01-21 12:31:13,087 [http-wspsa99a0036.wellsfargo.com%2F167.138.101.48-6443-2] INFO session.CountFromViewStrategy - Initializing MATERIALIZED VIEW (Synchronous) [GTW_TX ==> TMP_GTW_TX_COUNT_MVE]
2014-01-21 12:31:13,097 [http-wspsa99a0036.wellsfargo.com%2F167.138.101.48-6443-2] INFO session.CountFromViewStrategy - Initializing MATERIALIZED VIEW (Synchronous) [GTW_WFL_EX ==> TMP_GTW_WFL_EX_COUNT_MVE]
2014-01-21 12:31:25,702 [http-wspsa99a0036.wellsfargo.com%2F167.138.101.48-6443-4] WARN impl.CacheManagerImpl - Cache: test.anonymiser.delay not configured, using defaults.
If you don't start wrapping your code in code tags you will receive infractions. That's at least four posts of yours I've had to fix.
I can't tell where that output is coming from because I don't know what your input is. Try $AWK -v T="$TIME" '/^[0-9][0-9][0-9][0-9]/ && ($0 >= T)' log4j.log but if that doesn't work post your input. I am not a mind reader.