Dealing with DeployIt Timer problem

I hate it when it occurs but got to face this every few days when the number of deployments are high. We run our deployments through a DeployIt plugin off Jenkins and sometimes get the following error in the logs.

[ERROR]: Task failed.
[ERROR]: nl.javadude.t2bus.BusException: java.lang.IllegalStateException: Timer already cancelled.
[ERROR]:  at nl.javadude.t2bus.event.strategy.ThrowingEventHandlerStrategy.handleInvocationTargetException(ThrowingEventHandlerStrategy.java:11)
[ERROR]:  at nl.javadude.t2bus.event.strategy.BaseEventHandlerStrategy.handle(BaseEventHandlerStrategy.java:19)
[ERROR]:  at nl.javadude.t2bus.T2Bus.handle(T2Bus.java:373)
[ERROR]:  at nl.javadude.t2bus.T2Bus.dispatch(T2Bus.java:359)
[ERROR]:  at nl.javadude.t2bus.T2Bus.dispatchQueuedEvents(T2Bus.java:341)
[ERROR]:  at nl.javadude.t2bus.T2Bus.post(T2Bus.java:275)
[ERROR]:  at nl.javadude.t2bus.T2Bus.post(T2Bus.java:298)
[ERROR]:  at com.xebialabs.deployit.engine.tasker.EventBusAdapter.post(EventBusAdapter.java:22)
[ERROR]:  at com.xebialabs.deployit.engine.tasker.TaskExecutionContext.publish(TaskExecutionContext.java:71)
[ERROR]:  at com.xebialabs.deployit.engine.tasker.TaskRunner.setTaskState(TaskRunner.java:255)
[ERROR]:  at com.xebialabs.deployit.engine.tasker.TaskRunner.setTaskState(TaskRunner.java:259)
[ERROR]:  at com.xebialabs.deployit.engine.tasker.TaskRunner.run(TaskRunner.java:72)
[ERROR]:  at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
[ERROR]:  at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
[ERROR]:  at java.util.concurrent.FutureTask.run(FutureTask.java:166)
[ERROR]:  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[ERROR]:  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[ERROR]:  at java.lang.Thread.run(Thread.java:722)
[ERROR]: Caused by: java.lang.IllegalStateException: Timer already cancelled.
[ERROR]:  at java.util.Timer.sched(Timer.java:397)
[ERROR]:  at java.util.Timer.schedule(Timer.java:193)
[ERROR]:  at com.xebialabs.deployit.engine.tasker.TaskRecoveryTrigger.startWritingTimer(TaskRecoveryTrigger.java:65)
[ERROR]:  at com.xebialabs.deployit.engine.tasker.TaskRecoveryTrigger.taskStateChanged(TaskRecoveryTrigger.java:53)
[ERROR]:  at com.xebialabs.deployit.engine.tasker.EventBusAdapter$EventListenerAdapter.taskStateChanged(EventBusAdapter.java:67)
[ERROR]:  at sun.reflect.GeneratedMethodAccessor94.invoke(Unknown Source)
[ERROR]:  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[ERROR]:  at java.lang.reflect.Method.invoke(Method.java:601)
[ERROR]:  at nl.javadude.t2bus.EventHandler.handleEvent(EventHandler.java:88)
[ERROR]:  at nl.javadude.t2bus.SynchronizedEventHandler.handleEvent(SynchronizedEventHandler.java:48)
[ERROR]:  at nl.javadude.t2bus.event.strategy.BaseEventHandlerStrategy.handle(BaseEventHandlerStrategy.java:15)
[ERROR]:  ... 16 more

The only way so far I have seen to fix this for the time being is to shutdown DeployIt and restart the service. Do take a note to kill the DeployIt service if it doesn't quit gracefully.

Now while you are at it, you might want to back up and clean out the temporary work folders. Made my day. I would post once I get a proper solution from XebiaLabs.

[Update]: The issue has been fixed in DeployIt 3.9.3 with a hotfix (DEPLOYITPB-4904).

Comments

Post a Comment

Popular posts from this blog

Quick Image/Restore a Linux Installation

I have been dealing with a lot of image creation and restoration lately and that's when I came across an article to restore a backup in a certain format at one of our cloud providers. The article can be found here . Now one part of the problem was resolved i.e. restoring server backups from the cloud. The other problem started when requests started coming in to create such backups at our other providers so as to be able to restore them later. Then one fine morning the cloud provider supporting the backup mentioned suddenly drops it in favor of OVF. I then went ahead and created a simple set of commands to create a backup of a Linux installation and use the steps in the article above to restore it. A few things before I start. The backup/restore will work only for same flavor of Linux. Do not restore a Debian on a CentOS system. The kernel versions should match, due to possible better features at boot level. And here we go. Taking a backup. Login into your...
Read more

Trying to be hands-on after an eon...

It's been quite sometime I have developed something from scratch. While my primary experience has been around product development, these past couple years have been the usual application maintenance. Boring at times, pretty predictable. I miss the risks, the forte of innovation and a larger vision. It's been almost 7 months since I finished grad school at GeorgiaTech, boy those times. My days at work since then have been crazy, with WFH the days have dragged longer at times. Well, my team puts in their 200%, a great team I got. but somewhere I still miss being myself. I can talk hours on technologies, but some of the latest I may struggle to rig something up. So out on the terrace on a winter afternoon, I decide to go back to roots. I never left coding all these years, why not just keep going at it. The fuel for my line of work is knowledge, knowledge of whats introduced. So its going to be a fun mess, while chalk up something for the upcoming days. I would be back at completin...
Read more

Job Satisfaction: Myth or Reality

Last week I was at for my SSB interview for commission in the Indian Army. Well I was Not Recommended for 2nd straight time, but this is not about the interview. That is going to come in a later post. What I want to talk about is the mentality of the Indian common man, and quite frankly of an Army officer. All is about Job Satisfaction. It's been more than 60 years we got independence, but the Indian mindset has still not changed. It still is some 40 years backward. Coming straight to the point, I was interviewed by very senior officers in the Army, of the rank of Lieutenant Colonel and above. All of them asked me about my current job and the reason to join the Army. My answer was a simple "Personal ambition and passion". But somehow it wasn't taken. Everyone asked me about Job Satisfaction, was I satisfied with my job or not. The answer to that was a rude "I believe in satisfying the job, rather than seek job satisfaction". Frankly, in today's era job s...
Read more