Another error from Biztalk (tweaking)...:((
Yesterday April 10th, 2005. I've been called to solve an error in the production biztalk server.
The symptoms was like this:
1. There's a client want to access an orchestration through web services, sometimes the request success and sometimes produce an error.
2. The error message found in event viewer was Biztalk fail to connect to BiztalkMsgBoxDb, general network error.
Looking through the error message in the eventviewer, it is somewhat same like the anoying ADO.NET error, that has many entries when you search in googles...:(.
So by then I pop up the sql query analyzer and log into SQL server, run the sp_who2 active, and what I saw was unbelievable....there are many connection from BiztalkServer and the operation was blocked by a Biztalk SQL Job...:O..(what the...).
The SQL Job run very long and blocked almost all the operation from BiztalkServer to the database. After make sure that if I kill the job will not affected another proccess, I kill the job, and suddenly all the error operation run smoothly ...(fiuh...:p).
To prevent the problem from reccuring in the future. I inspect all the Biztalk SQL job and I found it very interesting. Almost all the Biztalk SQL Job was scheduled to run every minutes, every days, from 12:00:00 PM to 11:59:59 AM, which means the Job will work on most of the company peak hours(08:00:00 AM - 11:30:00 AM). That's explained the result I found that the request before and after the peak hour to the orchestration web services usually success and request in the peak hours usually fail. I then rescheduled the affected jobs to run everyday, every minutes, at 12:00:00 PM to 05:00:00 AM
So, by then I realized that the Biztalk Installation was not provide us an environment that ready to run in production environment, we should tweaked/tuned/optimized it to run properly in the production.
Today April 11th, 2005. I started an optimization/tuning the Biztalk Server. I will try to write what I found and the optimization steps in another blog soon.
The symptoms was like this:
1. There's a client want to access an orchestration through web services, sometimes the request success and sometimes produce an error.
2. The error message found in event viewer was Biztalk fail to connect to BiztalkMsgBoxDb, general network error.
Looking through the error message in the eventviewer, it is somewhat same like the anoying ADO.NET error, that has many entries when you search in googles...:(.
So by then I pop up the sql query analyzer and log into SQL server, run the sp_who2 active, and what I saw was unbelievable....there are many connection from BiztalkServer and the operation was blocked by a Biztalk SQL Job...:O..(what the...).
The SQL Job run very long and blocked almost all the operation from BiztalkServer to the database. After make sure that if I kill the job will not affected another proccess, I kill the job, and suddenly all the error operation run smoothly ...(fiuh...:p).
To prevent the problem from reccuring in the future. I inspect all the Biztalk SQL job and I found it very interesting. Almost all the Biztalk SQL Job was scheduled to run every minutes, every days, from 12:00:00 PM to 11:59:59 AM, which means the Job will work on most of the company peak hours(08:00:00 AM - 11:30:00 AM). That's explained the result I found that the request before and after the peak hour to the orchestration web services usually success and request in the peak hours usually fail. I then rescheduled the affected jobs to run everyday, every minutes, at 12:00:00 PM to 05:00:00 AM
So, by then I realized that the Biztalk Installation was not provide us an environment that ready to run in production environment, we should tweaked/tuned/optimized it to run properly in the production.
Today April 11th, 2005. I started an optimization/tuning the Biztalk Server. I will try to write what I found and the optimization steps in another blog soon.
