(Non-technical readers of my blog, you'll want to glaze past this entry. This is a case where I encountered a problem, scoured the net for any clues and, finding none, slogged on forever until finally solving it. I'm writing this entry because I've found that the last couple of times I've solved an obscure computer problem, if I posted my solution in my blog then the entry would accumulate lots of comments saying "Thanks so much. I was really stuck on this.")
So, to state the problem we encountered...
We've got a JBoss application that makes pretty heavy use of MDB (message drive beans) to manage tasks. Our JBoss server talks to another proprietary server (via HTTP mostly) and the status of many tasks depends on whether that other server reports it is ready or finished or whatever.
Essentially, we have a fair number of MDBs that kick off other MDBs using JMS messages.
The problem was that we discovered the JBoss server was "accumulating" hundreds if not thousands of threads until eventually the server would die from resource starvation. (OutOfMemory error in this case.)
We looked at the stack traces of these threads to get an idea of what was going on. This has been made possible as of JBoss 4.0.2 via the jmx-console and the ServerInfo JMX MBean. (Note: you have to be running JBoss under a Java 1.5 JVM. That doesn't mean your code has to be Java 1.5, as ours isn't)
What we found was hundreds of pairs of threads running UIL2.SocketManager.ReadTask and UIL2.SocketManager.WriteTask. Where the ReadTasks were blocking in java.net.SocketInputStream.socketRead0 and the WriteTasks were waiting via java.lang.Object.wait.
So here's the magic clue I'm going to give that I sure wish someone else had posted on the web earlier. This behavior happens if your JBoss code doesn't close its QueueSession and QueueConnection objects. Actually, it may be one or the other; I found in our code that we hadn't called close() on either and the garbage collector was obviously not closing them for me.
All these zombie threads had apparently been created by JBoss's JMS/MQ system to facilitate reading messages from a JMS sender, and these threads were never knowing to terminate themselves, even when we'd been finished consuming the messages on the server-side.
Hope this helps anyone else in a similar situation! Write a comment if it has.
Posted by Murray Todd Williams at August 24, 2005 02:19 PMI was experiencing exactly the same thing. We were rapidly developing a product prototype to determine whether J2EE is a suitabel technology for teh application which we are seeking to develop. The prototype has a message driven architecture, with 1000's of messages being sent as we performed our tests.
Sure enough, we had the same problem - JBoss would accumulate ~5000 threads then die. We are all reletaive J2EE novices, so it was not until I found this blog post that a solution was found.
Many thanks Murray.
Colin E.
Posted by: Colin E. at September 6, 2005 02:25 PMhttp://lesbian-picture.asstraffic-top.com
http://lesbians-for-free.asstraffic-top.com
http://lesbian-orgasmic-videospictures.asstraffic-top.com
http://big-tit-blonde-lesbians-fucking.asstraffic-top.com
http://lesbian-panty-videos.asstraffic-top.com
http://lesbian-in-sex.asstraffic-top.com
http://lesbians-naked-girls.asstraffic-top.com
http://lesbian-thumbnails-free.asstraffic-top.com
http://teen-lesbian-free-movies.asstraffic-top.com
http://adult-videos-lesbian.asstraffic-top.com
http://dating-tips-for-lesbian-singles.asstraffic-top.com
http://lesbian-sex-free-porn.asstraffic-top.com
http://teenie-lesbian-galleries.asstraffic-top.com
http://lesbain-personals.asstraffic-top.com
http://free-lesbian-spanking-pics.asstraffic-top.com
http://sexy-lesbians-of-europe.asstraffic-top.com
http://bondage-lesbian.asstraffic-top.com
http://dirty-fucking-lesbians.asstraffic-top.com
http://lesbian-group-videos.asstraffic-top.com
http://free-tennis-court-lesbians-pics.asstraffic-top.com
http://free-erotic-lesbian-sex-stories.asstraffic-top.com
http://free-lesbian-dominatrix-sex-picks.asstraffic-top.com
http://free-lesbian-licking-pictures.asstraffic-top.com
http://lesbian-sex-pics-tgp.asstraffic-top.com
http://lesbians-caught-having-sex.asstraffic-top.com
http://online-stories-of-lesbian-seduction.asstraffic-top.com
http://lesbains-gallery.asstraffic-top.com
http://lesbain-orgasims.asstraffic-top.com
http://how-to-lick-a-pussy.asstraffic-top.com
http://free-lesbain-porn-vidios.asstraffic-top.com
http://mature-lesbians-pics.asstraffic-top.com
http://xxx-lesbain-stories.asstraffic-top.com
http://sisters-in-the-struggle-lesbian.asstraffic-top.com
http://free-sexy-lesbian-pics.asstraffic-top.com
http://asian-lesbians-in-pantyhose.asstraffic-top.com
http://lesbain-personals.asstraffic-top.com
http://sexy-hot-itchy-lesbians.asstraffic-top.com
http://lick-cum-from-pussy.asstraffic-top.com
http://dildo-lesbians.asstraffic-top.com
http://mature-amateur-lesbians.asstraffic-top.com
http://lick-own-pussy.asstraffic-top.com
http://free-lesbian-dildo-porn.asstraffic-top.com
http://girls-lick-their-own-pussy.asstraffic-top.com
http://lesbian-video-downloads.asstraffic-top.com
http://lesbian-strapon-sex.asstraffic-top.com
http://lesbian-sex-sample-video-clips.asstraffic-top.com
http://lesbian-hardcore-tongue-action.asstraffic-top.com
http://lesbians-kissing-each-other.asstraffic-top.com
http://lesbo-group-orgy.asstraffic-top.com
http://blonde-lesbian-videofree.asstraffic-top.com
http://bald-lesbian-squirting-free-porn-thumbnailed-gallery.asstraffic-top.com
http://stories-about-teen-lesbians.asstraffic-top.com
http://free-lesbian-stories-or-pictures.asstraffic-top.com
http://free-lesbian-sex-site.asstraffic-top.com
http://lesbian-domination.asstraffic-top.com
http://uga-nude-college-girls.asstraffic-top.com
http://black-on-black-lesbian-fucking.asstraffic-top.com
http://video-lesbian-porn-watch-on-internet-no-hidden-fees.asstraffic-top.com
http://horny-lesbian-orgy.asstraffic-top.com
http://lesbian-and-erotic-and-stories.asstraffic-top.com
http://filipino-lesbian-xxx.asstraffic-top.com
http://free-arab-lesbian-sex-pictures.asstraffic-top.com
http://lesbain-wet-cunts.asstraffic-top.com
http://zemanova-lesbo-gallery.asstraffic-top.com
http://lesbian-bedtime-stories.asstraffic-top.com
http://lesbian-chat-room-orlando.asstraffic-top.com
http://lesbain-nude.asstraffic-top.com
http://free-stories-lesbian-feet-socks.asstraffic-top.com
http://free-lesbian-mpeg-videos.asstraffic-top.com
http://lesbian-labia-pussy-pics.asstraffic-top.com
http://college-girls-g-strings.asstraffic-top.com
http://we-live-together-dina.asstraffic-top.com
http://lick-my-pussy-video.asstraffic-top.com
http://lesbain-stories-free-lesbian.asstraffic-top.com
http://lesbian-sex-storeis.asstraffic-top.com
http://hentai-lesbian-pussy.asstraffic-top.com
http://celebrity-kissing-lesbian.asstraffic-top.com
http://free-chubby-lesbian-pics.asstraffic-top.com
http://college-girls-exposed.asstraffic-top.com
http://nude-college-girls-and-downloads.asstraffic-top.com
http://free-lesbian-hentai-pictures.asstraffic-top.com
http://erotic-lesbian-chat-rooms.asstraffic-top.com
http://lesbian-video-download.asstraffic-top.com
http://lesbian-and-sex-and-free.asstraffic-top.com
http://gays-and-lesbians.asstraffic-top.com
http://free-fucking-lesbian-thumbs.asstraffic-top.com
http://hot-teen-lesbians.asstraffic-top.com
http://innocent-year-old-vs-mature-lesbians.asstraffic-top.com
http://ebony-lesbian-pussy-galleries.asstraffic-top.com
http://nude-lesbian-pics.asstraffic-top.com
http://spanking-photos-lesbian.asstraffic-top.com
http://free-lesbian-pussy-movies.asstraffic-top.com
http://tomb-raider-lesbian-pics.asstraffic-top.com
http://free-sexy-lesbian-ecards.asstraffic-top.com
http://free-lesbian-pussy-licking-porn.asstraffic-top.com
http://hot-sexy-lesbian-pics.asstraffic-top.com
http://oral-lesbian-sex.asstraffic-top.com
http://lesbianas-galerias.asstraffic-top.com
http://lesbos-sucking-nipples.asstraffic-top.com
http://anime-lesbian-sex-movies-free-sample.asstraffic-top.com
http://free-lesbian-pic-gallery.asstraffic-top.com
http://pics-lesbian-free.asstraffic-top.com
http://why-dog-lick-pussy.asstraffic-top.com
http://we-live-together-thumbnails.asstraffic-top.com
http://free-lesbian-teen-sex-stories.asstraffic-top.com
http://lesbian-pussy-extenders.asstraffic-top.com
http://free-welivetogether.asstraffic-top.com
http://free-shaved-lesbian-sex.asstraffic-top.com
http://lucy-lui-lesbian-kiss.asstraffic-top.com
http://japanese-lesbians-french-kissing-videos.asstraffic-top.com
http://encyclopdia-of-lesbian-movies.asstraffic-top.com
http://we-live-together-galleries.asstraffic-top.com
http://lesbian-kissing-and-licking-videos.asstraffic-top.com
http://naughty-college-girls-6.asstraffic-top.com
http://isle-of-lesbos.asstraffic-top.com
http://teen-lesbian-movies.asstraffic-top.com
http://twin-sister-lesbians.asstraffic-top.com
http://porn-free-xxx-lesbians-breasts-cunts-anal-orgies.asstraffic-top.com
http://free-pictures-of-lesbians-licking-each-other.asstraffic-top.com
http://black-lesbian-tgp.asstraffic-top.com
http://lesbian-sex-mpeg-trailers.asstraffic-top.com
http://free-lesbian-bisexual-sex-pics.asstraffic-top.com
http://free-naked-photos-of-lesbians.asstraffic-top.com
http://lesbian-lover.asstraffic-top.com
http://lesbian-fuck-videos.asstraffic-top.com
http://lesbian-group-videos.asstraffic-top.com
http://we-live-together-and-in-the-vip.asstraffic-top.com
http://free-sample-lesbian-sex-videos.asstraffic-top.com
http://free-lesbian-hunter-stream-teen-sex.asstraffic-top.com
http://lesbians-amateur-kissing.asstraffic-top.com
http://free-welivetogether-mpegs.asstraffic-top.com
http://lactating-black-lesbians.asstraffic-top.com
http://lesbian-elms-scenes-movies.asstraffic-top.com
http://free-sample-lesbian-sex-videos.asstraffic-top.com
http://hot-lesbian-oral-free-galleries.asstraffic-top.com
http://mature-lesbians-pics.asstraffic-top.com
http://teen-lesbos.asstraffic-top.com
http://lick-my-pussy-and-my-crack-lyrics.asstraffic-top.com
http://college-girls-naked.asstraffic-top.com
http://lesbian-woman-pics.asstraffic-top.com
http://free-first-time-lesbian-stories.asstraffic-top.com
http://free-lesbian-domination-mpegs.asstraffic-top.com
http://lesbian-shower.asstraffic-top.com
http://lesbians-kissing-fingering.asstraffic-top.com
http://where-can-i-find-lesbian-chat-rooms.asstraffic-top.com
http://black-lesbian-tgp-gallerie.asstraffic-top.com
http://lesbian-pussy-dildo.asstraffic-top.com
http://teen-lesbians-in-pantyhose.asstraffic-top.com
http://spanking-the-lusty-lesbian.asstraffic-top.com
http://teen-lesbian-videos.asstraffic-top.com