RabbitMQ message consumers stop consuming messagesRedirecting rabbitmq-server log messages to syslogConfigure...

What's the difference between 違法 and 不法?

Are lightweight LN wallets vulnerable to transaction withholding?

How do ground effect vehicles perform turns?

A social experiment. What is the worst that can happen?

Why has "pence" been used in this sentence, not "pences"?

My friend sent me a screenshot of a transaction hash, but when I search for it I find divergent data. What happened?

How do you respond to a colleague from another team when they're wrongly expecting that you'll help them?

When quoting, must I also copy hyphens used to divide words that continue on the next line?

How do I repair my stair bannister?

Is possible to search in vim history?

Frequency of inspection at vegan restaurants

Why does Async/Await work properly when the loop is inside the async function and not the other way around?

How do I implement a file system driver driver in Linux?

What does this horizontal bar at the first measure mean?

Find last 3 digits of this monster number

Could solar power be utilized and substitute coal in the 19th Century

Using a siddur to Daven from in a seforim store

Melting point of aspirin, contradicting sources

MAXDOP Settings for SQL Server 2014

Did arcade monitors have same pixel aspect ratio as TV sets?

Drawing ramified coverings with tikz

Can the Supreme Court overturn an impeachment?

Freedom of speech and where it applies

Translation of Scottish 16th century church stained glass



RabbitMQ message consumers stop consuming messages


Redirecting rabbitmq-server log messages to syslogConfigure HAProxy for rabbitmqway to start and stop RabbitMQ mannuallyMessage Queuing vs. Load Balancing. I don't truly understand the differenceHow can I prevent the proliferation of stale/false RabbitMQ connection objects in the management plugin without upgrading the server?RabbitMQ keeps messages in memory (memory overflow)RabbitMQ not closing dead connections with unacked messagesIncrease max number of consumers on RabbitMQView rabbitmq unacked messageHow to view pending messages in RabbitMQ admin?













0















Our team is in a spike sprint to choose between ActiveMQ or RabbitMQ. We made 2 little producer/consumer spikes sending an object message with an array of 16 strings, a timestamp, and 2 integers. The spikes are ok on our devs machines (messages are well consumed).



Then came the benchs. We first noticed that somtimes, on our machines, when we were sending a lot of messages the consumer was sometimes hanging. It was there, but the messsages were accumulating in the queue.



When we went on the bench plateform :




  • cluster of 2 rabbitmq machines 4 cores/3.2Ghz, 4Gb RAM, load balanced by a VIP

  • one to 6 consumers running on the rabbitmq machines, saving the messages in a mysql DB (same type of machine for the DB)

  • 12 producers running on 12 AS machines (tomcat), attacked with jmeter running on another machine. The load is about 600 to 700 http request per second, on the servlets that produces the same load of RabbitMQ messages.


We noticed that sometimes, consumers hang (well, they are not blocked, but they dont consume messages anymore). We can see that because each consumer save around 100 msg/sec in database, so when one is stopping consumming, the overall messages saved per seconds in DB fall down with the same ratio (if let say 3 consumers stop, we fall around 600 msg/sec to 300 msg/sec).



During that time, the producers are ok, and still produce at the jmeter rate (around 600 msg/sec). The messages are in the queues and taken by the consumers still "alive".



We load all the servlets with the producers first, then launch all the consumers one by one, checking if the connexions are ok, then run jmeter.



We are sending messages to one direct exchange. All consumers are listening to one persistent queue bounded to the exchange.



That point is major for our choice. Have you seen this with rabbitmq, do you have an idea of what is going on ?



Thank you for your answers.










share|improve this question














bumped to the homepage by Community 4 mins ago


This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.




















    0















    Our team is in a spike sprint to choose between ActiveMQ or RabbitMQ. We made 2 little producer/consumer spikes sending an object message with an array of 16 strings, a timestamp, and 2 integers. The spikes are ok on our devs machines (messages are well consumed).



    Then came the benchs. We first noticed that somtimes, on our machines, when we were sending a lot of messages the consumer was sometimes hanging. It was there, but the messsages were accumulating in the queue.



    When we went on the bench plateform :




    • cluster of 2 rabbitmq machines 4 cores/3.2Ghz, 4Gb RAM, load balanced by a VIP

    • one to 6 consumers running on the rabbitmq machines, saving the messages in a mysql DB (same type of machine for the DB)

    • 12 producers running on 12 AS machines (tomcat), attacked with jmeter running on another machine. The load is about 600 to 700 http request per second, on the servlets that produces the same load of RabbitMQ messages.


    We noticed that sometimes, consumers hang (well, they are not blocked, but they dont consume messages anymore). We can see that because each consumer save around 100 msg/sec in database, so when one is stopping consumming, the overall messages saved per seconds in DB fall down with the same ratio (if let say 3 consumers stop, we fall around 600 msg/sec to 300 msg/sec).



    During that time, the producers are ok, and still produce at the jmeter rate (around 600 msg/sec). The messages are in the queues and taken by the consumers still "alive".



    We load all the servlets with the producers first, then launch all the consumers one by one, checking if the connexions are ok, then run jmeter.



    We are sending messages to one direct exchange. All consumers are listening to one persistent queue bounded to the exchange.



    That point is major for our choice. Have you seen this with rabbitmq, do you have an idea of what is going on ?



    Thank you for your answers.










    share|improve this question














    bumped to the homepage by Community 4 mins ago


    This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.


















      0












      0








      0








      Our team is in a spike sprint to choose between ActiveMQ or RabbitMQ. We made 2 little producer/consumer spikes sending an object message with an array of 16 strings, a timestamp, and 2 integers. The spikes are ok on our devs machines (messages are well consumed).



      Then came the benchs. We first noticed that somtimes, on our machines, when we were sending a lot of messages the consumer was sometimes hanging. It was there, but the messsages were accumulating in the queue.



      When we went on the bench plateform :




      • cluster of 2 rabbitmq machines 4 cores/3.2Ghz, 4Gb RAM, load balanced by a VIP

      • one to 6 consumers running on the rabbitmq machines, saving the messages in a mysql DB (same type of machine for the DB)

      • 12 producers running on 12 AS machines (tomcat), attacked with jmeter running on another machine. The load is about 600 to 700 http request per second, on the servlets that produces the same load of RabbitMQ messages.


      We noticed that sometimes, consumers hang (well, they are not blocked, but they dont consume messages anymore). We can see that because each consumer save around 100 msg/sec in database, so when one is stopping consumming, the overall messages saved per seconds in DB fall down with the same ratio (if let say 3 consumers stop, we fall around 600 msg/sec to 300 msg/sec).



      During that time, the producers are ok, and still produce at the jmeter rate (around 600 msg/sec). The messages are in the queues and taken by the consumers still "alive".



      We load all the servlets with the producers first, then launch all the consumers one by one, checking if the connexions are ok, then run jmeter.



      We are sending messages to one direct exchange. All consumers are listening to one persistent queue bounded to the exchange.



      That point is major for our choice. Have you seen this with rabbitmq, do you have an idea of what is going on ?



      Thank you for your answers.










      share|improve this question














      Our team is in a spike sprint to choose between ActiveMQ or RabbitMQ. We made 2 little producer/consumer spikes sending an object message with an array of 16 strings, a timestamp, and 2 integers. The spikes are ok on our devs machines (messages are well consumed).



      Then came the benchs. We first noticed that somtimes, on our machines, when we were sending a lot of messages the consumer was sometimes hanging. It was there, but the messsages were accumulating in the queue.



      When we went on the bench plateform :




      • cluster of 2 rabbitmq machines 4 cores/3.2Ghz, 4Gb RAM, load balanced by a VIP

      • one to 6 consumers running on the rabbitmq machines, saving the messages in a mysql DB (same type of machine for the DB)

      • 12 producers running on 12 AS machines (tomcat), attacked with jmeter running on another machine. The load is about 600 to 700 http request per second, on the servlets that produces the same load of RabbitMQ messages.


      We noticed that sometimes, consumers hang (well, they are not blocked, but they dont consume messages anymore). We can see that because each consumer save around 100 msg/sec in database, so when one is stopping consumming, the overall messages saved per seconds in DB fall down with the same ratio (if let say 3 consumers stop, we fall around 600 msg/sec to 300 msg/sec).



      During that time, the producers are ok, and still produce at the jmeter rate (around 600 msg/sec). The messages are in the queues and taken by the consumers still "alive".



      We load all the servlets with the producers first, then launch all the consumers one by one, checking if the connexions are ok, then run jmeter.



      We are sending messages to one direct exchange. All consumers are listening to one persistent queue bounded to the exchange.



      That point is major for our choice. Have you seen this with rabbitmq, do you have an idea of what is going on ?



      Thank you for your answers.







      benchmark rabbitmq






      share|improve this question













      share|improve this question











      share|improve this question




      share|improve this question










      asked Jul 19 '10 at 20:51









      Bruno ThomasBruno Thomas

      1012




      1012





      bumped to the homepage by Community 4 mins ago


      This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.







      bumped to the homepage by Community 4 mins ago


      This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
























          1 Answer
          1






          active

          oldest

          votes


















          0














          I have seen this behavior when using the RabbitMQ STOMP plugin. I haven't found a solution yet.



          Are you using the STOMP plugin?






          share|improve this answer























            Your Answer








            StackExchange.ready(function() {
            var channelOptions = {
            tags: "".split(" "),
            id: "2"
            };
            initTagRenderer("".split(" "), "".split(" "), channelOptions);

            StackExchange.using("externalEditor", function() {
            // Have to fire editor after snippets, if snippets enabled
            if (StackExchange.settings.snippets.snippetsEnabled) {
            StackExchange.using("snippets", function() {
            createEditor();
            });
            }
            else {
            createEditor();
            }
            });

            function createEditor() {
            StackExchange.prepareEditor({
            heartbeatType: 'answer',
            autoActivateHeartbeat: false,
            convertImagesToLinks: true,
            noModals: true,
            showLowRepImageUploadWarning: true,
            reputationToPostImages: 10,
            bindNavPrevention: true,
            postfix: "",
            imageUploader: {
            brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
            contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
            allowUrls: true
            },
            onDemand: true,
            discardSelector: ".discard-answer"
            ,immediatelyShowMarkdownHelp:true
            });


            }
            });














            draft saved

            draft discarded


















            StackExchange.ready(
            function () {
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f161971%2frabbitmq-message-consumers-stop-consuming-messages%23new-answer', 'question_page');
            }
            );

            Post as a guest















            Required, but never shown

























            1 Answer
            1






            active

            oldest

            votes








            1 Answer
            1






            active

            oldest

            votes









            active

            oldest

            votes






            active

            oldest

            votes









            0














            I have seen this behavior when using the RabbitMQ STOMP plugin. I haven't found a solution yet.



            Are you using the STOMP plugin?






            share|improve this answer




























              0














              I have seen this behavior when using the RabbitMQ STOMP plugin. I haven't found a solution yet.



              Are you using the STOMP plugin?






              share|improve this answer


























                0












                0








                0







                I have seen this behavior when using the RabbitMQ STOMP plugin. I haven't found a solution yet.



                Are you using the STOMP plugin?






                share|improve this answer













                I have seen this behavior when using the RabbitMQ STOMP plugin. I haven't found a solution yet.



                Are you using the STOMP plugin?







                share|improve this answer












                share|improve this answer



                share|improve this answer










                answered Jul 26 '10 at 0:28







                user49311





































                    draft saved

                    draft discarded




















































                    Thanks for contributing an answer to Server Fault!


                    • Please be sure to answer the question. Provide details and share your research!

                    But avoid



                    • Asking for help, clarification, or responding to other answers.

                    • Making statements based on opinion; back them up with references or personal experience.


                    To learn more, see our tips on writing great answers.




                    draft saved


                    draft discarded














                    StackExchange.ready(
                    function () {
                    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f161971%2frabbitmq-message-consumers-stop-consuming-messages%23new-answer', 'question_page');
                    }
                    );

                    Post as a guest















                    Required, but never shown





















































                    Required, but never shown














                    Required, but never shown












                    Required, but never shown







                    Required, but never shown

































                    Required, but never shown














                    Required, but never shown












                    Required, but never shown







                    Required, but never shown







                    Popular posts from this blog

                    As a Security Precaution, the user account has been locked The Next CEO of Stack OverflowMS...

                    Список ссавців Італії Природоохоронні статуси | Список |...

                    Українські прізвища Зміст Історичні відомості |...