Profile Image
arcow

Need Advice! Will decrease in qps affect Nginx server to go down?

 some nginx servers  are the  proxy for my java servers(with tomcat).  Suddenly my java servers qps from 15000 qps/s to 5000 qps/s  and the nginx servers' log showed that a timeout,the healthy check showed that cannot connect the port 80 of the java servers. some minutes later ,the server recovery to the 15000 qps/s? the problem time is near  8:35.so i provided the log



Report URL - https://gceasy.io/my-gc-report.jsp?p=c2hhcmVkLzIwMjEvMDUvMTEvLS1nYy50eHQtLTMtMjYtMA==&channel=WEB

  • serverdown

  • javaservers

  • tomcat

  • serverrecovery

  • nginx

Please Sign In or to post your comment or answer

Profile Image

Ram Lakshmanan

Hello acrow!

 

 Greetings.

 

 Right around 8:35 there is multiple GC events running. When GC event runs, it pauses your application. All the GC events which ran around 8:35 are pausing your application for 400 - 500ms, as shown in the graph:

 

 

 This clearly explains why your application's qps dropped from 15,000 to 5,000. Also one more observation is: your application's GC throughput is 95.38%.This is a poor throughput. This can cause degeneration in the application's performance. You should consider optimizing your GC performance. 

 

 Here is a video talk, which might get you started on the GC tuning. 

Profile Image

arcow

thank you!It's helpful.

Got something else on mind? Post Your Question

Not the answer you're looking for? Browse other questions tagged

  • serverdown

  • javaservers

  • tomcat

  • serverrecovery

  • nginx

Edit your question

Separate with comma, space or ENTER key. Special characters are not allowed in tag.

Edit your Answer

Edit your Comment