Server freeze after some time (requires restart to work again)
Have you checked memory and CPU usage for the process?
Before getting freeze it use 7-8% ram and 8-10% cpu
After freeze the ram usage remains almost same and cpu usage drop to 1-2 percent
On freeze Over all server have 60%-70% free memory and cpu also free
OS working fine other applications also
No issue in using any other application even when traccar is freeze
I guess you'll need to check jstack thread dump for the process to see what's happening.
i fount this in thread dump
Found one Java-level deadlock:
=============================
"nioEventLoopGroup-3-1":
waiting for ownable synchronizer 0x000000070734bcb8, (a java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync),
which is held by "nioEventLoopGroup-3-2"
"nioEventLoopGroup-3-2":
waiting for ownable synchronizer 0x000000070ca03b38, (a java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync),
which is held by "qtp1003928100-534"
"qtp1003928100-534":
waiting for ownable synchronizer 0x000000070734bcb8, (a java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync),
which is held by "nioEventLoopGroup-3-2"any suggestions how to avoid this, or what's causing this?
Are there full stack traces for those threads?
here is the complete thread dump file link https://files.fm/u/hw2fuuycz
Very interesting. I see this lock:
at org.traccar.api.resource.PermissionsResource.addMultipleProperty(PermissionsResource.java:195)Did you forget to tell us that you are not using official version of Traccar?
sorry I forget to mention.
this function is to link multiple devices to user in single call, same as link single device to user.
I'm unable to understand thread dump file, can you just specify what's cause this deadlock or which part of code/ dump file line, that will be really helpful.
thanks.
I`m get this erro too.
When I run jstack, i get the message:
jstack -l 952
952: Operation not permittedI`m using Ubuntu 20.04 with 4 vcpu and 16 GB memory, this machine run only webserver/web the database run in other vm.
Around 650 devices.
Traccar 5.0 official.
Web old version (official)
The server freeze and I only can access if reboot.
Are you running jstack as a root user?
No, now I run with root and get this:
I don't see any locked threads. What makes you think Traccar freezes?
I don't get log on system...
When I see the syslog doesn`t have something.
When I check traccar log, I see this line:
^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^>I try to change SSD to HDD on VM, but, not work too.
Anton, can you help me?
I tried change ubuntu 20.04 to Debian 10.
But it not work too.
What I see the memory only use max 2g but my ExecStart is:
ExecStart=java -Djdk.tls.client.protocols=TLSv1.2 -Xms3G -Xmx6G -jar tracker-server.jar conf/traccar.xmlJava version
openjdk version "11.0.16" 2022-07-19
OpenJDK Runtime Environment (build 11.0.16+8-post-Debian-1deb10u1)
OpenJDK 64-Bit Server VM (build 11.0.16+8-post-Debian-1deb10u1, mixed mode, sharing)
Hi,
after few hours traccar server freezes, no response to devices and no response to web application, even if i hit api using postman still no response,
i have to kill and restart every time when it freezes
these are the logs.
any suggestions what's causing this, or how can i over come this issue
my server is with 16GB ram and 500GB hard with core i7.