Issue after upgrading to 4.2 server from traccar-3.17
You should probably check logs.
There no any relevant log for system off plz chek this log file
Hi Anton
There any solution for this because we are stuck in this problem. Server working stop after some time interval.
Your log is too big. You need to extract relevant parts.
Hello Anton,
Thank you for the reply. We have dig into logs and find below errors throughout the logs. And i think any of them not the service killer issue. Correct me if i am wrong.
Please help me to debug this issue further. From last 24 hours, it keep stopping every time after 45 minutes to 1 hour.
Logs:
2018-12-16 14:15:23 WARN: [a5a4b686] error - Connection reset by peer - IOException (...)
2018-12-16 14:15:28 WARN: Attribute computation error - org.traccar.processing.ComputedAttributesHandler.computeAttribute@91![1,6]: '(alarm && alarm == 'sos')? 'Hydraulic UP' : alarm;' undefined variable alarm - Variable (... < ComputedAttributesHandler:91 < *:102 < BaseDataHandler:27 < ... < *:29 < ... < *:29 < ... < *:29 < ...)
2018-12-16 14:15:36 WARN: Attribute computation error - org.traccar.processing.ComputedAttributesHandler.computeAttribute@91![1,6]: '(alarm && alarm == 'sos')? 'Hydraulic UP' : alarm;' undefined variable alarm - Variable (... < ComputedAttributesHandler:91 < *:102 < BaseDataHandler:27 < ... < *:29 < ... < *:29 < ... < *:29 < ...)
2018-12-16 14:15:36 WARN: Attribute computation error - org.traccar.processing.ComputedAttributesHandler.computeAttribute@91![1,6]: '(alarm && alarm == 'sos')? 'Hydraulic UP' : alarm;' undefined variable alarm - Variable (... < ComputedAttributesHandler:91 < *:102 < BaseDataHandler:27 < ... < *:29 < ... < *:29 < ... < *:29 < ...)
2018-12-16 14:15:44 WARN: [dafe0a22] error - Connection reset by peer - IOException (...)
2018-12-16 14:15:44 WARN: Attribute computation error - org.traccar.processing.ComputedAttributesHandler.computeAttribute@91![0,5]: 'alarm == 'sos'? 'FUEL CAP is OPEN' : 'FUEL CAP is CLOSE';' undefined variable alarm - Variable (... < ComputedAttributesHandler:91 < *:102 < BaseDataHandler:27 < ... < *:29 < ... < *:29 < ... < *:29 < ...)
2018-12-16 14:15:58 WARN: Attribute computation error - org.traccar.processing.ComputedAttributesHandler.computeAttribute@91![0,5]: 'alarm == 'sos'? 'FUEL CAP is OPEN' : 'FUEL CAP is CLOSE';' undefined variable alarm - Variable (... < ComputedAttributesHandler:91 < *:102 < BaseDataHandler:27 < ... < *:29 < ... < *:29 < ... < *:29 < ...)
2018-12-16 14:16:01 WARN: Attribute computation error - org.traccar.processing.ComputedAttributesHandler.computeAttribute@91![1,6]: '(alarm && alarm == 'sos')? 'Hydraulic UP' : alarm;' undefined variable alarm - Variable (... < ComputedAttributesHandler:91 < *:102 < BaseDataHandler:27 < ... < *:29 < ... < *:29 < ... < *:29 < ...)
2018-12-16 14:16:05 WARN: [7e8cfe10] error - Connection reset by peer - IOException (...)
2018-12-16 14:16:08 WARN: Attribute computation error - org.traccar.processing.ComputedAttributesHandler.computeAttribute@1:124 parsing error near '... uel)) ...' - Parsing (... < ComputedAttributesHandler:91 < *:102 < BaseDataHandler:27 < ... < *:29 < ... < *:29 < ... < *:29 < ...)
2018-12-16 14:16:16 WARN: [e3bf60ae] error - Connection timed out - IOException (...)
2018-12-16 14:16:18 WARN: Attribute computation error - org.traccar.processing.ComputedAttributesHandler.computeAttribute@91![1,6]: '(alarm && alarm == 'sos')? 'Hydraulic UP' : alarm;' undefined variable alarm - Variable (... < ComputedAttributesHandler:91 < *:102 < BaseDataHandler:27 < ... < *:29 < ... < *:29 < ... < *:29 < ...)
2018-12-16 14:16:20 WARN: Attribute computation error - org.traccar.processing.ComputedAttributesHandler.computeAttribute@91![0,5]: 'alarm == 'sos'? 'FUEL CAP is OPEN' : 'FUEL CAP is CLOSE';' undefined variable alarm - Variable (... < ComputedAttributesHandler:91 < *:102 < BaseDataHandler:27 < ... < *:29 < ... < *:29 < ... < *:29 < ...)
2018-12-16 14:16:22 WARN: Attribute computation error - org.traccar.processing.ComputedAttributesHandler.computeAttribute@91![0,5]: 'alarm == 'sos'? 'FUEL CAP is OPEN' : 'FUEL CAP is CLOSE';' undefined variable alarm - Variable (... < ComputedAttributesHandler:91 < *:102 < BaseDataHandler:27 < ... < *:29 < ... < *:29 < ... < *:29 < ...)
2018-12-16 14:16:35 WARN: Attribute computation error - org.traccar.processing.ComputedAttributesHandler.computeAttribute@91![1,6]: '(alarm && alarm == 'sos')? 'Hydraulic UP' : alarm;' undefined variable alarm - Variable (... < ComputedAttributesHandler:91 < *:102 < BaseDataHandler:27 < ... < *:29 < ... < *:29 < ... < *:29 < ...)
2018-12-16 14:16:40 WARN: Attribute computation error - org.traccar.processing.ComputedAttributesHandler.computeAttribute@91![1,6]: '(alarm && alarm == 'sos')? 'Hydraulic UP' : alarm;' undefined variable alarm - Variable (... < ComputedAttributesHandler:91 < *:102 < BaseDataHandler:27 < ... < *:29 < ... < *:29 < ... < *:29 < ...)
2018-12-16 14:16:46 WARN: Attribute computation error - org.traccar.processing.ComputedAttributesHandler.computeAttribute@91![0,5]: 'alarm == 'sos'? 'FUEL CAP is OPEN' : 'FUEL CAP is CLOSE';' undefined variable alarm - Variable (... < ComputedAttributesHandler:91 < *:102 < BaseDataHandler:27 < ... < *:29 < ... < *:29 < ... < *:29 < ...)
2018-12-16 14:16:57 WARN: Attribute computation error - org.traccar.processing.ComputedAttributesHandler.computeAttribute@91![1,6]: '(alarm && alarm == 'sos')? 'Hydraulic UP' : alarm;' undefined variable alarm - Variable (... < ComputedAttributesHandler:91 < *:102 < BaseDataHandler:27 < ... < *:29 < ... < *:29 < ... < *:29 < ...)
2018-12-16 14:17:00 WARN: Attribute computation error - org.traccar.processing.ComputedAttributesHandler.computeAttribute@91![0,5]: 'alarm == 'sos'? 'FUEL CAP is OPEN' : 'FUEL CAP is CLOSE';' undefined variable alarm - Variable (... < ComputedAttributesHandler:91 < *:102 < BaseDataHandler:27 < ... < *:29 < ... < *:29 < ... < *:29 < ...)
2018-12-16 14:17:07 WARN: Attribute computation error - org.traccar.processing.ComputedAttributesHandler.computeAttribute@1:124 parsing error near '... uel)) ...' - Parsing (... < ComputedAttributesHandler:91 < *:102 < BaseDataHandler:27 < ... < *:29 < ... < *:29 < ... < *:29 < ...)Those errors are not related to your problem, but you should probably fix your computed attributes.
Hello Anton,
Thanks for the response. You are absolutely correct that these logs not indicate any error that cause traccar shutdown.
And yes, I need to fix the computed attributes also.
But I still stuck with the server shutdown issue.
traccar Server has 1200 tracker device
server specs:
8 GB
4 Core
Ubuntu 16.04
DB: mysql (mysql Ver 14.14 Distrib 5.7.24, for Linux (x86_64) using EditLine wrapper)
Also, these server was working seamlessly with traccar-3.17 perfectly.
Once we updated to 4.2, it keep stopping every 1 hours time frame.
I have also observer RAM and CPU utilisation and looks no overload also.
Need your guidance for further debugging as i stuck badly. I here pasted the system logs also.
Can it be related to java or mysql version or configuration compatibility with traccar-4.2?
Would any other logs help you to suggest me the issue and fix?
Regards,
Parth
system logs from /var/log/syslog:
Dec 18 03:17:12 ubuntu-2gb-nyc3-01 systemd[1]: traccar.service: Service hold-off time over, scheduling restart.
Dec 18 03:17:12 ubuntu-2gb-nyc3-01 systemd[1]: Stopped traccar.
Dec 18 03:17:12 ubuntu-2gb-nyc3-01 systemd[1]: Started traccar.
Dec 18 03:17:13 ubuntu-2gb-nyc3-01 traccar[30158]: Tue Dec 18 03:17:13 UTC 2018 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification.
Dec 18 03:17:13 ubuntu-2gb-nyc3-01 traccar[30158]: message repeated 9 times: [ Tue Dec 18 03:17:13 UTC 2018 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification.]
Dec 18 03:17:14 ubuntu-2gb-nyc3-01 traccar[30158]: Tue Dec 18 03:17:14 UTC 2018 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification.
Dec 18 03:17:18 ubuntu-2gb-nyc3-01 traccar[30158]: WARNING: An illegal reflective access operation has occurred
Dec 18 03:17:18 ubuntu-2gb-nyc3-01 traccar[30158]: WARNING: Illegal reflective access by com.google.inject.internal.cglib.core.$ReflectUtils$1 (file:/opt/traccar/lib/guice-4.2.1.jar) to method java.lang.ClassLoader.defineClass(java.lang.String,byte[],int,int,java.security.ProtectionDomain)
Dec 18 03:17:18 ubuntu-2gb-nyc3-01 traccar[30158]: WARNING: Please consider reporting this to the maintainers of com.google.inject.internal.cglib.core.$ReflectUtils$1
Dec 18 03:17:18 ubuntu-2gb-nyc3-01 traccar[30158]: WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
Dec 18 03:17:18 ubuntu-2gb-nyc3-01 traccar[30158]: WARNING: All illegal access operations will be denied in a future release
Dec 18 03:18:11 ubuntu-2gb-nyc3-01 CRON[29864]: (CRON) info (No MTA installed, discarding output)
Dec 18 03:39:01 ubuntu-2gb-nyc3-01 CRON[31742]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && /usr/lib/php/sessionclean)
Dec 18 03:46:34 ubuntu-2gb-nyc3-01 traccar[30158]: Tue Dec 18 03:46:34 UTC 2018 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification.
Dec 18 03:46:57 ubuntu-2gb-nyc3-01 traccar[30158]: Tue Dec 18 03:46:57 UTC 2018 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification.
Dec 18 03:46:59 ubuntu-2gb-nyc3-01 traccar[30158]: Tue Dec 18 03:46:59 UTC 2018 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification.
Dec 18 03:47:00 ubuntu-2gb-nyc3-01 traccar[30158]: Tue Dec 18 03:47:00 UTC 2018 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification.
Dec 18 03:47:01 ubuntu-2gb-nyc3-01 traccar[30158]: Tue Dec 18 03:47:01 UTC 2018 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, Dec 18 04:09:01 ubuntu-2gb-nyc3-01 CRON[13648]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && /usr/lib/php/sessionclean)
o 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification.
Dec 18 04:16:48 ubuntu-2gb-nyc3-01 traccar[30158]: Tue Dec 18 04:16:48 UTC 2018 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification.
Dec 18 04:16:57 ubuntu-2gb-nyc3-01 traccar[30158]: Tue Dec 18 04:16:57 UTC 2018 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification.
Dec 18 04:17:01 ubuntu-2gb-nyc3-01 CRON[26442]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Dec 18 04:17:12 ubuntu-2gb-nyc3-01 systemd[1]: traccar.service: Service hold-off time over, scheduling restart.
Dec 18 04:17:12 ubuntu-2gb-nyc3-01 systemd[1]: Stopped traccar.
Dec 18 04:17:12 ubuntu-2gb-nyc3-01 systemd[1]: Started traccar.Have you implemented suggestions from the optimization guide?
Yes Anton,
I have applied all the changes except java.maxmemory setting, as kept it default. Still the server stop after 44 minutes.
Below is the java memory state:
/opt/traccar/jre/bin/java -XX:+PrintFlagsFinal -version | grep -iE 'HeapSize|PermSize|ThreadStackSize'
intx CompilerThreadStackSize = 1024 {pd product} {default}
size_t ErgoHeapSizeLimit = 0 {product} {default}
size_t HeapSizePerGCThread = 87241520 {product} {default}
size_t InitialHeapSize = 132120576 {product} {ergonomic}
size_t LargePageHeapSizeThreshold = 134217728 {product} {default}
size_t MaxHeapSize = 2092957696 {product} {ergonomic}
uintx NonNMethodCodeHeapSize = 5830092 {pd product} {ergonomic}
uintx NonProfiledCodeHeapSize = 122914074 {pd product} {ergonomic}
uintx ProfiledCodeHeapSize = 122914074 {pd product} {ergonomic}
intx ThreadStackSize = 1024 {pd product} {default}
intx VMThreadStackSize = 1024 {pd product} {default}
openjdk version "10.0.2-ojdkbuild" 2018-07-17
OpenJDK Runtime Environment (build 10.0.2-ojdkbuild+13)
OpenJDK 64-Bit Server VM (build 10.0.2-ojdkbuild+13, mixed mode)Regards.
Hello Anton,
Any guidance for further debugging? I still haven't able to solve the issue.
Thanks,
Parth
Not really. You need to find out the root cause. Otherwise we can only guess.
Traccar server stop after every one hour .