Devices timed-out and disconnected from the server

Dear forum members,
I had about 17 different devices connected to the server, some of them are using H02 and some others watch protocols. I noticed at the time that all of these devices were disconnecting each after another from the server and all these 17 devices were timed-out and then disconnected in 4 minutes, but I made sure that all devices were online and none of them turned-off at that specific time.

During device disconnection, I also noticed in the log that a connection to the firebase is also being time-out and notifications are not being sent.

I am sharing the logs for your information as below:

2022-09-19 14:37:16  INFO: [Ta3f01520] id: 8800000004, command type: positionSingle sent
2022-09-19 14:37:16  INFO: [Ta3f01520: watch > 20.14.13.210] 5b53472a383830303030303030342a303030322a43525d
2022-09-19 14:37:41  INFO: [Te21d2770] timed out
2022-09-19 14:37:41  INFO: [Te21d2770] disconnected
2022-09-19 14:38:17  INFO: [T54fde7f5] timed out
2022-09-19 14:38:17  INFO: [T54fde7f5] disconnected
2022-09-19 14:38:45  INFO: user: 306, report: events, from: 2022-08-20 14:38, to: 2022-09-19 14:38, devices: [-1], groups: []
2022-09-19 14:38:45  INFO: user: 306, report: events, from: 2022-08-20 14:38, to: 2022-09-19 14:38, devices: [952], groups: []
2022-09-19 14:38:48  INFO: [T89a2c85c] timed out
2022-09-19 14:38:48  INFO: [T89a2c85c] disconnected
2022-09-19 14:38:53  INFO: [Tcc0acd73] timed out
2022-09-19 14:38:53  INFO: [Tcc0acd73] disconnected
2022-09-19 14:38:56  INFO: [Td9794c6e] timed out
2022-09-19 14:38:56  INFO: [Td9794c6e] disconnected
2022-09-19 14:39:05  INFO: [T70eb653e] timed out
2022-09-19 14:39:05  INFO: [T70eb653e] disconnected
2022-09-19 14:39:07  INFO: [Tcba87f48] timed out
2022-09-19 14:39:07  INFO: [Tcba87f48] disconnected
2022-09-19 14:39:08  INFO: [T81c5323e] timed out
2022-09-19 14:39:08  INFO: [T81c5323e] disconnected
2022-09-19 14:39:10  INFO: [T3ecd7613] timed out
2022-09-19 14:39:10  INFO: [T3ecd7613] disconnected
2022-09-19 14:39:26  INFO: user: 306, action: login, from: 91.97.97.44
2022-09-19 14:39:27  INFO: [Td0a5d097] timed out
2022-09-19 14:39:27  INFO: [Td0a5d097] disconnected
2022-09-19 14:39:34  INFO: [Ta3f01520] timed out
2022-09-19 14:39:34  INFO: [Ta3f01520] disconnected
2022-09-19 14:39:49  INFO: [Te1d00c35] timed out
2022-09-19 14:39:49  INFO: [Te1d00c35] disconnected
2022-09-19 14:40:08  INFO: [T769f2e2a] timed out
2022-09-19 14:40:08  INFO: [T769f2e2a] disconnected
2022-09-19 14:40:13  INFO: user: 306, report: events, from: 2022-08-20 14:40, to: 2022-09-19 14:40, devices: [-1], groups: []
2022-09-19 14:40:13  INFO: user: 306, report: events, from: 2022-08-20 14:40, to: 2022-09-19 14:40, devices: [952], groups: []
2022-09-19 14:40:39  INFO: [T1678f300] timed out
2022-09-19 14:40:39  INFO: [T1678f300] disconnected
2022-09-19 14:40:51  INFO: [Ta86b79c4] timed out
2022-09-19 14:40:51  INFO: [Ta86b79c4] disconnected
2022-09-19 14:40:57  WARN: Notification failed - Connection timed out (Connection timed out) - ConnectException (... < NotificatorFirebase:86 < NotificationManager:104 < ... < *:101 < ... < *:100 < *:124 < ConnectionManager:315 < ...)
2022-09-19 14:40:57  WARN: Failed to get notificator
2022-09-19 14:40:57  WARN: You are using null notificatior, please check your configuration, notification not sent
2022-09-19 14:40:57  WARN: Failed to get notificator
2022-09-19 14:40:57  WARN: You are using null notificatior, please check your configuration, notification not sent
2022-09-19 14:41:07  INFO: [Tc6849b4e] timed out
2022-09-19 14:41:07  INFO: [Tc6849b4e] disconnected
2022-09-19 14:41:24  INFO: [Tae5f08ea] timed out
2022-09-19 14:41:24  INFO: [Tae5f08ea] disconnected
2022-09-19 14:41:43  INFO: user: 306, report: events, from: 2022-08-20 14:41, to: 2022-09-19 14:41, devices: [-1], groups: []
2022-09-19 14:41:44  INFO: user: 306, report: events, from: 2022-08-20 14:41, to: 2022-09-19 14:41, devices: [952], groups: []
2022-09-19 14:43:08  WARN: Notification failed - Connection timed out (Connection timed out) - ConnectException (... < NotificatorFirebase:86 < NotificationManager:104 < ... < *:101 < ... < *:100 < *:124 < ConnectionManager:315 < ...)
2022-09-19 14:43:08  WARN: Failed to get notificator
2022-09-19 14:43:08  WARN: You are using null notificatior, please check your configuration, notification not sent
2022-09-19 14:43:23  INFO: user: 306, action: login, from: 91.97.97.44

For a short time I thought maybe the internet connection of server has been lost, but then noted that I am still connected to the same server through SSH and was reading the logs.

Any help to find the cause for this or prevent it in the future will be highly appreciated.

Maybe you need to increase or disable the timeout?

I'm encountering constant timeout and disconnection messages from Teltonika devices in my Traccar server logs, such as the following:

INFO: [XXXXXX] timed out  
INFO: [XXXXXX] disconnected

I wanted to ask if frequent timeouts and disconnections could potentially lead to issues with the MySQL server, particularly affecting the Hikari connection pool. After a while, I start seeing HikariPool errors in my logs.

Could these device timeout/disconnection issues be contributing to the pool exhaustion? If so, are there any recommended configuration changes (e.g., timeouts, pool size, etc.) to mitigate this?

Could these device timeout/disconnection issues be contributing to the pool exhaustion?

No.