The downloaded log delay issue

[cheunal]

Hello Team,

I have used logdownloader script which is available in GitHub but Script fetching older logs from the ncapsula.

We can still see in the log the log file is download and processing completed successfully, but when we open the log file , the logs inside is keep delay and we cannot fetch the latest log.

Any advise that we can enhance the performance?

[G4fanhoto]

Good morning, anyone facing log delay problems?

I have late logs ranging from 7 days

Hello @imperva Any solution ????

[joeymoore]

Hello @G4fanhoto ,
Can you elaborate on where the "late" logs are? Are delays from the logs API or are they sitting on your machine that is downloading the logs?

[joeymoore]

@G4fanhoto please let me know if this is still an issue. A new 3.0.0 release is available and resolves a lot of known issues. Please review the readme if planning to upgrade.
https://github.com/imperva/incapsula-logs-downloader/tree/release-3.0.0-beta

[G4fanhoto]

@G4fanhoto please let me know if this is still an issue. A new 3.0.0 release is available and resolves a lot of known issues. Please review the readme if planning to upgrade. https://github.com/imperva/incapsula-logs-downloader/tree/release-3.0.0-beta

Good afternoon my friend, how are you ?

I still keep getting logs that are 7 days overdue. Is there any setting to adjust?

[joeymoore]

@G4fanhoto can you please confirm which version of the script you are using? 3.0 will have little to know delay in processing the logs. Logs in general will take 10-30mins to publish. Cheers

[G4fanhoto]

@G4fanhoto can you please confirm which version of the script you are using? 3.0 will have little to know delay in processing the logs. Logs in general will take 10-30mins to publish. Cheers

Good morning friend, how are you?
Could you help me understand why my logs are always two days late?

[G4fanhoto]

Yes my version 3.0

[joeymoore]

@G4fanhoto, I can't find the script to be at fault here but can you send me the script log? Are you seeing any error messages? Try to see if there is an exogenous issue that we're not seeing. I also poked PM to look into this.

[G4fanhoto]

@joeymoore

Good afternoon, I noticed in the download logs that my file is in index (847), with a total index of 73769.

I notice that it is slow to download, due to the amount of logs that are arriving.

[G4fanhoto]

I still have delays in collections
start=1708449963553