Pipeline getting failed sometimes #2868
Comments
|
Hello Team, adding more info and details on the issue as I have been working with customer the pipeline jobs download files from storage account and here we are facing the issue we intermittently get 403 while we do the downloads although we whitelist the IP address of the devops agent in the storage account azcopy version 10.26 2024-11-06T04:36:04.5284500Z + azcopy sync 'https://braunusstagingproducts.blob.core.windows.net/braunstagingproductsdetails?sp=' /home/vsts/work/1/s/ --recursive=true 2024-11-06T04:36:04.5285178Z /home/vsts/work/1/s comparing working and non working scenarios we see that using azcopy version 10.27 we dont see the 403 error one thing to add is that in the pipeline we try to install the latest version of azcopy and we get 10.26 as seen below downloading using this commands Download and extractwget https://aka.ms/downloadazcopy-v10-linux Move AzCopysudo rm -f /usr/bin/azcopy Clean the kitchenrm -f downloadazcopy-v10-linux later we see 2024-11-06T04:30:49.2342636Z can you help us investigate the inconsistency of the azcopy behavior? |
|
@sohamkyagit these logs are from over a week ago (around the time when we were releasing 10.27), are you still experiencing this issue? The latest version that should be downloaded consistently is 10.27.1 |
|
logs_4304700-latest-completed.zip Hello, I have added todays log. Where with in 3 pipeline 1 got failed and 2 got completed I have attached these 3 logs. Please let me know if anything is needed from my end. Thanks, |
|
@gapra-msft good day! have you had the chance to review the logs? I can still see the version of azcopy installed is old one |
|
Hello Team, Is their any update? I have attached the latest logs. Thanks, |
|
Hello, I tried to download the latest version with the below commands. And it was showing the latest version. wget https://aka.ms/downloadazcopy-v10-linux Could you please confirm which azcopy binary is getting executed? Command: which azcopy |
|
Hello team,
Can you please share us your feasible time to connect? So we can connect over the call and sorted out these things.
Please share us your comfortable time.
Thanks & Regards,
Soham Rakshit
LTIMindtree Ltd Contractor working behalf of P&G
Kolkata, India
…________________________________
From: dphulkar-msft ***@***.***>
Sent: 02 December 2024 17:11
To: Azure/azure-storage-azcopy ***@***.***>
Cc: Soham Rakshit ***@***.***>; Mention ***@***.***>
Subject: Re: [Azure/azure-storage-azcopy] Pipeline getting failed sometimes (Issue #2868)
Caution - This email is from an external source. Please do not click on links or attachments if sender is unknown or from known person but the content is unusual. Never share your user ID or password under any circumstances.
Hello,
I tried to download the latest version with the below commands. And it was showing the latest version.
wget https://aka.ms/downloadazcopy-v10-linux
tar -xvf downloadazcopy-v10-linux
Could you please confirm which azcopy binary is getting executed?
Command: which azcopy
This will output the full path of the binary being executed (e.g., /usr/bin/azcopy).
—
Reply to this email directly, view it on GitHub<#2868 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/BIRZYVVPYWB7L6O45BG7NJ32DRBQNAVCNFSM6AAAAABR7FND62VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDKMJRGMYDMMRUGQ>.
You are receiving this because you were mentioned.Message ID: ***@***.***>
________________________________
The contents of this e-mail and any attachment(s) may contain confidential or privileged information for the intended recipient(s). Unintended recipients are prohibited from taking action on the basis of information in this e-mail and using or disseminating the information, and must notify the sender and delete it from their system. LTIMindtree will not accept responsibility or liability for the accuracy or completeness of, or the presence of any virus or disabling code in this e-mail.
|
|
Hello team, Can you please share us your feasible time to connect? So we can connect over the call and sorted out these things. Please share us your comfortable time. |
|
Hello, Could you try installing azcopy with the linux package manager and check once? If you still face the issues, we can connect over the call. Commands to use: |
More details can be found here: https://learn.microsoft.com/en-us/azure/storage/common/storage-use-azcopy-v10?tabs=dnf#install-azcopy-on-linux-by-using-a-package-manager |
|
Hello team, I need to connect with you. Can you please share your feasible time to connect? I will share you the meeting link. Thanks, |
|
Hello team, I'm sharing you the teams meeting invitation to connect on this. Can you please try to join in this meeting and guide me to resolve this issue, please let me know if you are able to join this meeting or we can reschedule this meeting. Thanks, |
|
Hello team, today we have updated as per your suggestion. We will see for 2 days and update you on the same. Thanks, |
logs_4250322 --successfull.zip
logs_4250360 --failed.zip
Hello,
I have shared you the details of some of the logs of the pipelines, which are runs on a daily basis but its was getting failed frequently. Same pipeline if successful today is may failed tomorrow. We didn't do any changes for the pipeline. I have attached the logs for the pipelines can you please look into this on a urgent basis. As this is the production issue.
Thanks,
Soham Rakshit.
The text was updated successfully, but these errors were encountered: