AzCopy Download is Broken Due to Dead MSFT Link

[mosullivan93]

Describe the bug

In the AzCopy v10.32.0 release notes (link), they note that they intend to stop support for AzCopy download URLs hosted via Azure Front Door. We noticed today that one of our pipelines is failing and traced the cause back to this. Not sure if you can get them to change their mind, but I'm assuming not.

There is experience in Azure CLI with overcoming this issue once before (see #30640), and there is now even a back up URL tried as of #30712. Currently, the backup URLs all point to the Front Door URL, so they are also failing.

Can the install_azcopy function please be updated (permalink to current tip of dev)?

It would also be nice if you could change the existing aka.ms URLs to point to the new hosting location of AzCopy, otherwise there is no currently available version of Azure CLI that can self-download AzCopy.

Workaround

As noted in the original issue the first time download of AzCopy broke (#30625), if azcopy is available on the PATH (or, presumably, in the current directory of the process running az), and it is at least version 10.13.0 (this is defined here, and here), then no download would be attempted. So, the workaround would be to install AzCopy earlier in your pipeline, if at all possible (original comment).

Related command

N/A

Errors

N/A

Issue script & Debug output

N/A

Expected behavior

N/A

Environment Summary

N/A

Additional context

Sorry, I would love to add more details, but I'm submitting after hours as I don't use GitHub at work. Also, this one is really simple to reproduce: just go to the existing link under https://azcopyvnext-awgzd8g7aagqhzhe.b02.azurefd.net/.

[yonzhan]

Thank you for opening this issue, we will look into it.

[ichesa]

I confirm this is happening to me as well. As already said, this is affecting all versions of the AZ CLI, and there is not a chance of self-download of AzCopy now, so it is a global issue currently. Please, those links should be working since any new usages of the az CLI commands involved for this kind of operation, like it usually occurs with the pipelines, will not stop failing because of this, and this is a matter of urgency depending on each scenario.

[ivthentschel]

Same problem happens in our deployment pipeline. We are currently blocked rolling out new features. Any ideas of a work around?
Steps to reproduce: docker run -it mcr.microsoft.com/azure-cli

root [ / ]# az storage blob sync --source ./someFolder --container "someContainer" --account-name someAccountName --auth-mode key --account-key "someKey" --delete-destination false

This command is in preview and under development. Reference and support levels: https://aka.ms/CLI_refstatus
Positional argument '<EXTRA_OPTIONS>' is experimental and under development. Reference and support levels: https://aka.ms/CLI_refstatus
Azcopy not found, installing at /root/.azure/bin/azcopy
There is an error downloading from the url: https://azcopyvnext-awgzd8g7aagqhzhe.b02.azurefd.net/release20211027/azcopy_linux_amd64_10.13.0.tar.gz
There is an error downloading from the url: https://aka.ms/InstallAzCopyForCLILinux
Downloading AzCopy from None
The command failed with an unexpected error. Here is the traceback:
'NoneType' object has no attribute 'timeout'
Traceback (most recent call last):
  File "/usr/lib64/az/lib/python3.12/site-packages/knack/cli.py", line 233, in invoke
    cmd_result = self.invocation.execute(args)
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
....
  File "/usr/lib/python3.12/urllib/request.py", line 215, in urlopen
    return opener.open(url, data, timeout)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/urllib/request.py", line 505, in open
    req.timeout = timeout
    ^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'timeout'
To check existing issues, please visit: https://github.com/Azure/azure-cli/issues

[mosullivan93]

@ichesa, @ivthentschel

I've edited my original report to include the workaround. It is the same as last time this happened. You need to make azcopy available beforehand to avoid the need for az to attempt to install it. In my situation, this is not possible, but your mileage may vary.