Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • Users
  • Groups
  • Search
  • Get Qt Extensions
  • Unsolved
Collapse
Brand Logo
  1. Home
  2. Qt Development
  3. Installation and Deployment
  4. Qt Maintenance Tool Failed to download metadata.
Forum Updated to NodeBB v4.3 + New Features

Qt Maintenance Tool Failed to download metadata.

Scheduled Pinned Locked Moved Unsolved Installation and Deployment
15 Posts 5 Posters 7.3k Views 2 Watching
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • F flashmozzg

    @JKSH I usually go with some random mirror and I think it always worked before. Now I have to manually "uncheck" half of the repos for obsolete qt version for maintenance tool to work.
    It looks like it somehow manages to "overload" my network with huge amount of requests (even regular pages can have trouble loading while qt mt tries to fetch metadata) but it's the only program that does that.

    0_1517747021847_qtmt.png

    JKSHJ Offline
    JKSHJ Offline
    JKSH
    Moderators
    wrote on last edited by
    #6

    @flashmozzg said in Qt Maintenance Tool Failed to download metadata.:

    I usually go with some random mirror and I think it always worked before.

    Some mirrors are better for you than others, so I wonder if you just picked some bad ones recently...

    Try the master.qt.io mirror. Does that let you finish downloading metadata without having to uncheck the "temporary repositories"?

    Qt Doc Search for browsers: forum.qt.io/topic/35616/web-browser-extension-for-improved-doc-searches

    F 1 Reply Last reply
    1
    • JKSHJ JKSH

      @flashmozzg said in Qt Maintenance Tool Failed to download metadata.:

      I usually go with some random mirror and I think it always worked before.

      Some mirrors are better for you than others, so I wonder if you just picked some bad ones recently...

      Try the master.qt.io mirror. Does that let you finish downloading metadata without having to uncheck the "temporary repositories"?

      F Offline
      F Offline
      flashmozzg
      wrote on last edited by
      #7

      @JKSH said in Qt Maintenance Tool Failed to download metadata.:

      @flashmozzg said in Qt Maintenance Tool Failed to download metadata.:

      I usually go with some random mirror and I think it always worked before.

      Some mirrors are better for you than others, so I wonder if you just picked some bad ones recently...

      Try the master.qt.io mirror. Does that let you finish downloading metadata without having to uncheck the "temporary repositories"?

      After a few tries and after I've unchecked "use temp repos only" I think It finally worked. Not sure if it will last. Also this option is grayed out now so I'm not sure what to do to enable it back. Definitely not a pleasant experience.

      1 Reply Last reply
      0
      • T Offline
        T Offline
        troste
        wrote on last edited by
        #8

        I got the same problem. To me it looks like the problem is at the server side.
        It don't have the meta data to download. So it times out.
        Looking at the network traffic it goes down to zero when for the to time out.

        For sure the problem is not on my network or my installation. I reinstalled windows 10 and started the installer with the same result.

        If someone could help me I would be real happy.
        Or tell me a way to get Qt5.9.4 for windows 10 offline version.

        Regards

        Trond

        jsulmJ 1 Reply Last reply
        0
        • T troste

          I got the same problem. To me it looks like the problem is at the server side.
          It don't have the meta data to download. So it times out.
          Looking at the network traffic it goes down to zero when for the to time out.

          For sure the problem is not on my network or my installation. I reinstalled windows 10 and started the installer with the same result.

          If someone could help me I would be real happy.
          Or tell me a way to get Qt5.9.4 for windows 10 offline version.

          Regards

          Trond

          jsulmJ Offline
          jsulmJ Offline
          jsulm
          Lifetime Qt Champion
          wrote on last edited by
          #9

          @troste Try this tool to select another repository: https://github.com/JKSH/QtSdkRepoChooser
          I hope one day the official installer will provide this functionality (as far as I know there is already a change request for this).

          https://forum.qt.io/topic/113070/qt-code-of-conduct

          1 Reply Last reply
          2
          • F Offline
            F Offline
            flashmozzg
            wrote on last edited by flashmozzg
            #10

            @jsulm said in Qt Maintenance Tool Failed to download metadata.:

            @troste Try this tool to select another repository: https://github.com/JKSH/QtSdkRepoChooser
            I hope one day the official installer will provide this functionality (as far as I know there is already a change request for this).

            Unfortunately it rarely helps in my case (right now I've already spent an hour trying to update QTC to 4.6.0 and it worked once, forced me to updated the isntaller first and restart and now it's not working again), so I assume it's not really a solution.
            Also, my repo setting don't look like this:
            alt text

            I have hundreds of stale Qt repos that are added with each new Qt version I install that are not deleted after I remove them from my PC. It literally takes me hours to deselect them all to just try if the new mirror works:

            0_1522257382983_9e41ccb5-3eba-4747-9aaa-6a984414c3ad-image.png

            jsulmJ 1 Reply Last reply
            0
            • F flashmozzg

              @jsulm said in Qt Maintenance Tool Failed to download metadata.:

              @troste Try this tool to select another repository: https://github.com/JKSH/QtSdkRepoChooser
              I hope one day the official installer will provide this functionality (as far as I know there is already a change request for this).

              Unfortunately it rarely helps in my case (right now I've already spent an hour trying to update QTC to 4.6.0 and it worked once, forced me to updated the isntaller first and restart and now it's not working again), so I assume it's not really a solution.
              Also, my repo setting don't look like this:
              alt text

              I have hundreds of stale Qt repos that are added with each new Qt version I install that are not deleted after I remove them from my PC. It literally takes me hours to deselect them all to just try if the new mirror works:

              0_1522257382983_9e41ccb5-3eba-4747-9aaa-6a984414c3ad-image.png

              jsulmJ Offline
              jsulmJ Offline
              jsulm
              Lifetime Qt Champion
              wrote on last edited by
              #11

              @JKSH any idea?

              https://forum.qt.io/topic/113070/qt-code-of-conduct

              JKSHJ 1 Reply Last reply
              0
              • jsulmJ jsulm

                @JKSH any idea?

                JKSHJ Offline
                JKSHJ Offline
                JKSH
                Moderators
                wrote on last edited by JKSH
                #12

                @flashmozzg said in Qt Maintenance Tool Failed to download metadata.:

                I have hundreds of stale Qt repos that are added with each new Qt version I install that are not deleted after I remove them from my PC. It literally takes me hours to deselect them all to just try if the new mirror works

                @jsulm said in Qt Maintenance Tool Failed to download metadata.:

                @JKSH any idea?

                It looks like the MaintenanceTool has 2 distinct stages:

                1. Download metadata -- This is always done through download.qt.io.
                2. Download actual libraries -- This is normally done through an automatically-selected mirror.

                The Qt SDK Repo Chooser lets us override #2, but it doesn't affect #1. Currently, #1 is inefficient because it involves 2391 HTTP GET requests to download tiny metadata files, so that's a lot of room for failure. This problem is felt the worst on Windows because Windows has the most packages available (multiple versions of MSVC, MinGW, Android, UWP). In contrast, Linux has fewer packages (GCC, Android) and only requires 1205 HTTP GET requests. (Numbers obtained via Wireshark today)

                I think @flashmozzg's issue is that the connection between his PC and download.qt.io is flaky. This means it's unlikely for him to successfully complete all 2000+ GET requests in one run. Deselecting the repos helps because it reduces the number of GET requests. They are not "stale repos" per se -- they are all the repos for every version of Qt out there, not just the ones you installed before. Unfortunately, all the repos are enabled by default and there's currently no way of mass-deselecting them, so this is painful process.

                The metadata download process needs improvement -- all those metadata files really shouldn't be downloaded individually. Things will be much better if the metadata is transmitted as one large file, or if the tool can be configured to only fetch a subset of metadata (e.g. skip Android and UWP packages)

                I'll write up something to send to the Qt engineers.

                EDIT: @flashmozzg, may I ask which country you currently live in?

                Qt Doc Search for browsers: forum.qt.io/topic/35616/web-browser-extension-for-improved-doc-searches

                F 1 Reply Last reply
                3
                • M Offline
                  M Offline
                  mchinand
                  wrote on last edited by
                  #13

                  Is it possible to only download the metadata files if they are newer than the most recent request (e.g., using conditional requests). This would be especially useful when doing 'Check for Updates' followed by 'Add or Remove Components'.

                  1 Reply Last reply
                  0
                  • JKSHJ JKSH

                    @flashmozzg said in Qt Maintenance Tool Failed to download metadata.:

                    I have hundreds of stale Qt repos that are added with each new Qt version I install that are not deleted after I remove them from my PC. It literally takes me hours to deselect them all to just try if the new mirror works

                    @jsulm said in Qt Maintenance Tool Failed to download metadata.:

                    @JKSH any idea?

                    It looks like the MaintenanceTool has 2 distinct stages:

                    1. Download metadata -- This is always done through download.qt.io.
                    2. Download actual libraries -- This is normally done through an automatically-selected mirror.

                    The Qt SDK Repo Chooser lets us override #2, but it doesn't affect #1. Currently, #1 is inefficient because it involves 2391 HTTP GET requests to download tiny metadata files, so that's a lot of room for failure. This problem is felt the worst on Windows because Windows has the most packages available (multiple versions of MSVC, MinGW, Android, UWP). In contrast, Linux has fewer packages (GCC, Android) and only requires 1205 HTTP GET requests. (Numbers obtained via Wireshark today)

                    I think @flashmozzg's issue is that the connection between his PC and download.qt.io is flaky. This means it's unlikely for him to successfully complete all 2000+ GET requests in one run. Deselecting the repos helps because it reduces the number of GET requests. They are not "stale repos" per se -- they are all the repos for every version of Qt out there, not just the ones you installed before. Unfortunately, all the repos are enabled by default and there's currently no way of mass-deselecting them, so this is painful process.

                    The metadata download process needs improvement -- all those metadata files really shouldn't be downloaded individually. Things will be much better if the metadata is transmitted as one large file, or if the tool can be configured to only fetch a subset of metadata (e.g. skip Android and UWP packages)

                    I'll write up something to send to the Qt engineers.

                    EDIT: @flashmozzg, may I ask which country you currently live in?

                    F Offline
                    F Offline
                    flashmozzg
                    wrote on last edited by flashmozzg
                    #14

                    @JKSH said in Qt Maintenance Tool Failed to download metadata.:

                    EDIT: @flashmozzg, may I ask which country you currently live in?

                    Russia. One thing to note: I think it's not only/just the number of GETs but that they all happen simultaneously that overloads my network somehow. My webpages can even briefly stop loading when Qt MT "does its thing". And it usually works fine from my Uni net (but at home I've only ever experienced this problem with the maintenance tool and it was on different connections and different PCs, so it could be my ISP reacting poorly or something) though I haven't tried in a long time, maybe I was just lucky.

                    Btw, in any case spawning thousand of GETs per second is no good and I'm pretty sure it's reaching several OS limits (like max tcp connections).

                    JKSHJ 1 Reply Last reply
                    1
                    • F flashmozzg

                      @JKSH said in Qt Maintenance Tool Failed to download metadata.:

                      EDIT: @flashmozzg, may I ask which country you currently live in?

                      Russia. One thing to note: I think it's not only/just the number of GETs but that they all happen simultaneously that overloads my network somehow. My webpages can even briefly stop loading when Qt MT "does its thing". And it usually works fine from my Uni net (but at home I've only ever experienced this problem with the maintenance tool and it was on different connections and different PCs, so it could be my ISP reacting poorly or something) though I haven't tried in a long time, maybe I was just lucky.

                      Btw, in any case spawning thousand of GETs per second is no good and I'm pretty sure it's reaching several OS limits (like max tcp connections).

                      JKSHJ Offline
                      JKSHJ Offline
                      JKSH
                      Moderators
                      wrote on last edited by
                      #15

                      @flashmozzg said in Qt Maintenance Tool Failed to download metadata.:

                      Russia. One thing to note: I think it's not only/just the number of GETs but that they all happen simultaneously that overloads my network somehow. My webpages can even briefly stop loading when Qt MT "does its thing"...

                      Btw, in any case spawning thousand of GETs per second is no good and I'm pretty sure it's reaching several OS limits (like max tcp connections).

                      Hmm... I'm quite sure that QNetworkAccessManager only allows 6 simultaneous GETS; if more are requested, they get put in a queue until one of the 6 finish.

                      I can't explain why your webpages stop loading though. I experience slow metadata downloads (it takes a few minutes for me), but I normally just let MaintenanceTool do its thing in the background while I browse other sites.

                      Anyway, I've written to the Qt devs about this, and also about other issues relating to the online installer. Anyone who's interested can join in at:

                      • http://lists.qt-project.org/pipermail/development/2018-April/032461.html (If you want to post, you must subscribe to the Development mailing list
                      • https://bugreports.qt.io/browse/QTIFW-975 (you can post using your Qt Account)

                      Qt Doc Search for browsers: forum.qt.io/topic/35616/web-browser-extension-for-improved-doc-searches

                      1 Reply Last reply
                      3

                      • Login

                      • Login or register to search.
                      • First post
                        Last post
                      0
                      • Categories
                      • Recent
                      • Tags
                      • Popular
                      • Users
                      • Groups
                      • Search
                      • Get Qt Extensions
                      • Unsolved