[solved] DevNet API disabled for a while
-
We got an abnormal amount of "API calls":http://bugreports.qt.nokia.com/browse/QTWEBSITE-137 during the last few days. To preserve the site performance for everyone we decided to disable the API for a little while. We know why we got this load and it should be sorted soon(tm). I'll post here when we know more.
Also we blocked 11 IPs today for very high traffic, they will be unblocked shortly now that we know what hit us. :)
Update: A new version of the API "has been released":http://developer.qt.nokia.com/forums/viewthread/5451/P30/#38130 and it's open again.
-
Hi Marius,
Just wondering what was it?
-
It was probably an issue with the chrome plug-in, Vass is on it. We compared notes on IRC earlier and I think a bugfix there should solve it. No kittens were harmed in this experiment.
-
Ah, that's why clicking the extension this morning did not do much.
Talking about kitten, found an injured jaguar that was hit by a car last weekend when driving home.
-
[quote author="ucomesdag" date="1303824601"]
Talking about kitten, found an injured jaguar that was hit by a car last weekend when driving home.[/quote]Surely an old Mac that was crashed? What a pity!
-
[quote author="Volker" date="1303826154"]
[quote author="ucomesdag" date="1303824601"]
Talking about kitten, found an injured jaguar that was hit by a car last weekend when driving home.[/quote]Surely an old Mac that was crashed? What a pity![/quote]
Lol, no this one was furry and a bit bigger then your regular kitten :) , too big for petting.
A veterinary brought it to the local zoo, so I guess it will be alright.
-
[quote author="ucomesdag" date="1303824601"]
Talking about kitten, found an injured jaguar that was hit by a car last weekend when driving home.[/quote]Wow!
Im glad, living in a country where jaquars are only been seen in a zoo. :)
-
correct.
I also like looking at them, if there is some fence between me and them :-)
-
I hope I didn't cause any excess traffic to the API URLs. You should be able to tell from the user-agent string though. My client is set to poll the profile once every 60 secs whilst I am developing it.
I am slowly getting closer to a 0.1 release...just having to gain some experience with QML on my way.
-
As mariusg told, some people did get an ip-ban. :) So when you still can post without changing your ip, i dont think its you who causes the problem.
-
Well I am getting a Forbidden response from the server but that might be due to the global disabling of the API rather than an IP-specific access restriction.
-
i think so too
-
[quote author="ZapB" date="1303853614"]Well I am getting a Forbidden response from the server but that might be due to the global disabling of the API rather than an IP-specific access restriction.[/quote]
Yep, the front end server will return a "403 Forbidden" on API urls until we're back at sane levels.
-
[quote author="vinb" date="1303840005"]
[quote author="ucomesdag" date="1303824601"]
Talking about kitten, found an injured jaguar that was hit by a car last weekend when driving home.[/quote]Wow!
Im glad, living in a country where jaquars are only been seen in a zoo. :)
[/quote]I am sad that I live in a country where most species of animal can only be seen in a zoo, and not in the wild. That includes jaguars.
-
[quote author="Andre" date="1303908659"]
[quote author="vinb" date="1303840005"]
[quote author="ucomesdag" date="1303824601"]
Talking about kitten, found an injured jaguar that was hit by a car last weekend when driving home.[/quote]Wow!
Im glad, living in a country where jaquars are only been seen in a zoo. :)
[/quote]I am sad that I live in a country where most species of animal can only be seen in a zoo, and not in the wild. That includes jaguars.
[/quote]
Yes and no,
if they are also seen in the wild, you have to take care where you are around, and might not just walk anywhere in the outside....
-
Any idea yet on when the API might be made accessible again please?
-
[quote author="ZapB" date="1303978592"]Any idea yet on when the API might be made accessible again please?[/quote]
We're still getting a very high amount of API hits on the front end server. See graph:
!http://dl.dropbox.com/u/217336/cache-server-hits_0411.png!
The low level you see on the left is the normal request rate.
Those requests are now taken care of by the cache server only (giving 403s) so they don't affect the site performance. The requests never make it to the web server layer and below.
Vass has a new version of the plugin ready so as soon as that is tested and deployed I expect it to take a little while for the browsers out there to get updated and we will see the drop to normal traffic. As soon as we see that we will enable the API again.
-
OK thanks for the update and thanks to Vass for fixing the Chrome plugin.
-
[quote author="Gerolf" date="1303913677"]
[quote author="Andre" date="1303908659"]
[quote author="vinb" date="1303840005"]
[quote author="ucomesdag" date="1303824601"]
Talking about kitten, found an injured jaguar that was hit by a car last weekend when driving home.[/quote]Wow!
Im glad, living in a country where jaquars are only been seen in a zoo. :)
[/quote]I am sad that I live in a country where most species of animal can only be seen in a zoo, and not in the wild. That includes jaguars.
[/quote]
Yes and no,
if they are also seen in the wild, you have to take care where you are around, and might not just walk anywhere in the outside....[/quote]
In the wild you never see them even though they are around, when camping in the forest you can see their tracks because they sometimes follow you in circles. But never heard of someone being attacked by a jaguar afaik. Btw. the biggest risk here is to be killed by falling tree or simply getting lost :)
-
On topic: Just saw that the extension got updates to 0.9.96. I hope that this will fix it and get things back on track, getting withdrawal symptoms :-)
-
I'll wait for vass to announce that he found and fixed the issue (if it is indeed an issue with his plugin, of course).
-
Hello folks!
I think I fixed issue. Because API disabled, I tested it only on local API simulator. New version now available. Wait when Marius enable API.
-
Any idea how I update it to the latest version? Or does Chrome do that automagically?
-
I'm not sure about automatically
options->tools->extensions
click on "developer mode"
button "update extensions"or just reinstall it from here: https://chrome.google.com/extensions/detail/mhbcdhmbdinbggoongcnmblnclloilbh
-
Thanks Vass, I'll keep an eye on the request rate :)
-
Is any troll apart from Marius able to check this whilst Marius is on hols please? How are the API requst levels now and can they be reinstated please?
-
[quote author="ZapB" date="1304500975"]Is any troll apart from Marius able to check this whilst Marius is on hols please? How are the API requst levels now and can they be reinstated please?[/quote]
I second that!
-
Greetings from a beach bungalow in San Diego :)
!http://dl.dropbox.com/u/217336/varnish_request_rate-month.png(graph)!
We're still seeing volumes of API traffic way above normal. It´s trending downwards though.
-
OK Marius. Thanks for the update. Enjoy your hols :-)
-
[quote author="mariusg" date="1305002565"]Greetings from a beach bungalow in San Diego :)[/quote]
Some much needed sunshine? ;-)
-
The stats are not going down as we have hoped, so I suggest we do a +1 on the API version and provide it on a new unblocked URL.
From http://developer.qt.nokia.com/qtapi/0/* to http://developer.qt.nokia.com/qtapi/1/*.
We would then stop /0/ in the firewall and consider it forever unavailable.
Yay or nay? :)
-
It might be a good idea, but there is nothing to stop this from happening again. Would it be a good idea to hand out API keys for apps to use? That way, you can at least monitor what application is causing trouble.
-
Andre, do you mean something like OAuth?
-
I don't know much about OAuth, so I would not know. What I mean is that as a developer working against the API, you would request a unique key to use for your application. You would append this key to your requests as an additional parameter. The API would only respond if the API key is valid, and give an error otherwise.
I think Google uses something like this to keep track of the use of their services. It can also be used to limit the number of requests for a specific application of the API.
-
Yep, agreed with this suggestion.
Also it will be good to have devnet auth in new api :)
-
Welcome back Marius. Yes an API key would be a good idea.
Marius, can you tell from the logs what user-agent or ip blocks are causing the problems?
-
We have opened up v1 of the API now:
http://developer.qt.nokia.com/qtapi/1/member/profile
http://developer.qt.nokia.com/qtapi/1/forums/posts/unreadNo API keys needed yet, but we're evaluating that as a good idea for the future.
v0 of the API is still getting hammered.
-
Excellent. Thanks Marius. I'll update my client over the weekend and give it a test drive. Have a good weekend.
-
[quote author="ZapB" date="1307111488"]Excellent. Thanks Marius. I'll update my client over the weekend and give it a test drive. Have a good weekend.[/quote]
Same to you! I've mailed Vass with the update, so he can test his plugin - and maybe we can be back to normal.
-
The badges list in the http://developer.qt.nokia.com/qtapi/1/member/profile result is incomplete.
){kind=link}