TTIW Development Blog
Small new feature... and bot benchmarking.
I added a small new feature today, you can now order your wishes by Priority, Date Added or Site you add it from (Appart from alphabetically and price). It was a small thing but I had promissed users this and somebody asked for this today and well, it was a half an hour thing so there it is. It's only for managing. I'll add sorting (not ordering) for gifting during the next days, which I won´t be working that much at this, there is some real world stuff I need to do and I want to do some stuff with hCard. But I will be adding little small thingys like this one, I'll keep you informed through the blog.
I did a full benchmarking of the different processes of the bot and I have finally found what is slowing it down. First, I thought the problem was with the new contextual stuff, since I added this at last minute. I had some dead time while I waited for Ernesto to finnish something and I realized that I could do this from something that came up on the discussion at the microformats list. I figured that with the data the bot was already picking I could do some of the parsing based on contextual variables, and I had some dead time so I added that to the bot. This was kind of rushed to be honest. But I benchmarked this and it slows the bot down for about 10% to 30%. So I started digging further and I realized that querying amazon from my machine generally took 1 second while It took 6 from the site, this means that the getting of the page or XML document from the site is trully slow, I'm guessing that we are probably behind a proxy or some cache mechanism ( This would also explain why if you add an item then add it again, the second time takes 1 tenth of the time of the first one. The parsing is exactly the same and it's not cached, so the problem is when picking the page in itself.). So I will be contacting the people at our server provider regarding this. Hopefully they will give us some sort of solution since we are consuming data from all sort of sources and we plan of doing web services in the future.
Well that's pretty much it!
Comments are closed for this post.


Comments:
No Comments for this post yet...