RSS-Spider

Development, Ideas, Issues, problems, ßetas and what not…

Merry Christmas & Everything Else

Filed under: What Not... — Dave at 8:57 pm on Saturday, December 24, 2005

Merry Christmas… We’ll be away for a few days in Buffalo New York. See you at Ted’s Red Hots!

Speed is an issue

Filed under: Issues, Problems — Dave at 12:22 am on Wednesday, December 21, 2005

I’ve been noticing that some times it takes upwards of a minute or more to return a search. This ain’t good. Looking into it I see that MySql is attemping to do UPDATES and SELECTS at the same time. The spider is updating the RSS feed links to current time (last polled) while people are using the database. I’ve bundled all the updates into a single querey and added PRIORITY_LOW to the updates. Remove all other updates which weren’t doing anything meaningful ie: number of times an item was viewed on a returning search page… bah… crap…

New search variable “SITE:”

Filed under: Development — Dave at 9:05 am on Tuesday, December 20, 2005

You can now search for sites in RSS-Spider. “SITE:” (without the quotes of course) + www.webaddress.com will search for all items listed in our database from that particular site. Searching for SITE:www.cleveland.com will show all the RSS items from www.Cleveland.com (if any). Unlike Google or Yahoo! you can also do a partial site search… Searching for SITE:cleveland will search for all web addresses with the term cleveland in them and return all items on those pages.

Top 10 working again… New && Blue!

Filed under: What Not... — Dave at 11:01 pm on Sunday, December 18, 2005

And it’s working so nicely that I thought it should replace our home page. So now we have the top ten searchs for the last 24 hours instead of the top ten searches ever…

you may also have noticed the background color has changed. The dull grey wasn’t really doing it for me anymore. I’m php programmer first, database developer second, sales support monkey third… blah blah blah, and a graphic designer ninenty second. I liked the blue on the blog so I spread it around the site tonight.

Top 10 Searches

Filed under: Problems — Dave at 9:06 pm on Sunday, December 18, 2005

Ok… Top 10 Searches is broken…