Loud Baking

One of the application’s core functionalities is monitoring changes on different sources. Some of which have some kind of webservices available while other don’t. By monitoring I mean getting, validating, storing and comparing the data over time. For that, different data manipulations are required:

• fetching
• scraping
• parsing
• cleansing
• storing
• mining

I will share in this serie of posts different resources, code snippets, benchmarks and techniques related to one or more of the above. Maybe if I get enough time, I can cover them all and group them in one easy-to-understand chapter: data manipulation 101.

The sandbox environement I am using:

• PHP 5.2.3
• libcurl
• dom.
• MySQL 5.1

And now, on with the show. Next up, Data Scraping.

This entry was posted on Monday, July 30th, 2007 at 1:48 pm and is filed under Coding. You can follow any responses to this entry through the RSS 2.0 feed. You can leave a response, or trackback from your own site.