HTTP Automation Framework / Project GRAV
One of the projects I’ve been working on recently has included an HTTP Automation Engine. The SDK I'm developing will allow rapid production of data-services specifically designed to automate web-page scraping. The goal of this system is to create web-services specifically for accessing secured resources. There are many benefits to using an automation framework:
By creating my own optimized web client system, I have significantly improved page access times through algorithms designed to quickly and efficiently parse and traverse resulting HTML.
When used in conjunction with my GRAV scripting language, page scraping and HTTP request scripts can be easily created with abbreviated syntax and DOM-optimized syntax.
With a single point of maintenance, any improvements I make will be instantly propagated to all services developed with the engine. Supportability and future improvements would represent a huge benefit.
An example of the HTTP Framework can be seen through the flowchart below. The lifecycle of a data-enabled http scraping engine could drastically change the type of information available to mobile and desktop applications.
Form more information about the engine, feel free to contact me!