HTTP Automation Framework / Project GRAV
One of the projects I’ve been working on recently has included an HTTP Automation Engine. The SDK I'm developing will allow rapid production of data-services specifically designed to automate web-page scraping. The goal of this system is to create web-services specifically for accessing secured resources. There are many benefits to using an automation framework:
-
By creating my own optimized web client system, I have significantly improved page access times through algorithms designed to quickly and efficiently parse and traverse resulting HTML.
-
When used in conjunction with my GRAV scripting language, page scraping and HTTP request scripts can be easily created with abbreviated syntax and DOM-optimized syntax.
-
With a single point of maintenance, any improvements I make will be instantly propagated to all services developed with the engine. Supportability and future improvements would represent a huge benefit.
An example of the HTTP Framework can be seen through the flowchart below. The lifecycle of a data-enabled http scraping engine could drastically change the type of information available to mobile and desktop applications.
Form more information about the engine, feel free to contact me!