YOUR FEEDBACK
Kirstan Vandersluis wrote: Great intro to SOA, Paul. You mention in the summary that budget cuts may stifl...
Cloud Computing Conference
March 30 - April 1, New York
Register Today and SAVE !..


2008 East
DIAMOND SPONSOR:
Data Direct
Frontiers in Data Access: The Coming Wave in Data Services
PLATINUM SPONSORS:
Red Hat
The Opening of Virtualization
Intel
Virtualization – Path to Predictive Enterprise
Green Hills
IT Security in a Hostile World
JBoss / freedom oss
Practical SOA Approach
GOLD SPONSORS:
Software AG
The Art & Science of SOA: How Governance Enables Adoption
PlateSpin
Effective Planning for Virtual Infrastructure Growth
Fujitsu
Automated Business Process Discovery & Virtualization Service
Ceedo
Workspace Virtualization
Click For 2007 West
Event Webcasts

2008 East
PLATINUM SPONSORS:
Appcelerator
Think Fast: Accelerate AJAX Development with Appcelerator
GOLD SPONSORS:
DreamFace Interactive
The Ultimate Framework for Creating Personalized Web 2.0 Mashups
ICEsoft
AJAX and Social Computing for the Enterprise
Kaazing
Enterprise Comet: Real–Time, Real–Time, or Real–Time Web 2.0?
Nexaweb
Now Playing: Desktop Apps in the Browser!
Sun
jMaki as an AJAX Mashup Framework
POWER PANELS:
The Business Value
of RIAs
What Lies Beyond AJAX?
KEYNOTES:
Douglas Crockford
Can We Fix the Web?
Anthony Franco
2008: The Year of the RIA
Click For 2007 Event Webcasts
SYS-CON.TV
TODAY'S TOP SOA & WEBSERVICES LINKS


What Lies Beneath
Data(base) considerations for service-oriented architectures

How important are data considerations to service-oriented architectures (SOA) vending Web services? Consider the following definition of Web services from AMR Research: "Web services have been commonly defined as a standardized way of integrating applications using Extensible Markup Language (XML), Simple Object Access Protocol (SOAP), Web Services Definition Language (WSDL), and Universal Description, Discovery and Integration (UDDI) standards. XML is used to tag the data; SOAP is used to transfer the data; WSDL is used for describing the services available; and UDDI is used for listing what services are available." (All the emphasis is mine).

In other words, we use technologies such as UDDI, WSDL, SOAP, and XML to find, understand, package, and format Web services - but the services themselves are all about managing data and providing data-based behavior. Now, this is neither the time nor the place to get into a "process v/s data" war. The point is simply that in order for service-oriented architecture to deliver up to expectations, there must be serious consideration of data-related factors. What are these factors? From the perspective of data management, interestingly enough, these factors are essentially no different for Web services architecture than for other application architectures, such as a client/server application or a conventional Web-based transaction processing application. (Conventional and Web-based together? How the times have changed.) A note to the purists: for the purposes of this article, "service-oriented architecture" and "Web services" are used interchangeably - in truth, of course, any loosely coupled, layered architecture where one or more layers exposes its functionality in the form of callable services may be deemed as a "service-oriented architecture."

Data Integration
Perhaps the most important aspect of data management is the integration of various components and layers of data. The greatest threat to the success of SOA lies here: fail to integrate all your data, and the application may tend to get increasingly disservice-oriented. As our information systems move from being soloists to joining ensembles, chorus and symphony are the name of the game. It is no longer sufficient that an application or a component of a large architecture manages its data correctly - though let's face it, even this is often no ordinary task. In addition, the component data must stay coordinated and "march in step" with other components. In a research paper on IT Trends 2004, Philip Russom of Giga Research (a wholly owned subsidiary of Forrester Research), identified the following key trends in data integration. In the paper, Mr. Russom discusses "data integration" from a more classical and thus somewhat different perspective than I have in mind; hence, although the bullet titles are borrowed from the paper, the ordering, interpretation, and corresponding descriptions are my own.

  • Convergence between data integration and application integration. No longer can data integration be viewed as a concern distinct from (and independent of) application integration. If we consider Web services architecture as a collection of semi-independent applications, then integrating these applications into a single cohesive architecture must pay attention to how the corresponding data repositories integrate, not just at the physical (database) level, but more important at the conceptual and transactional level.

  • Distributed architectures for data integration. Today, traditional (or classical) data integration has come to connote the bringing together of widely disparate and distributed data by various means such as data extraction-transformation-loading (ETL) and enterprise information integration (EII), which requires a distributed architectural approach (and curiously enough, may also use Web services!). On the other hand, while SOA may not quite be "distributed" in nature (or at least by definition), it is certainly not a conventional, centralized architecture: it falls, as a loosely coupled architecture, somewhere in the middle. From a data integration perspective, this loose coupling leads to considerations that are very similar to those in distributed data architectures: we would still have to deal with disparate data sources and data formats, and data integration is still de rigueur.

  • Real-time data integration. Perhaps the greatest data management challenge for service-oriented architectures is real-time data integration. Whereas conventional data integration - such as ETL - often contends with (and is content with) data integration with a degree of latency, the on-demand nature of Web services requires an on-demand integration of data. It is important to understand, however, that "on-demand" is not quite the same as "on-the-fly." On-demand (or real-time) data integration typically requires significant up-front planning, design, and development efforts in order for the promise to be realized. Once again, think symphony.

  • Virtual and federal data integration. If the problem is distributed data architectures and the need for real-time data integration, then consider using data virtualization techniques in your SOA. A "required competency" for service-oriented architectures that is reborn in the forceful new avatar of Enterprise Information Integration (EII), data virtualization is now available in the form of sophisticated, off-the-shelf solutions that you more or less plug into your SOA. Of course, this does not imply that the need for a planned approach for data integration is diminished in any way - in fact, quite the contrary.
  • About Rajan Chandras
    Rajan Chandras is a principal consultant with the New York offices of CSC Consulting (www.csc.com),. The article is written in his personal capacity and not on behalf of or representing CSC.

    XML JOURNAL LATEST STORIES . . .
    A few years ago, a British newspaper speculated on what might be the Web equivalent of the Seven Wonders of the World, and received suggestions that were hardly surprising: Google search, the Amazon.com e-tail portal, the eBay auction mechanism, etc. But that was back in 1991, before F...
    A round-up of the many themes and topics of interest to infrastructure architects, developers and IT managers featuring at SYS-CON's Cloud Computing Expo being held November 19-21, 2008 at The Fairmont Hotel in San Jose, California. The conference is expecting a record turnout of senio...
    SYS-CON Events announced today that the leading global SOA, Virtualization, Cloud Computing and Open Source technology provider FreedomOSS named "Gold Sponsor" of SYS-CON's SOA World Conference & Expo which will take place November 19-21, 2008, at the Fairmont Hotel in the heart of Sil...
    Cloud Computing offers significant benefits over traditional solutions for deploying production systems as well as for conducting development and testing activities. This session will distill the unique characteristics of clouds and describe how to best think about deployments in the c...
    Intel has just released Intel XML Software Suite 1.2. This latest release helps maximize XML performance, while minimizing the effort for any Enterprise, SOA, SaaS, and Web 2.0 based applications. Intel XML Software Suite 1.2 optimizes XML application performance, takes full advantage ...
    SUBSCRIBE TO THE WORLD'S MOST POWERFUL NEWSLETTERS
    SUBSCRIBE TO OUR RSS FEEDS & GET YOUR SYS-CON NEWS LIVE!
    Click to Add our RSS Feeds to the Service of Your Choice:
    Google Reader or Homepage Add to My Yahoo! Subscribe with Bloglines Subscribe in NewsGator Online
    myFeedster Add to My AOL Subscribe in Rojo Add 'Hugg' to Newsburst from CNET News.com Kinja Digest View Additional SYS-CON Feeds
    Publish Your Article! Please send it to editorial(at)sys-con.com!

    Advertise on this site! Contact advertising(at)sys-con.com! 201 802-3021


    SYS-CON FEATURED WHITEPAPERS


    ADS BY GOOGLE