Industrial IoT Authors: Derek Weeks, Yeshim Deniz, Kevin Jackson, Elizabeth White, SmartBear Blog

Related Topics: Industrial IoT

Industrial IoT: Article

Combining XQuery and Web Services

Combined entities can lead to sophisticated solutions

The XML world is driving new emerging technologies that can be utilized to provide solutions to a variety of problems. This article focuses on two of these technologies: Web services and XQuery. As separate entities, these technologies provide a powerful set of features; but when combined they have the potential to present ever more sophisticated feature sets designed for very specific goals.

Web services, while not strictly an XML technology, depends heavily on XML for both its definition language, Web Services Description Language (WSDL), and its messaging protocol, Simple Object Access Protocol (SOAP). Alongside its various descendants, WSDL itself builds on previous XML technologies, such as XML Schema, to provide an abstraction layer over which service endpoints can be defined in terms of messages and operations. Similarly, SOAP provides a mechanism for issuing remote procedural calls and document transactions between distributed systems.

Correspondingly, XQuery provides a rich, data-oriented language for interacting with XML and XML-mapped data sources. It builds on existing XML technologies such as XPath and XML Schema to provide a unified query language over both weakly typed (streams, Web sites) and strongly typed (databases, messages) XML sources. Unlike other query languages, such as SQL, it is intended to not only be a database query language, but a general language for natively interacting with XML as well.

Both technologies have starring roles in new methodologies for solving old problems. Service-oriented architecture (SOA) promises to open up all of the applications in the enterprise via Web services. With it, application developers can build new applications from the functions and features of existing applications. Enterprise Information Integration (EII), utilizing XQuery, makes a similar promise: to present a single front end to all of the databases and data sources available on the network. In both cases, the goal is to bring together the processes and data we interact with individually in a manner that reduces the amount of custom mapping required for each source.

Our ultimate goal herein will be to demonstrate how Web services and XQuery combined can ease the task of developing applications on top of heterogeneous distributed systems. Essentially, we're looking to these technologies to hide all of the differences between the systems with which we wish to interact and allow developers to concentrate on the applications being developed.

Integrating XQuery with Web Services
Whether you look at adding XQuery to Web services or Web services to XQuery, the respective technology will gain something it did not previously have. On one hand XQuery, a language intended to manage, restrict, and combine static data from multiple sources of data (relational databases, XML databases, static Web content), can simplify interactions with XML-based Web services. On the other hand, Web services open XQuery up to more sophisticated interactions with systems outside its local scope. By combining XQuery and Web services, XQuery receives a new interaction model with external sources and Web services along with a sophisticated language for handling its input and output.

To illustrate just one possibility offered by the interaction, consider the following scenario. Super Travel Agency (STA) wishes to present a new feature on its Web site, awarding its repeat customers with fare estimates based not only on best fares but on their participation in frequent flyer programs. STA has a complete customer database with profiles listing their frequent flyer codes for each airline. For this system, STA needs to interact with the airlines via Web services that are defined using completely different result formats.

This fairly straightforward usecase can be accomplished in a discrete series of steps. First, the user profile is accessed and the relevant frequent flyer codes extracted. Combining these codes with destinations and dates, we then pass them to the appropriate airline services and receive a quote from each in a different XML format. We then have to define either a transformation or a custom extraction routine to extract the prices. Finally, we have to take this correlated data and produce a single report for consumption by the client.

In traditional modern programming languages, this problem could be solved by defining a number of discrete modules. One module would access and interpret the client database result, one would be defined for interacting with each airline Web service, one each for the extraction routines to parse the XML results and extract the relevant information, and finally a module for generating the final report. All of the interactions are defined in terms of XML messages, but given the disparate requirements of each such message format the solution will typically have to define a number of custom parsers to convert in and out of the data-oriented XML and object-oriented language paradigms. Simply put, this requires specialized coding and, while extensible, usually requires much more code to integrate new airlines and new client profiling data.

By allowing existing WSDL definitions to be referenced in the query and their services exposed as standard XQuery functions, the steps followed to achieve the solution can be more concise using XQuery. The simplicity is achieved by leaving the entire sequence of interactions in the XML world and taking advantage of XQuery's rich set of features for dealing with XML data to seamlessly interact with all of the various data and function points.

In order to facilitate this interaction between XQuery and Web services, we'll employ an extension to the XQuery language. This syntax parallels the built-in schema import facility in XQuery and was first proposed in XQuery at your Web service. We'll see below how it allows the query author to specify the services to be used in the query by simply importing the WSDL documents defining those services.

Bridging the Gap
In technology, gaps force us to build new technology to bridge disparate paradigms. XQuery sought to bridge the gap between modern programming languages and data. Web services sought to bridge the gap between those same programming languages and distributed processes. We've defined how to bridge the gap between XQuery and Web services; now in closing the gap between the posited airline scenario and the XQuery/Web services solution, we'll hopefully demonstrate how many of the gaps in existing solutions are now bridged.

Recall that the basic problem STA faced could be solved in a discrete series of steps. All steps essentially revolved around the disparate data requirements at each point in the interaction: the client, the database, and the airline services. We'll take each in turn and build up to a total solution. The inputs to our scenario are the client's identification ($client-id) and request parameters ($city and $date).

More Stories By Jeff Dexter

Jeff Dexter is the lead architect of XML Query technologies at Raining Data Corporation, and their representative on the W3C?s XML Query working group. Jeff has spent the last six years in the field of information aggregation and database query, specifically focusing on the realm of XML query at Raining Data. Jeff was the designer and main implementer of the TigerLogic 1.0 high-performance query engine, and the architect and principal engineer on the TigerLogic 2.0 data server.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.

@ThingsExpo Stories
SYS-CON Events announced today that EnterpriseTech has been named “Media Sponsor” of SYS-CON's 21st International Cloud Expo, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. EnterpriseTech is a professional resource for news and intelligence covering the migration of high-end technologies into the enterprise and business-IT industry, with a special focus on high-tech solutions in new product development, workload management, increased effi...
Internet of @ThingsExpo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 21st Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The Internet of Things (IoT) is the most profound change in personal and enterprise IT since the creation of the Worldwide Web more than 20 years ago. All major researchers estimate there will be tens of billions devic...
SYS-CON Events announced today that SourceForge has been named “Media Sponsor” of SYS-CON's 21st International Cloud Expo, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. SourceForge is the largest, most trusted destination for Open Source Software development, collaboration, discovery and download on the web serving over 32 million viewers, 150 million downloads and over 460,000 active development projects each and every month.
Multiple data types are pouring into IoT deployments. Data is coming in small packages as well as enormous files and data streams of many sizes. Widespread use of mobile devices adds to the total. In this power panel at @ThingsExpo, moderated by Conference Chair Roger Strukhoff, panelists looked at the tools and environments that are being put to use in IoT deployments, as well as the team skills a modern enterprise IT shop needs to keep things running, get a handle on all this data, and deliver...
We build IoT infrastructure products - when you have to integrate different devices, different systems and cloud you have to build an application to do that but we eliminate the need to build an application. Our products can integrate any device, any system, any cloud regardless of protocol," explained Peter Jung, Chief Product Officer at Pulzze Systems, in this SYS-CON.tv interview at @ThingsExpo, held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA
SYS-CON Events announced today that IBM has been named “Diamond Sponsor” of SYS-CON's 21st Cloud Expo, which will take place on October 31 through November 2nd 2017 at the Santa Clara Convention Center in Santa Clara, California.
SYS-CON Events announced today that CHEETAH Training & Innovation will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct. 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. CHEETAH Training & Innovation is a cloud consulting and IT training firm specializing in improving clients cloud strategies and infrastructures for medium to large companies.
SYS-CON Events announced today that TMC has been named “Media Sponsor” of SYS-CON's 21st International Cloud Expo and Big Data at Cloud Expo, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Global buyers rely on TMC’s content-driven marketplaces to make purchase decisions and navigate markets. Learn how we can help you reach your marketing goals.
"MobiDev is a Ukraine-based software development company. We do mobile development, and we're specialists in that. But we do full stack software development for entrepreneurs, for emerging companies, and for enterprise ventures," explained Alan Winters, U.S. Head of Business Development at MobiDev, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
SYS-CON Events announced today that Conference Guru has been named “Media Sponsor” of SYS-CON's 21st International Cloud Expo, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. A valuable conference experience generates new contacts, sales leads, potential strategic partners and potential investors; helps gather competitive intelligence and even provides inspiration for new products and services. Conference Guru works with conference organi...
With major technology companies and startups seriously embracing Cloud strategies, now is the perfect time to attend 21st Cloud Expo October 31 - November 2, 2017, at the Santa Clara Convention Center, CA, and June 12-14, 2018, at the Javits Center in New York City, NY, and learn what is going on, contribute to the discussions, and ensure that your enterprise is on the right path to Digital Transformation.
IoT solutions exploit operational data generated by Internet-connected smart “things” for the purpose of gaining operational insight and producing “better outcomes” (for example, create new business models, eliminate unscheduled maintenance, etc.). The explosive proliferation of IoT solutions will result in an exponential growth in the volume of IoT data, precipitating significant Information Governance issues: who owns the IoT data, what are the rights/duties of IoT solutions adopters towards t...
With the introduction of IoT and Smart Living in every aspect of our lives, one question has become relevant: What are the security implications? To answer this, first we have to look and explore the security models of the technologies that IoT is founded upon. In his session at @ThingsExpo, Nevi Kaja, a Research Engineer at Ford Motor Company, discussed some of the security challenges of the IoT infrastructure and related how these aspects impact Smart Living. The material was delivered interac...
No hype cycles or predictions of zillions of things here. IoT is big. You get it. You know your business and have great ideas for a business transformation strategy. What comes next? Time to make it happen. In his session at @ThingsExpo, Jay Mason, Associate Partner at M&S Consulting, presented a step-by-step plan to develop your technology implementation strategy. He discussed the evaluation of communication standards and IoT messaging protocols, data analytics considerations, edge-to-cloud tec...
New competitors, disruptive technologies, and growing expectations are pushing every business to both adopt and deliver new digital services. This ‘Digital Transformation’ demands rapid delivery and continuous iteration of new competitive services via multiple channels, which in turn demands new service delivery techniques – including DevOps. In this power panel at @DevOpsSummit 20th Cloud Expo, moderated by DevOps Conference Co-Chair Andi Mann, panelists examined how DevOps helps to meet the de...
When growing capacity and power in the data center, the architectural trade-offs between server scale-up vs. scale-out continue to be debated. Both approaches are valid: scale-out adds multiple, smaller servers running in a distributed computing model, while scale-up adds fewer, more powerful servers that are capable of running larger workloads. It’s worth noting that there are additional, unique advantages that scale-up architectures offer. One big advantage is large memory and compute capacity...
"When we talk about cloud without compromise what we're talking about is that when people think about 'I need the flexibility of the cloud' - it's the ability to create applications and run them in a cloud environment that's far more flexible,” explained Matthew Finnie, CTO of Interoute, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
SYS-CON Events announced today that Datanami has been named “Media Sponsor” of SYS-CON's 21st International Cloud Expo, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Datanami is a communication channel dedicated to providing insight, analysis and up-to-the-minute information about emerging trends and solutions in Big Data. The publication sheds light on all cutting-edge technologies including networking, storage and applications, and thei...
SYS-CON Events announced today that Silicon India has been named “Media Sponsor” of SYS-CON's 21st International Cloud Expo, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Published in Silicon Valley, Silicon India magazine is the premiere platform for CIOs to discuss their innovative enterprise solutions and allows IT vendors to learn about new solutions that can help grow their business.
The Internet giants are fully embracing AI. All the services they offer to their customers are aimed at drawing a map of the world with the data they get. The AIs from these companies are used to build disruptive approaches that cannot be used by established enterprises, which are threatened by these disruptions. However, most leaders underestimate the effect this will have on their businesses. In his session at 21st Cloud Expo, Rene Buest, Director Market Research & Technology Evangelism at Ara...