Welcome!

Industrial IoT Authors: Elizabeth White, Carmen Gonzalez, William Schmarzo, Yeshim Deniz, Liz McMillan

Blog Feed Post

MarkLogic 6: An introduction

By

The latest permeation of MarkLogic (version 6) offers ACID (atomicity, consistency, isolation, durability) transactions, horizontal scaling, real-time indexing, high availability, disaster recovery, government-grade security and built-in search.

MarkLogic has made application development easier with Java and REST APIs. They also added JSON support. This allows developers to use their language of choice, and eliminate the need to learn new production language. It also provides data visualization widgets. These widgets can display the shape and dimensions of data, identify trends or patterns and explore the data as a whole.

Version 6 also comes with built in database analytics. Integration with IBM Cognos and Tableau is included as well. This enables analysts to create reports, dashboards and the data. Lastly, version 6 adds the in-database MapReduce capabilities.

Find out more about MarkLogic version 6 here.

And here is more from their website:

Mission-critical Big Data Applications around the world are powered by MarkLogic. It is the only Enterprise NoSQL database that manages all types of data at scale in real time. It gives you the range of features you need to deliver value. It lets you leverage your existing tools, knowledge, and experience. And it provides a reliable, scalable, and secure platform for your important data.

New Feature Highlights

Business Intelligence Tools

Business Intelligence Tools
Big Data in the enterprise needs to be accessible to everyone who could benefit from the information. To make that easier, MarkLogic now includes out-of-the-box integration with Business Intelligence tools like IBM Cognos and Tableau to allow analysts to use familiar solutions for generating reports, dashboards and data exploration results from data stored in MarkLogic.

 

REST API

REST API
In order to enable developers to work in their language of choice, MarkLogic now includes a REST API that allows you to perform searches, create documents, read documents, update documents, and delete documents. The REST API allows you to build fully functional MarkLogic applications in any programming language. It also allows you to directly load JSON documents.

 

MarkLogic Java API

MarkLogic Java API
The new Java API allows you full-featured access to MarkLogic functionality with pure Java. The MarkLogic Java API is written on top of the REST API, and has all of its functionality such as paginated search with facets and snippets, full document CRUD operations, and more.

 

Enhanced JSON Support

Enhanced JSON Support
Our new JSON library makes it easy to store JSON documents as key-value stores, and to convert them back and forth between JSON and XML. The REST Client API and the MarkLogic Client API for Java make use of this functionality to make it easier to load and work with JSON documents.

 

Visualization Widgets

Visualization Widgets
We’ve also added Visualization Widgets so you can easily build powerful applications that help your users discover the shape and dimensions of data, quickly assess trends and patterns, and explore data more intuitively. You can access these widgets with MarkLogic Application Builder.

 

In-database MapReduce & User Defined Functions

In-database MapReduce & User Defined Functions
Many customers wanted more flexibility to develop complex, real-time analytics. We’ve extended MarkLogic 6 to let you create user-defined aggregate functions (UDFs) that take advantage of MarkLogic’s parallel-processing architecture. We call this In-database MapReduce, and it lets you create blindingly fast analytic functions with custom C++ code by writing “map” and “reduce” functions.

 

In-Database Analytic Functions

In-Database Analytic Functions
In order to enable customers to leverage the power of the MarkLogic platform to produce enterprise-grade analytics, we’ve included several built-in XQuery functions to perform analytic and statistical functions.

 

MarkLogic Content Pump (mlcp)

MarkLogic Content Pump
In order to speed loading and exporting of data between databases, we are introducing the MarkLogic Content Pump (mlcp). mlcp is a command-line tool for loading content into MarkLogic Server and for migrating content from one instance of MarkLogic to another, even if they are on different platforms. If you have a Hadoop cluster, mlcp takes advantage of Hadoop to parallelize the loading. mlcp takes much of the functionality of the open source projects Record Loader and xqsync and bundles them in a single package, and allows them to take advantage of Hadoop if it is available; Hadoop is not required to use mlcp, but is used if it is available.

 

FIPS 140-2 Cryptographic Compliance

FIPS 140-2 Cryptographic Compliance
MarkLogic 6 includes the OpenSSL Federal Information Processing Standard (FIPS) Object Module, which was evaluated by the National Institute of Standards (NIST) for FIPS 140-2 compliance. More details on the OpenSSL Object Module and on the FIPS 140-2 compliance.

 

Search API Enhancements

Search API Enhancements
When you’ve got a lot of data, great search is key. We’ve worked to make our search API even better with the following enhancements:

  • Structured Search
  • Extracting metadata at search time
  • Modify the unconstrained term behavior using <search:term>
  • Range constraints for path range indexes
  • Ability to return values from range indexes with search:values
  • JSON key support

 

Path Range Indexes

Path Range Indexes
In order to enable fine-grained range indexes while maintaining the advantages of using the lexicon functions and the range query constructors MarkLogic now includes support for range index specified by a path. You can specify a subset of XPath as the definition of what goes into an index. The search API can take advantage of path range indexes to create range constraints on them. Path range indexes are also useful when setting up SQL views on data stored in a MarkLogic database.

 

Synonym Search

Synonym Search
You now have the option to ensure that documents that contain multiple synonyms are scored appropriately, rather than unnaturally gaining points to the search score. Learn more about how the architecture of MarkLogic works and how you can deploy it.

Read the original blog entry...

More Stories By Bob Gourley

Bob Gourley writes on enterprise IT. He is a founder and partner at Cognitio Corp and publsher of CTOvision.com

@ThingsExpo Stories
In his keynote at 18th Cloud Expo, Andrew Keys, Co-Founder of ConsenSys Enterprise, provided an overview of the evolution of the Internet and the Database and the future of their combination – the Blockchain. Andrew Keys is Co-Founder of ConsenSys Enterprise. He comes to ConsenSys Enterprise with capital markets, technology and entrepreneurial experience. Previously, he worked for UBS investment bank in equities analysis. Later, he was responsible for the creation and distribution of life sett...
The WebRTC Summit New York, to be held June 6-8, 2017, at the Javits Center in New York City, NY, announces that its Call for Papers is now open. Topics include all aspects of improving IT delivery by eliminating waste through automated business models leveraging cloud technologies. WebRTC Summit is co-located with 20th International Cloud Expo and @ThingsExpo. WebRTC is the future of browser-to-browser communications, and continues to make inroads into the traditional, difficult, plug-in web ...
20th Cloud Expo, taking place June 6-8, 2017, at the Javits Center in New York City, NY, will feature technical sessions from a rock star conference faculty and the leading industry players in the world. Cloud computing is now being embraced by a majority of enterprises of all sizes. Yesterday's debate about public vs. private has transformed into the reality of hybrid cloud: a recent survey shows that 74% of enterprises have a hybrid cloud strategy.
Internet-of-Things discussions can end up either going down the consumer gadget rabbit hole or focused on the sort of data logging that industrial manufacturers have been doing forever. However, in fact, companies today are already using IoT data both to optimize their operational technology and to improve the experience of customer interactions in novel ways. In his session at @ThingsExpo, Gordon Haff, Red Hat Technology Evangelist, will share examples from a wide range of industries – includin...
WebRTC is the future of browser-to-browser communications, and continues to make inroads into the traditional, difficult, plug-in web communications world. The 6th WebRTC Summit continues our tradition of delivering the latest and greatest presentations within the world of WebRTC. Topics include voice calling, video chat, P2P file sharing, and use cases that have already leveraged the power and convenience of WebRTC.
"We build IoT infrastructure products - when you have to integrate different devices, different systems and cloud you have to build an application to do that but we eliminate the need to build an application. Our products can integrate any device, any system, any cloud regardless of protocol," explained Peter Jung, Chief Product Officer at Pulzze Systems, in this SYS-CON.tv interview at @ThingsExpo, held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.
Data is the fuel that drives the machine learning algorithmic engines and ultimately provides the business value. In his session at 20th Cloud Expo, Ed Featherston, director/senior enterprise architect at Collaborative Consulting, will discuss the key considerations around quality, volume, timeliness, and pedigree that must be dealt with in order to properly fuel that engine.
"Once customers get a year into their IoT deployments, they start to realize that they may have been shortsighted in the ways they built out their deployment and the key thing I see a lot of people looking at is - how can I take equipment data, pull it back in an IoT solution and show it in a dashboard," stated Dave McCarthy, Director of Products at Bsquare Corporation, in this SYS-CON.tv interview at @ThingsExpo, held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.
IoT is rapidly changing the way enterprises are using data to improve business decision-making. In order to derive business value, organizations must unlock insights from the data gathered and then act on these. In their session at @ThingsExpo, Eric Hoffman, Vice President at EastBanc Technologies, and Peter Shashkin, Head of Development Department at EastBanc Technologies, discussed how one organization leveraged IoT, cloud technology and data analysis to improve customer experiences and effici...
Fact is, enterprises have significant legacy voice infrastructure that’s costly to replace with pure IP solutions. How can we bring this analog infrastructure into our shiny new cloud applications? There are proven methods to bind both legacy voice applications and traditional PSTN audio into cloud-based applications and services at a carrier scale. Some of the most successful implementations leverage WebRTC, WebSockets, SIP and other open source technologies. In his session at @ThingsExpo, Da...
"IoT is going to be a huge industry with a lot of value for end users, for industries, for consumers, for manufacturers. How can we use cloud to effectively manage IoT applications," stated Ian Khan, Innovation & Marketing Manager at Solgeniakhela, in this SYS-CON.tv interview at @ThingsExpo, held November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA.
As data explodes in quantity, importance and from new sources, the need for managing and protecting data residing across physical, virtual, and cloud environments grow with it. Managing data includes protecting it, indexing and classifying it for true, long-term management, compliance and E-Discovery. Commvault can ensure this with a single pane of glass solution – whether in a private cloud, a Service Provider delivered public cloud or a hybrid cloud environment – across the heterogeneous enter...
The cloud promises new levels of agility and cost-savings for Big Data, data warehousing and analytics. But it’s challenging to understand all the options – from IaaS and PaaS to newer services like HaaS (Hadoop as a Service) and BDaaS (Big Data as a Service). In her session at @BigDataExpo at @ThingsExpo, Hannah Smalltree, a director at Cazena, provided an educational overview of emerging “as-a-service” options for Big Data in the cloud. This is critical background for IT and data professionals...
Today we can collect lots and lots of performance data. We build beautiful dashboards and even have fancy query languages to access and transform the data. Still performance data is a secret language only a couple of people understand. The more business becomes digital the more stakeholders are interested in this data including how it relates to business. Some of these people have never used a monitoring tool before. They have a question on their mind like “How is my application doing” but no id...
@GonzalezCarmen has been ranked the Number One Influencer and @ThingsExpo has been named the Number One Brand in the “M2M 2016: Top 100 Influencers and Brands” by Onalytica. Onalytica analyzed tweets over the last 6 months mentioning the keywords M2M OR “Machine to Machine.” They then identified the top 100 most influential brands and individuals leading the discussion on Twitter.
What happens when the different parts of a vehicle become smarter than the vehicle itself? As we move toward the era of smart everything, hundreds of entities in a vehicle that communicate with each other, the vehicle and external systems create a need for identity orchestration so that all entities work as a conglomerate. Much like an orchestra without a conductor, without the ability to secure, control, and connect the link between a vehicle’s head unit, devices, and systems and to manage the ...
More and more brands have jumped on the IoT bandwagon. We have an excess of wearables – activity trackers, smartwatches, smart glasses and sneakers, and more that track seemingly endless datapoints. However, most consumers have no idea what “IoT” means. Creating more wearables that track data shouldn't be the aim of brands; delivering meaningful, tangible relevance to their users should be. We're in a period in which the IoT pendulum is still swinging. Initially, it swung toward "smart for smar...
In an era of historic innovation fueled by unprecedented access to data and technology, the low cost and risk of entering new markets has leveled the playing field for business. Today, any ambitious innovator can easily introduce a new application or product that can reinvent business models and transform the client experience. In their Day 2 Keynote at 19th Cloud Expo, Mercer Rowe, IBM Vice President of Strategic Alliances, and Raejeanne Skillern, Intel Vice President of Data Center Group and G...
Information technology is an industry that has always experienced change, and the dramatic change sweeping across the industry today could not be truthfully described as the first time we've seen such widespread change impacting customer investments. However, the rate of the change, and the potential outcomes from today's digital transformation has the distinct potential to separate the industry into two camps: Organizations that see the change coming, embrace it, and successful leverage it; and...
With major technology companies and startups seriously embracing IoT strategies, now is the perfect time to attend @ThingsExpo 2016 in New York. Learn what is going on, contribute to the discussions, and ensure that your enterprise is as "IoT-Ready" as it can be! Internet of @ThingsExpo, taking place June 6-8, 2017, at the Javits Center in New York City, New York, is co-located with 20th Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry p...