Page 201 - Building Big Data Applications

Chapter 11 Data discovery and connectivity 201

FIGURE 11.3 The new connected islands of data.

workloads in a cost-effective manner. This is a syndrome that I refer to as “infrastructure
fatigue”. Even the best in class database systems with all their infrastructure power
cannot sustain the workload demands, which drove us to innovate further (Fig. 11.4).
We have evolved in the infrastructure journey with cloud computing, driven by the
internet and eCommerce which has quickly changed the landscape of how we can
perform computing on data of multiple formats with minimal dependency on databases
and moved the users to a world of thrill and immense compute fantasy. However moving
infrastructure to the cloud means that we will now use cloud storage, which needs a new
data architecture and file design, new governance policies and mechanisms to manage

FIGURE 11.4 Workloads on datadinfrastructure fatigue.